您好,欢迎访问三七文档
APerturbationTheoryforErgodicPropertiesofMarkovChainsT.Shardlow12andA.M.Stuart1AbstractPerturbationstoMarkovchainsandMarkovprocessesareconsid-ered.Theunperturbedproblemisassumedtobegeometricallyer-godicinthesenseusuallyestablishedthroughuseofFoster-Lyapunovdriftconditions.Theperturbationsareassumedtobeuniform,inaweaksense,onboundedtimeintervals.Thelong-timebehaviouroftheperturbedchainisstudied.Applicationsaregiventonumer-icalapproximationsofarandomlyimpulsedODE,anIt^oSDEandaparabolicSPDEsubjecttospace-timeBrowniannoise.ExistingperturbationtheoriesforgeometricallyergodicMarkovchainsarenotreadilyapplicabletothesesituationssincetheyrequireverystringenthypothesesontheperturbations.KeyWords:MarkovChains,ErgodicTheory,NumericalApproxima-tion,RandomImpulses,StochasticDi erentialEquations,StochasticPartialDi erentialEquations.AMSSubjectClassi cations:60J10,60J27,65U,60H10,60H15,34A371Scienti cComputingandComputationalMathematicsProgram,Durand257,Stan-fordUniversity,StanfordCA94305-4040,USA.SupportedbytheNationalScienceFoun-dationundergrantDMS-95-04879.2CurrentAddress:IMA,UniversityofMinnesota,514VincentHall,MinneapolisMN55455{04361IntroductionItisfrequentlyofinteresttounderstandhowergodicpropertiesofMarkovchainspersistundervariouskindsofperturbations.Hereperturbationsto(discretetime)Markovchainsand(continuoustime)Markovprocessesevolv-inginaBanachspaceareconsidered.Inbothcasestheperturbationisas-sumedtobeadiscretetimeMarkovchainandourprimarymotivationistounderstandthenumericalapproximationofMarkovchainsandprocesses.TheunperturbedMarkovchainisassumedtobegeometricallyergodicim-plyingexponentialconvergenceofexpectationsoffunctionsfromacertainclass;thegeneralframeworkofgeometricergodicitywithinwhichweoper-ateistakenfromtheworkofMeynandTweedie[20,21]basedonFoster-Lyapunovdriftconditions.TheperturbedMarkovchainsareassumedtobeclosetotheunperturbedprobleminaweaksense:theerrorinexpectationsoffunctionsissmall,uniformlyoncompacttime-intervalsdisjointfromtheorigin,forfunctionsinthesameclass.Perturbationtheoriesforgeometri-callyergodicMarkovchainsdoexistalready,butitturnsoutthattheclassofperturbationsconsideredthereistypicallytoorestrictivetoadmitappli-cationtothenumericalmethodsconsideredhere{atleastforthe nitetimeapproximationresultsthatwearecurrentlyabletoobtainforthesenumeri-calmethods.Attheendofsection3wewillrelateourperturbationtheorytoanexistingperturbationtheoryduetoKartashov[13,14,15].PropertiesofergodicMarkovchainsunderperturbationhavebeenstudiedinmanyothercontexts;forexampleinSDEstheideaofapproximatingwhitenoisebyabroad-bandGaussiannoiseprocessisofinterestandthisisstudiedin[1]andfurtherin[17].Insection2ournotationandgeneralframeworkisestablished.Ageneraltheoryisdevelopedinsection3andthen,insection4,applicationsdescribedtothreeproblemswhere,inallcases,theperturbationarisesfromnumericalapproximation.The rstconcernsanODEsubjecttorandomimpulses,thesecondanIt^oSDE,andthethirdaparabolicSPDEsubjecttospace-timeBrowniannoise.Thenumericalsimulationofergodicstochasticprocessesinthecontextof nitedimensionalSDEshasbeenstudiedbyTalay[26]inthecasewherethegeneratoroftheprocessisuniformlyparabolic;seealso[27,10]and[16].Howeverinmanyapplicationsthisuniformparabolicitydoesnothold;ourtheoryencompassesproblemsforwhichthegeneratorisnotuniformly2parabolic,albeitatareducedrateofconvergencewhencomparedwiththeestimatesin[26].ForstochasticparabolicPDEs,muchisknownaboutap-proximationpropertieson nitetimeintervals[4,8,11,23],butthetheorypresentedhereenablesustoprovelong-timeweakconvergencepropertiesinthegeometricallyergodiccase;suchresultshavenotbeenobtainedbeforetothebestofourknowledge.2PreliminariesInthefollowingN=f1;2;3;:::gandZ+=f0;1;2;:::g:LetSbeaBanachspaceandB(S)bethecorrespondingBorel {algebra.WeconsiderMarkovchainsfun;n2Z+g;(2.1)ofrandomvariablesfromaprobabilityspace( ;F;P)to(S;B(S)).Foraninitialdistribution ,lettheprobabilitytriple( ;F;P )generatethechain(2:1).Weusethenotation xtodenoteapointmassatx2S:Expec-tationwithrespecttoP willbedenotedbyE .Finally,wede nemeasures non(S;B(S));parameterizedby 0= ,accordingto n(B)=P f!2 :un2Bg;B2B(S):WeapproximatetheMarkovchain(2:1)byaMarkovchainfun;n2Z+g;(2.2)ofrandomvariablesfromaprobabilityspace( ;F;P)to(S;B(S)).Foraninitialdistribution ,theprobabilitytriple( ;F;P )isassumedtogeneratethechain(2:2).ExpectationwithrespecttoP willbedenotedbyE ;thisshouldcausenoconfusionasitwillalwaysbeclearfromthecontextwhichunderlyingprobabilityspaceisgivingrisetotheexpectation.Inmanyapplicationstheunderlyingprobabilityspacesfor(2:1)and(2:2)willbethesamebutthisisnotnecessarilythecase,forexamplewhenweakapproximationsofstochasticdi erentialequationsarestudied.Wede nemeasures non(S;B(S));parameterizedby 0= ,accordingto n(B)=P f!2 :un2Bg;B2B(S):3Wewillalsoconsidertheapproximationoftime-continuousMarkovpro-cessesbytime-discreteMarkovchainsoftheform(2:2).Speci callywecon-siderastochasticprocessfu(t);t 0gofrandomvariablesfrom( ;F;P)to(S;B(S)).Foraninitialdistribtuon ,theprobabiltytriple( ;F;P )gener-atesthisprocess.Foreach
本文标题:A perturbation theory for ergodic properties of Ma
链接地址:https://www.777doc.com/doc-3330727 .html