半Markov控制過程的性能靈敏度分析、優(yōu)化及其算法研究.pdf

1、中國科學技術大學博士學位論文半Markov控制過程的性能靈敏度分析、優(yōu)化及其算法研究姓名：代桂平申請學位級別：博士專業(yè)：模式識別與智能系統(tǒng)指導教師：奚宏生20050401Abstractlnthisthesis，theperf0丌n強cepotentialtheorywasestablishedforsemi—MarkoVprocessesBasedontheperfomancepotentials，mepmblemsofthestea

2、dystateperfonllancesensitivityanalysisandcheoptimizationforaclassofsemiMarkoVcon仃D1processeswithcountablestatespacesandin6nitehorizonaVerage—costperfb珊ancemeasurewerediscussed，如dsomeoDtimizatjonaIgofjthmswereprovidedByan

3、equjvalentMarkovprocess，thePoissonequatioDforsemiMarkovprocesswasestablished，andthesoluti伽stothePoissonequationwasde6nedasmeperformancepotentiaIsofsemi—MarkovpmcessesTheproblemsoft11esteadystateperfo冊ancesensitiVitywasdj

4、scussedtllroughmememodofequivalentMarkovpmcess鋤dembeddedMarkovchain，飆dt圭Iesensitivitvfomu】asofthesteady—s詛teperf咖姐ceexpressedbyt11ep毗蚰tialsoftheequivalentMa訂(ovprocessandmeembeddedMarkovchainafe茹vellCombiningthepotential

5、fheorywi也semiMad，ovcon打olprocesses，weobtainaperfo冊al】cepotentia】s_basedoptima“tytbe甜鯽Theprob】emofmeoptimalstationarypoljcyforsemi—MarkoVprocesseswi也countablcstatespace柚dcompactac60nsetwas小scussedbytllemetllodofequivaentM

6、arkovprocessandembeddedMarkoVchain鋤d盯￡hein蠡niteho—zonavefagccostperfb冊ancemeasureThmu曲tllebala王lceequationaIldPoissonequation，weobtainaperf0兀nancepotentjalsbasedoptimalitytlIeorem，柚daperformancepotentialsbasedaVerage—cos

7、toptimalityequationforsemi—MarkovcontrolprocessesUndersomeweakassump60ns，anexistencetheo『emoftIesolutions￡otlleoptimaljtyequationforsemiMarkoVcontrdpmcesseswitllcompactactionsetisdriVenInordertocalculateoptimalaverage—co

8、stpolicies，weproposesomealgorithmsinc】udinga伊adient—basedalg嘶thm，apolicyitemtionalgoritlmaIldaVaueiterationalgorithmFur出e訂nore，tlleconVe唱enceofthelasttwoalgo—thmsisestablished，whichshowsthattllealgoritllmswillStopinafini

9、tenumberofstepswithepsilon—policiesTheaboVecomputatjonbased叩tjmizationalgoritllmsassumemeaVailabiljtyofa11exactmodel，andrequirem鋤ycalculationsonma砸x訪VersionHowever’manyinterestjngpmcticaIsystemsinVolVeIa培es詛tespaces，ie，t