主題網(wǎng)絡(luò)蜘蛛的研究與實現(xiàn)

1、北京工業(yè)大學(xué)碩士學(xué)位論文主題網(wǎng)絡(luò)蜘蛛的研究與實現(xiàn)姓名：孫旭申請學(xué)位級別：碩士專業(yè)：計算機應(yīng)用技術(shù)指導(dǎo)教師：蔡永泉20090401AbstractAbstractWiththerapiddevelopmentoftheintemet，quantityoftheinformationisincreasinginallincredibleway111etraditionalWebsearchenginesarebecomingmoreandm

2、oreincapabletohandlethevariableneedsofpeopletoindextheinformationUnderthissituationtheTopic—SpecificSearchEnginescallleupResearchonfindingefficientsearchingstrategiesplaysanessentialroleintheapplicationandtheprogressofth

3、eTopic—SpecificSearchEnginesIntheperspectiveoftheapplicationofthereinforcementlearningonwebspiders，thispapermainlyfocusesontheworkoffindingefficientsearchingstrategies111econceptofreinforcementlearningandtherecentresearc

4、hesonsearchingstrategiesofW曲spidersarefirstintroducedBasedontheanalysesofthecharacteristicofeachspideranditsadvantageanddisadvantage，thePapersunlsupthekeystoimprovingtheefficiencyofW曲spidersWimtheviewofreducingthetimecon

5、sumptionandcomplexityofstatespace，thepaperaimsatimprovingthestudyingefficiencyoftheWebspiderbasedonreinforcementlearningAnewreinforcementlearningalgorithmbasedonexperiencesbiasinginformationlearningisproposedThemainideao

6、fthisalgorithmistotakeadvantageofsomeusefulstatefeaturestoexploremoreeffectivelyAsaresult，theefficiencyofstudyisimprovedTheresultsshowthatthenewalgorithmhasbetterPerformance碭eapplicationofthenewalgorithmon黜spiderisdiscus

7、sedandanewspiderlearningalgorithmbasedonexperiencesbiasinginformationlearningisproposedWevalidateournewalgorithmbyexperimentonWebsitelearning111eresultsshowthatthenewalgorithmhasbetterperformanceToimprovetheaccuracyofeva

8、luationofthevalueofhyperlinks，thepapercombinestwoevaluationmethodsofthevalueofthehyperlinks，namelythemethodbasedontheevaluationofimmediaterewardvalueandthemethodbasedontheevaluationoffuturerewardvalueBasedonthis，anovelwe

9、bspidermodelisproposedAnewfunctionnamedvaluebelieffunctioniscontributedtosolvetheproblemofbeliefassignmentoftheimmediaterewardvalueandthefuturerewardvalueThenaheuristicsearchingalgorithmbasedondegradingthebeliefoffuturer

10、ewardvalueisproposed，111emainideaofthealgorithmistoenhanceexplorationbyassigninglargerbeliefvalueoffuturerewardattheearlierstageofsearchingprocessandgraduallytoattachmoreimportanceonexploitationbydegradingthebeliefvalueo