基于语义web的涉鄂网络舆情分析系统

本科毕业论文题目：基于语义web的涉鄂网络舆情分析系统学院:计算机科学与技术专业:日期:二〇一一年六月武汉科技大学本科毕业论文I摘要随着网络的普及和网民数量的快速增长，网络舆情已经成为映射社会舆情的实时晴雨表，最直接、最快速地反映了经济、政治、文化的状况和发展态势。网络舆情分析平台成为了解社情民意的有力工具之一。然而，监管机构往往更关注某个领域、层次的舆情情况，从基于关键词的搜索结果中的海量信息中找到与特定领域的相关的局部信息是非常困难的，另一方面，由于互联网的开放性、共享性、扁平性使得网络舆情的出现和监管不再具有地域性，不再具有边界，使关键词在正确表达搜索期望时总显得力不从心，容易产生语义漂移现象。本文提出了一个基于语义web的网络舆情分析系统，系统主要包括网络舆情信息采集，舆情智能分析和处理，信息的分词索引，舆情简报和舆情检索，以及本体知识构建等功能，通过建立领域本体，采集网络舆情信息，并利用本体对舆情信息进行分析和聚类，实现舆情的垂直化、专业化分析，解决了舆情分析中的语义漂移问题。该系统以湖北省相关领域为样本，重点采集了湖北省地域比较活跃的论坛上舆情信息，对湖北省舆情信息进行监测分析，发现湖北地域比较热门的事件，并将基于关键词的搜索结果与基于语义的搜索结果进行对比，发现基于语义的搜索结果更加准确可靠，验证了系统模型的有效性。关键词:语义Web；本体；网络舆情；Web信息挖掘武汉科技大学本科毕业论文IIAbstractWiththepervasionofInternetandthesharpincreaseofthenumberofnetizens,Networkpublicopinionhasbeenservingasaneffectivemethodinthemonitoringandreflectionofsocialpublicopinion.However,RegulatoryAuthoritiesareinclinedtoconcernmoreaboutpublicopinioninaspecialfieldwhileitistoodifficulttoacquisitetheexpectedinformationthatrelatestoaspecialareafromthemassivesearchingresultsbasedonkeywords,ontheotherhand,thecharacteristicsofopenness,sharabilityandflatnessofInternetdeprivethenetworkpublicopinionofitslocalizationandboundariestoagreatextentandleadtothefactthatitispowerlessforthekeywordstoexpressthesearchingdesiresinceitseasinessofgeneratingsemanticdriftphenomenon.ThisarticleintroducedasemanticWeb-basedNetworkpublicopinionanalysissystemwhichincludesmanyfunctions,suchasNetworkpublicopiniongathering,Informationintelligenceanalysisandprocessing,Informationparticipleandindex,Publicopinionbriefing,PublicopinionretrievalandOntologyknowledgeconstructionetc.Alsothissystemrealizestheverticalsearchofpublicopinion,andtheanalysisofspecialization,besides,itcompletelysolvethesemanticdriftphenomenonprobleminpublicopinionanalysisbyestablishingdomainontology.TakingpublicopinionincollegesanduniversitiesofHubeiProvinceforsample,wesucceedinextractingtheinformationintheactiveBBSofhubeiprovince,analyzingtheinformation,findinghubeiregionalhotevents.AlsowecomparedtheresultofsemanticsearchwiththeresultofkeywordssearchandfoundthattheSemanticsearchwasmoreaccurateaswellasdemonstratedtheeffectivenessofthemodel.Keywords:semanticweb;ontology;networkpublicopinion;webinformationmining.武汉科技大学本科毕业论文III目录1绪论....................................................................................................................................11.1选题背景.............................................................................................................11.2研究现状.............................................................................................................11.3开发平台.............................................................................................................21.4论文组织结构.....................................................................................................22研究现状............................................................................................................................32.1技术介绍.............................................................................................................32.2产品现状.............................................................................................................42.3本章小结.............................................................................................................53系统结构与功能设计........................................................................................................63.1系统结构设计.....................................................................................................63.2系统功能设计.....................................................................................................73.2.1信息采集..............................................................................................73.2.2信息索引..............................................................................................73.2.3本体信息组织......................................................................................83.2.4舆情分析..............................................................................................83.2.5舆情统计..............................................................................................93.2.6舆情追踪..............................................................................................93.2.7舆情展示..............................................................................................93.2.8舆情预警............................................................................................103.3本章小结...........................................................................................................104采集与调度......................................................................................................................114.1采集范围...........................................................................................................114.2基于模板的信息采集.......................................................................................114.2.1采集异构网页信息的难点................................................................114.2.2基于模板的信息采集方案.