基于hadoop和mysql的天气分析系统

班级031201学号03120111本科毕业设计论文题目基于Hadoop的MapReduce应用软件设计与实现学院计算机学院专业计算机科学与技术学生姓名尤鹤毕业设计（论文）诚信声明书本人声明：本人所提交的毕业论文《基于Hadoop的MapReduc应用软件设计与实现》是本人在指导教师指导下独立研究、写作的成果，论文中所引用他人的无论以何种方式发布的文字、研究成果，均在论文中加以说明；有关教师、同学和其他人员对本文的写作、修订提出过并为我在论文中加以采纳的意见、建议，均已在我的致谢辞中加以说明并深致谢意。本论文和资料若有不实之处，本人承担一切相关责任。论文作者：尤鹤（签字）时间：2016年6月1日指导教师已阅：赵老师（签字）时间：2016年6月13日摘要摘要随着21世纪信息化时代的到来，随着科技的迅速发展，我们每时每刻都在这个世界中留下我们的足迹，这些足迹构成了日益增长的信息量。因此对这些大数据的存储和处理显得至关重要，天气信息的分析与查询就是一个很好的例子。本文针对这一问题，将阐述如何开发一款基于hadoop的MapReduce的天气分析系统。首先介绍了大数据时代的相关背景和为处理大数据而产生的相关工具，如Hbase。其次分析了打造一款基于hadoop天气分析系统的重要性和可行性。最后经过系统设计，开发环境搭建，系统实现和系统结果展现等部分完成了本系统的开发工作。整个系统界面简洁直观，使用方便，运行可靠，查询结果因图形展现的方式使数据之间对比明显，易于接受。关键字：大数据HadoopHbase天气分析AbstractAbstractWiththeadventoftheinformationagein21stcentury,withtherapiddevelopmentofscienceandtechnology,weallthetimeintheworldtoleaveourfootprints,thesefootprintsconstitutethegrowingamountofinformation.Therefore,thestorageandprocessingofthesebigdataisveryimportant,theanalysisoftheweatherinformationandqueryisagoodexample.Aimingatthisproblem,thispaperwillexplainhowtodevelopaweatheranalysissystembasedonMapReducehadoop.First,itintroducedthebackgroundoftheeraofbigdataandrelatedtoolsfortheprocessingoflargedata,suchasHbase.Secondly,itanalyzestheimportanceandfeasibilityofbuildingaweatheranalysissystembasedonHadoop.Finally,afterthesystemdesign,developmentenvironment,systemimplementationandsystemresultsitshowsthatthesystemhascompletedthedevelopmentofthework.Thewholesysteminterfaceissimpleandintuitive,easytouse,reliableoperation,andtheresultsofthequeryresultsshowthewaytomakethedatabetweentheobvious,easytoaccept.Keywords:bigdataHbaseHadoopweatheranalysis目录i目录第一章绪论.................................................................................................................11.1开发背景..............................................................................................................11.1.1大数据时代介绍............................................................................................11.1.2Hadoop的介绍..............................................................................................11.1.3天气信息查询与分析的前景........................................................................21.2设计目的..............................................................................................................21.3技术目标..............................................................................................................2第二章天气分析系统分析.........................................................................................32.1可行性分析..........................................................................................................32.1.1可行性研究介绍............................................................................................32.1.2可行性分析....................................................................................................32.2需求分析..............................................................................................................32.2.1需求分析作用................................................................................................42.2.2功能需求........................................................................................................4第三章天气分析系统设计.........................................................................................73.1界面设计..............................................................................................................73.1.1前台界面设计................................................................................................73.2模块划分..............................................................................................................83.2.1用户注册与登录模块....................................................................................83.2.2上传天气数据模块........................................................................................93.2.3数据分析模块................................................................................................93.2.4定时更新天气数据模块................................................................................93.2.5历史天气信息查询模块..............................................................................103.2.6今日天气信息动态显示模块......................................................................113.2.7历史天气走势与极端天气查询模块..........................................................113.2.8数据库设计模块..........................................................................................11ii目录3.3数据库设计E-R图............................................................................................12第四章天气分析系统相关技术简介.......................................................................154.1开发工具............................................................................................................154.1.1JDK1.7.........................................................................................................154.1.2eclipseluna...................................................................................................154.1.3hadoop2.7.2.........................................