虚拟服务器整合关键技术研究

国防科学技术大学硕士学位论文虚拟服务器整合关键技术研究姓名：刘杨申请学位级别：硕士专业：计算机科学与技术指导教师：肖侬研2010-11国防科学技术大学研究生院硕士学位论文第i页摘要虚拟服务器整合技术是将集群中多个物理服务器上运行的应用程序通过虚拟机封装后再整合到少数物理服务器上运行的技术。在企业级数据中心规模不断扩大的今天，虚拟服务器整合技术能够大大减少集群中使用的服务器的数量，从而帮助企业大幅降低硬件和运营成本，极大提高服务器的利用率。而如何解决虚拟集群监控、虚拟机装箱和虚拟机迁移这三大问题则是提升虚拟服务器整合效果的关键所在。本文针对Xen虚拟服务器集群设计并实现了虚拟服务器整合管理器VSCM。整个工作分为四个部分。1）对VSCM的总体框架进行了设计，将其划分为三个功能模块。2）对虚拟集群监控技术进行了研究，提出了监控信息模型，并设计实现了一个跨物理服务器的虚拟集群监控器Prospector。该监控器能够对集群中多个物理服务器及其上部署的虚拟机的多种实时状态进行动态收集和整合，解决虚拟集群监控问题。3）对虚拟机装箱技术进行了研究，提出了一种全局最优的虚拟机装箱策略GOVMP。该策略能够从全局最优的角度大幅减少集群中使用的服务器的数量，解决虚拟机装箱问题。4）对虚拟机迁移技术进行了研究，提出了一种基于反馈的虚拟机迁移策略FVMM。该策略利用反馈机制大大减少了迁移开销，并通过解除迁移限制来保证所生成的迁移命令的可行性，解决虚拟机迁移问题。在Xen虚拟集群环境下的测试结果表明，采用本文设计并实现的虚拟服务器整合管理器能够解决虚拟服务器整合的三大问题，在大幅减少服务器数量的同时，大大降低了迁移开销。主题词：虚拟服务器整合；Xen虚拟服务器集群；虚拟集群监控；虚拟机装箱；虚拟机迁移国防科学技术大学研究生院硕士学位论文第ii页ABSTRACTVirtualserverconsolidationistousevirtualmachinestoencapsulateapplcationsrunningonmultiplephysicalserversintheclusterandthenintegratethemintoasmallnumberofservers.Nowadays,withtheexpandingofenterprise-classdatacenters,virtualserverconsolidationcanreducelargenumberofserversinordertohelptheenterprisesreducehardwareandoperationalcostssignificantlyandimproveserverutilizationgreatly.Howtosolvethethreeproblems:virtualclustermonitor,virtualmachinepackingandvirtualmachinemigration,isthekeytoenhancetheperformanceofvirtualserverconsolidation.ForXenvirtualcluster,thispaperdesignsandimplementsVSCM,avirtualserverconsolidationmanager.Thewholeworkcanbedevidedintofourparts.1)WedesignthegeneralframeworkofVSCManddivideitintothreefunctionalmodules.2)Westudythetechniqueofvirtualclustermonitor,proposetheinformationmodelofmonitor,designandimplementavirtualclustermonitorsystemProspector,whichcandynamicallycollectallreal-timeinformationonphysicalserversandtheirvirtualmachinesplacedon.3)Westudythetechniqueofvirtualmachinepacking,andproposeastrategyofglobaloptimalvirtualmachinepacking,GOVMP,whichcansignificantlyreducethenumberofserversfromtheperspectiveofglobaloptimization,solvingtheproblemofvirtualmachinepacking.4)Westudythetechniqueofvirtualmachinemigration,andproposeastrategyoffeedbackbasedvirtualmachinemigration,FVMM,whichusesfeedbackmechanismtogreatlyreducethemigrationoverheadandguaranteethefeasibilityofmigrationcommandsgeneratedthroughremovingmigrationconstraints,solvingtheproblemofvirtualmachinemigration.ExperimentresultsinXenvirtualclustershowthat,thevirtualserverconsolidationmanagerwhichisdesignedandimplementedcansolvethethreeproblemofvirtualserverconsolidation,andgreatlyreducethemigrationoverheadwhilesignificantlyreducingthenumberofservers.KeyWords：virtualserverconsolidation,Xenvirtualservercluster,virtualclustermonitor,virtualmachinepacking,virtualmachinemigration国防科学技术大学研究生院硕士学位论文第III页表目录表3.1各种虚拟服务器整合技术需要的信息..........................................................22表3.2物理服务器的信息模型..................................................................................23表3.3虚拟机的信息模型..........................................................................................24表3.4虚拟集群的信息模型......................................................................................24表3.5基准程序运行时间对比..................................................................................29表3.6基准程序Mop/s对比........................................................................................30表4.1GOVMP和FFD使用的服务器数量对比........................................................36表5.1FVMM和VMM的迁移步数对比....................................................................49表5.2FVMM和VMM的迁移开销对比....................................................................49表5.3受迁移限制影响的迁移命令的个数..............................................................50国防科学技术大学研究生院硕士学位论文第IV页图目录图1.1虚拟服务器整合基本流程................................................................................7图2.1VSCM总体结构...............................................................................................12图2.2VSCM运行流程...............................................................................................13图2.3FFD算法伪代码...............................................................................................16图2.4VMPP的局部最优解决方案...........................................................................16图2.5VMPP的全局最优解决方案...........................................................................17图2.6顺序迁移限制..................................................................................................18图2.7循环迁移限制..................................................................................................18图3.1监控信息模型..................................................................................................23图3.2Prospector总体结构.........................................................................................25图3.3监控信息的终端显示......................................................................................27图3.4Prospector实验环境.........................................................................................28图4.1全局最优的虚拟机装箱策略的伪代码..........................................................34图4.2GOVMP和FFD的结果统计对比.