ThoughtWorks企业私有云首席咨询师金明《从虚拟化到私有云的几大实践方法》

FromVirtualizationtoPrivateCloudinPracticalWaysByMingJinThoughtWorksWhoAmIMingJin•HeadofCloudSolutionsinThoughtWorksChina•Architecture,AgileConsulting•SolutionsandConsultingonDevOps&Cloud•Sina:@金明i•Email:[e-mail]•Background•WhatVirtualizationMisses?•HowOurPrivateCloudDone?•WhatWeAchieved?•WhatWeLearned?ThoughtWorks•Virtualization/CloudAdaptionSince2010•VMwarevCenter,XenServer,OpenVZ,CloudStack,OpenStack•CloudStackfrom2.0to4.0•OpenStackfromCactustoGrizzley•NowOpenStackandvSphereWhyVirtualizationHelps•SoftwareTeamNeedalotofBoxes.CodeDebugCompilePackageAutomaticTestQATestUATLocalEnvTeamEnvCIBuildEnvAutoTestEnvQAEnvUATEnvContinuousIntegrationDevelopTestSampleWebApplication•1WebServer•1ApplicationServer•1DBServer6*3=18TheMoreComponents,TheMoreServersRequired.TypicalR&D•1ProductLine•200+Developers&Testers•~5Systems•~25ComponentTeams•15+ProductBranchesWhatVirtualizationHelps•VirtualizeLimitedHardware•Hypervisors,e.g.Xen,KVM,ESXi•Containers,e.g.LXC•QuickVMProvisioningBut…VirtualizationDoesn’tSolveProblems100%.TypicalOrganizationDevelopArch.TestProjectMgmt.ITSupportITInfrastructure。。。Project1ProjectnProject2ITGoveranceTypicalProcess项目•提交机器、环境配置申请•编写配置步骤IT支撑•审核机器配置步骤•审批团队资源使用量•记录团队资源配额余量基础设施•折算申请资源费用•记录项目使用资源量•确认项目申请请求IT管理•通过项目资源申请基础设施•配置模板•创建机器•安装中间件、数据库•配置网络等项目•配置项目环境•配置中间件环境变量•初始化数据库WhatVirtualizationMissesWhatVirtualizationMisses•WhatPeopleNeedis•EnvironmentinsteadofVM•VM+Configurations(Software,EnvVariables…)•“ConfigurationStorm”WhatVirtualizationMisses•VMOperations•Install/UninstallSoftware•Patch/Upgrade•EditConfigurationsWhatVirtualizationMisses•VMLifecycleWorkflow•InvolveMultipleParties•FitIntotheOrganizationProcess•NecessaryAudit/LogConsequence•VMCycleTime:Almost2Weeks•ITBusyWithCumbersomeConfigurations•VMDiffersinConfigurations•NoOneKnowsWhatATemplateContains•NoOneKnowsIfResourceUtilizedEfficientlySo…AsPublicCloudbecamepopular,weinitiateda“PrivateCloud”.WhatWeAchieved•ECT(EventCreationTime)from2weeksto20min.0500010000150002000025000BeforeNowECTECTWhatWeAchieved•MU(MachineUtility)from3%to30%010203040BeforeNowMUMUWhatWeAchieved•MPP(MachineperPerson)from10to150050100150200BeforeNowMPPMPPHowOurPrivateCloudDone•FocusOnVM’sLifecycleManagement•ProvideaSelf-ServiceConsole•‘AutomationWorkflow’Built-in•EverythingisAuditableandTraceable!VMLifecycleOrchestrationProvisionConfig.MonitorDestroyArchitectureBuildInfrastructureManagementConsoleConfigurationManagementMonitoringVirtualizationTemplatesLeftKitTFSBuildAgentAgentControllerJenkinsBuildSlaveSlaveMasterVirtualMachineOrchestration“1-Click”ProvisioningCheckVM’sResourceUsageCheckProjectQuotaResourcePoolAllocationProvisionnewVMNetworkConfigurationMiddleConfigurationDBConfigurationAddMonitorServiceLogVMCreationEventCommitProjectUsageChangeCheckEverythingReadyVMImageVMFlavorStartVMCreationWorkflowNewVMAdditionalConfigurations“1-Place”ConfigurationVMImageConfigurationManagementNewVMStandardConf.OS,LibrariesMiddleware,DBCustomConf.EnvVariablesAppVariablesAppSettingsExtraSoftwareAssociatedConf.CommonServices“1-fill-all”VirtualizationVMwarevCenterOpenStackCloudStackAWSScaleWorksArchitectureSelf-ServicePortalHardwareServerStorageNetworkOtherDevicesVirtualizationPlatformVMNetworkStorageMonitorImageTemplateMgmt.UserMgmt.NetworkMgmt.SystemMgmt.ProjectMgmt.VMMgmt.Perf.MonitorReportHostMgmt.StorageMgmt.Conf.Mgmt.LogMgmt.OverviewWhatWeLearned•Automation•Automateasmuchaspossible•VM’sLifecycle•InfrastructureasCode•PythonScript,Shell,PowerShell…WhatWeLearned•IT-BusinessAlignment•BusinessOrientedSystemDesign•DevOpsDeveloper+OperationWhatWeLearned•Standardization•Template•VMSpec•ConfigurationWhatWeLearned•ContinuousImprovementfromFeedback•‘LeanStartup’Approach•‘FeedbacksandReaction’Over‘Big-BangDesign’WhatWeLearned•It’sNotasMuchasItSeems•MostareDevelopedAfterWork•About3monthstoBuildEverything•‘GoodEnough’istheBest!LastButnotLeast•ToBuildorBuyPrivateCloud?Suggestions•LeverageYourITInvestment•TrustYourDevelopersandOperations•BuildYourOrganization’sDevOps•StartfromFreeCommunitySoftwares•GetHelpfromOutsideProfessionals