稳定、高效、低碳──淘宝软件基础设施构建实践

--!2010.12.7VelocityChina2010!CDN!•  •  •      •      •  !99.999%!CDNCDN!GlobalLoadBalancingL1-CacheL2-CacheApplicationStorageCacheClusterCacheClusterCacheClusterCacheClusterCacheClusterImageServerClusterImageServerClusterTFSClusterCacheClusterCacheClusterTFSCluster~40T~80T~200Servers995TUsed/1800TDeployed2007!FAS980CSnapShotSnapShotUploadServerNearStoreR200DR:A+B+C+DSnapVaultImageServerC:OnlineImageD:OnlineImageSnapMirrorFAS980CSnapShotSnapShotA:OnlineImageB:OnlineImageSnapMirrorAdminServer!•  Ø  Ø  •  Ø  Ø  Ø  Ø  Ø  TFS1.0!•           TFS1.0•  •  •  •  •  •  •  TFS1.3!•   •  Ø  Ø  Ø  Ø  Ø  Ø  TFS1.3!•  Ø  Ø  Ø  Ø  Ø  Ø  Ø  Ø  CDN!•        •          CDN-!NetScaler(7LB)squidsquidsquid…squidNetScaler(7LB)client12…nVIP1VIP2CDN-!LVS(L4)Haproxy(L7)squidsquidsquid…squidhaproxy(L7)Haproxy(L7)LVS  (L4)clientVIP1VIP2CDN!\• 128squidsquid2%• VIP100G• Hash1/(n+1)Squid!• • • • • 1!• • [root@cache161~]#iostat-x-k60|egrep-v-e“sd.[1-9]”…avg-cpu:%user%nice%system%iowait%steal%idle3.150.005.6311.350.0079.87Device:rrqm/swrqm/sr/sw/srkB/swkB/savgrq-szavgqu-szawaitsvctm%utilsda15.401.1750.662.632673.22124.85105.010.5510.396.2733.41sdb0.070.03447.291.024359.01191.9020.300.320.710.2712.13sdc5.731.53114.938.421264.86100.5822.141.058.483.5643.94sdd5.572.07121.839.571319.45104.1221.671.199.023.6347.72sde5.531.45111.458.521246.53101.9222.480.957.883.4241.06sdf5.452.02118.938.001281.92106.2521.871.199.373.7447.44SATASSDSAS4SASSSD2!• • [root@cache161~]#iostat-x-k60|egrep-v-e“sd.[1-9]”…avg-cpu:%user%nice%system%iowait%steal%idle3.150.005.6311.350.0079.87Device:rrqm/swrqm/sr/sw/srkB/swkB/savgrq-szavgqu-szawaitsvctm%utilsda5.081.6518.552.521210.07119.00126.180.146.505.4611.51sdb1.680.05610.531.756962.29413.4724.090.280.460.2314.25sdc0.220.0328.870.971172.93189.1391.310.165.284.4013.13sdd0.230.0229.700.771133.47122.5382.450.154.994.3913.37sde0.180.0328.231.031078.73206.2787.810.155.004.2412.40sdf0.100.0228.420.551090.27115.0083.220.155.044.4412.86SATASSDSASSSD4SAS5SASSATA1!• • • • • • • • • •  2!• • • • • • • • • •  !•  •  •  !CDN!TFS!TFS!•           •     •          TAIR!TAIR!•             •     •        OceanBase!•        •            MySQL!•        •      •      !•          •      •    Java!•            •  •        Linux!•        •      -!•  •      •      !•        •    •        :!LVSInternetRack6GbpsLVSCDN!•      •             CDN!•           •       !CDN!!•  •  •        •  •  !CDN!•  •  •  •  •  !Q&A!