EXADATA技术培训

娄恒[e-mail]高级电信行业架构师ORACLE数据库云服务器技术揭密提纲•Exadata架构设计原理•Exadata硬件体系架构•Exadata软件体系技术•Exadata数据库整合与资源管理•Exadata系统指标和配置问题1：随着系统规模增加，传统数据库架构瓶颈凸显•存储层：1）数据量不断增加，带来的IO瓶颈；2）随着数据长时间运行带来的数据分布不均匀，存在IO热点•网络层：传输带宽不足，无法快速传输大量数据到服务器•服务器层：接收过多数据进行处理，内存优势无法发挥解决思路：减轻负载、加宽通道、提高并行传统数据库架构解决思路：1.加宽通道、增加通道数量2.减少需要传送到服务器处理的数据量提高系统扩展能力3.增加系统并行处理Exadata设计原则：存储层智能化、数据预处理能力…ExadataCellDisk…DiskExadataCellExadatasoftwareExadatasoftwareOracleDatabaseServers问题2：多系统资源互相独立，无法共享有些资源过度，有些资源不足，由于生产环境动态变化，无法动态满足DatabaseServersStorageArraysExadata设计原则：资源共享和资源控制I/OResourceManagementOracleDatabaseServersSmartstorageoperationsStorageconsolidation(Transparenttodatabases)HighperformancestoragenetworkDatacompression问题3：复杂的数据库系统均衡化配置•“Theweakestlink”definesthethroughput•Eachbuildingblockisabalancedunit•Componentstoconsider:•CPU:Quantityandspeed•HBA(HostBusAdapter):Quantityandspeed•Switchspeed•Controller:Quantityandspeed•Disk:QuantityandspeedFC-Switch1FC-Switch2DiskArray1DiskArray2DiskArray3DiskArray4DiskArray5DiskArray6DiskArray7DiskArray8HBA1HBA2HBA1HBA2HBA1HBA2HBA1HBA2Eachmachinehas2GbHBAsAll8HBAscansustain8*200MB/s=1600MB/sEachswitchneedstosupport800MB/stoguaranteeatotalsystemthroughputof1600MB/sEachdiskarrayhasone2GbitcontrollerAll8diskarrayscansustain8*200MB/s=1600MB/sEachmachinehas2CPUsAllfourserversdriveabout2*200MB/s*4=1600MB/sExadata设计原则：平衡且优化配置•客户化系统无法达到最佳性能-组件不平衡,错误配置，瓶颈•Exadata端到端优化-从磁盘到数据库传输是两倍的GB/sec-磁盘，闪存，控制器，总线，HBA,网络，CPU等-数据库从固件，驱动，操作系统，网络的优化-多年的调优经验-没有瓶颈•将IT智慧转化成业务需求-而不要设计，调优，维护，硬件配置端到端优化问题4：系统的维护和扩容过程复杂均衡化配置方法论分区和HA规划网络互联配置规划数据库存储规划Exadata设计原则：简化部署•消除了数据库系统部署的复杂性-数月的配置、排错、调优•当天即可完成部署-预置的、经过测试的、可稳定运行的标准配置-连接网线、电源线、加电即可用-无需更改现有应用程序，youareExadatacertified•即可获得极限性能数月到数天提纲•Exadata架构设计原理•Exadata硬件体系架构•Exadata软件体系技术•Exadata数据库整合与资源管理•Exadata系统指标和配置Exadata硬件架构Exadata智能存储网格•14x高性能低成本存储服务器(2U)•高性能,低成本,冗余,线性扩展•100TBHighSpeeddisk,或336TBHighCapacitydisk•112Intelcoresinstorage•5.3TBPCI闪存•跨存储服务器的数据镜像保护Datamirroredacrossstorageservers•超级性能&开箱即用MaximumPowerusageofaFullRackDatabaseMachineis14KW,typicalis9.8KW.AsinglehighendSMPplatformwithoutstorageorswitchescanconsumewellover20KW.数据库网格InfiniBandNetwork•Redundant40Gb/sswitches•Unifiedserver&storagenetwork•8台数据库服务器(X2-2)96CPUcores(12Coreperserver,2xSix-CoreIntelX5670Processors(2.93GHz)768GBmemory•或2台数据库服务器(X2-8)128CPUcores(64Coreperserver)2TB(1TBperserver)Exadata低功耗2PowerDistributionUnits(PDUs)atrearDatabaseMachineX2-2FullRack8Intel-based2CPUSunFiredatabaseservers14ExadataStorageServers(allhighperformanceorallhighcapacity)3SunDatacenterInfiniBandSwitch36(36-portmanagedQDRswitch-40Gb/s)Keyboard,Video,Mouse(KVM)hardware1CiscoEthernetswitch(48-port)StartSmallandGrowX2-2FullRackX2-2QuarterRackX2-2HalfRackExadataX2-2FullRack•8Dual-procesorDatabaseServers(SunFireX4170M2)-96cores(12perserver)-768GBmemory(96GBperserver)-10GigEconnectivitytoDataCenter-16x10GbEports(2perserver)•14ExadataStorageServersX2-2-AllwithHighPerformance600GBSASdisksOR-AllwithHighCapacity2TBSASdisks•3SunDatacenterInfiniBandSwitch36-36-portManagedQDR(40Gb/s)switch•1“Admin”CiscoEthernetswitch•Keyboard,Video,Mouse(KVM)hardware•2RedundantPowerDistributionsUnits(PDUs)Addmoreracksforadditionalscalability•4Dual-procesorDatabaseServers(SunFireX4170M2)-48cores(12perserver)-384GBmemory(96GBperserver)-10GigEconnectivitytoDataCenter-8x10GbEports(2perserver)•7ExadataStorageServersX2-2-AllwithHighPerformance600GBSASdisksOR-AllwithHighCapacity2TBSASdisks•3SunDatacenterInfiniBandSwitch36-36-portManagedQDR(40Gb/s)switch•1“Admin”CiscoEthernetswitch•Keyboard,Video,Mouse(KVM)hardware•2RedundantPowerDistributionsUnits(PDUs)CanUpgradetoaFullRackExadataX2-2HalfRackCanUpgradetoanHalfRackExadataX2-2QuarterRack•2Dual-procesorDatabaseServers(SunFireX4170M2)-24cores(12perserver)-192GBmemory(96GBperserver)-10GigEconnectivitytoDataCenter-4x10GbEports(2perserver)•3ExadataStorageServersX2-2-AllwithHighPerformance600GBSASdisksOR-AllwithHighCapacity2TBSASdisks•2SunDatacenterInfiniBandSwitch36-36-portManagedQDR(40Gb/s)switch•1“Admin”CiscoEthernetswitch•Keyboard,Video,Mouse(KVM)hardware•2RedundantPowerDistributionsUnits(PDUs)DatabaseMachineX2-2ArchitectureX2-2DatabaseServer(SunFireX4170M2)Processors2Six-CoreIntel®Xeon®X5670processors(2.93GHz)Memory96GB(12x8GB)LocalDisksFour300GB10KRPMSASdisksDiskControllerDiskcontrollerHBAwith512MBbatterybackedcacheNetworkTwoInfiniBand4XQDR(40Gb/s)ports(1dual-portPCIe2.0HCA)Four1GbEEthernetportsTwo10GbEEthernetSFP+ports(1dual-port10GbEPCIe2.0networkcardbasedontheIntel8259910GbEControllertechnology)RemoteManagement1Ethernetport(ILOM)PowerSupplies2redundanthot-swappablepowersuppliesExadataStorageServer(SunFireX4270M2)Processors2Six-CoreIntel®Xeon®L5640Processors(2.26GHz)Memory24GB(6x4GB)LocalDisks12x600GB15KRPMHighPerformanceSASor12x2TB7.2KRPMHighCapacitySASFlash4x96GBSunFlashAcceleratorF20PCIeCardsDiskControllerDiskcontrollerHBAwith512MBbatterybackedcacheNetwork2InfiniBand4XQDR(40Gb/s)ports(1dual-portPCIe2.0HCA)4embeddedGigabitEthernetportsRemoteManagement1Ethernetport(ILOM)PowerSupplies2redundanthot-swappablepowersuppliesExad