资源描述:
《China Sys Arch Keynote Rev11》由会员上传分享,免费在线阅读,更多相关内容在学术论文-天天文库。
1、TheBIGDATA-centerEvolutionRobertOberLSIFellowandVP,LSICorporationSystemArchitectConferenceChina,September4th2013BigData:BigDataischangingourworldBigDataischangingourDataCenterArchitecturesToday,goodsolutionsexistforCapture,HoldandAnalyzeGreatModular,Rack
2、ScaleSolutionsarejustaroundthecorner2BIGDATADrivesChange3TheDataDelugeofBigData:ANewCycle300,000BigDataNewTweetsDeluge141,00060MAppsDownloadedPhotosChangeinTechnologyViewedOEMs/InflectionsODMs3.9MillionVideoViewsonRapidYouTubeCustomerInnovation&RevoltOpenSou
3、rce18183,423MillionWeb2.0/HoursofFacebookHyperscaleMusicViewsDataCentersDownloadedInthepast3minutesDataTransferredGB1,919,400DataStoredGB395,151,8214ToExtractValue:CaptureHoldAnalyze5BIGDATADrivesaDataflowArchitectureconfidential6BigDataThroughTheCloudMoving
4、froma“Compute”to“Dataflow”architecturesVolumeResilienceBandwidthorLatencyBandwidthCapacity/DensityCapacityEfficiency/PowerEfficiency/PowerEfficiencyCaptureHoldAnalyze7BIGDATANeedsSolutionsTodayconfidential8Capture:IngestofDatadeterminesSpindleandNodeCount30
5、%-60%improvementofSATAspindlebandwidthHigherIngestrateSATA/STPPerformanceComparisonofDataBolt(TM)ONandOFFCobraB.0(FW:0.93.100)/FuryC.0(FW:0.250.115-IT)x8SASLink,DBON,PCIe-3,Q=32FewerSpindles70006000500030%-60%4000HigherBandwidth3000FewerDrives20001000DataB
6、olt®0Throughput(MB/s)SequentialReadSequentialWrite24SATASSD'sDBON24SATASSDDBOFFCaptureHoldAnalyze9Hold:HighDensity,Resilience,OperationalSimplicityCapacity,Resilience,Power,ObjectStoreErasure/ReplicationonJBODsHADualnodeSyncro™MicroServerEfficient,Resili
7、entStorageInfrastructureManagedDenser,moreefficientdatacenterLSI’sCoreBusiness,Syncro™CaptureHoldAnalyze10Analyze:Efficiency&Work/YuanBandwidthBasedAnalysis(Hadoop,Hbase,etc)HadoopreliesonDiskBandwidthforperformanceLinearHDDbandwidth–ExecutionTimeRelations
8、hipUsuallynotgoodPrice/Performance20x6GSASHDDbandwidth/IOPsFury/Cobra,DataBoltOff/On,20x6GSASHDD,8Q'd1,000,0005,000DataBolt=100%higherBandwidth800,0004,000DataBoltDataBolt600,000Speedup3,000Sp