资源描述：
《HBase的二级索引课件.ppt》由会员上传分享，免费在线阅读，更多相关内容在教育资源-天天文库。
1、HUAWEITECHNOLOGIESCO.,LTD.HBase–SecondaryIndexHuaweiHadoopR&D–InaGlanceHadoopDevelopmentSecondaryIndexinHBaseHDFSNNHA(Hadoop-2)BookkeeperassharedstorageforNNHA(Hadoop-2)HDFSNNHA(Hadoop-1)MapReduceResourceManagerHA(Hadoop-2/YARN)MapReduceJobTrackerHA(Hadoop-1)HiveHAStabili
2、zationRaisedover650defectssinceJan‟11Fixedover500defectssinceJan‟11,andcontributedbacktocommunity.Page2HUAWEITECHNOLOGIESCO.,LTD.SeniorTechLeadinHuaweiR&Dcentre@BangaloreActivecontributorinApacheHBasecommunityActivememberinHBasedev/usermailinglistWorkingwithHBaseandHivePa
3、ge3HUAWEITECHNOLOGIESCO.,LTD.WhoamIMaster,RegionserversTablesplitintoregionsColumnarstorage,ColumnfamilyMemstore,HfilesinDFSHfileslogicallysplitintosmallerblocks,datawrite/readasblocksHBaseRecapPage4HUAWEITECHNOLOGIESCO.,LTD.NoindexingavailableinHBaseScanswithconditionson
4、columnvalueonhugesparsedata.FilterusageScanthroughputverylessTimeoutsatclientsideandleaseexpiryMotivationPage5HUAWEITECHNOLOGIESCO.,LTD.IndextablePersistindexdatainseparatetableCo-processorbaseddesign100%serversidesolutionRegionwiseindexingwithcollocation1-1mappingwithact
5、ualtableandindextableregionsRegioncollocationusingcustomLoadbalancerPage6HUAWEITECHNOLOGIESCO.,LTD.OverallSolutionSecondaryIndexArchitectureClientExtallowstospecifyindexdetailswhiletablecreateCustombalancerdocollocationCoprocessorhandlestheindexdataPage7HUAWEITECHNOLOGIES
6、CO.,LTD.TablecreationRegionscollocationMasterBalancerRS1RS2ClientCreatetableWithregionsR1ABR2BCR1ABR2Page8HUAWEITECHNOLOGIESCO.,LTD.BCIndextableActualtablePutoperationTable–>tab1columnfamily–>cf1Index–>idx1,cf1:c1andidx2,cf1:c2Indextable–>tab1_idxRegionServerClientPut„tab
7、1‟,„abd‟,„cf1:c1‟,„5‟„cf1:c2‟,„Z1‟R1UserTableR2IndexTableaaadaaadCoprocessorIndextablerowkey=regionstartkey+indexname+indexedcolumnvalue+usertablerowkeyOneindextableperusertableAllindexdatagoestosameindextablePut„tab1_idx‟,„aaidx15abd‟Put„tab1_idx‟,„aaidx2Z1abd‟Page9HUAWE
8、ITECHNOLOGIESCO.,LTD.ScanoperationRegionServerClientCreatescannerConditionc1=5R1UserTableR2Index
