资源描述：
《Extending DIRAC File Management with Erasure-Coding for efficient用擦除编码扩展狄拉克文件高效管理以实现高效存储.pdf》由会员上传分享，免费在线阅读，更多相关内容在应用文档-天天文库。
1、JournalofPhysics:ConferenceSeriesPAPER•OPENACCESSExtendingDIRACFileManagementwithErasure-Codingforefficientstorage.Tocitethisarticle:SamuelCadellinSkipseyetal2015J.Phys.:Conf.Ser.664042051Viewthearticleonlineforupdatesandenhancements.ThiscontentwasdownloadedfromIPaddr
2、ess117.165.42.60on18/08/2018at11:1321stInternationalConferenceonComputinginHighEnergyandNuclearPhysics(CHEP2015)IOPPublishingJournalofPhysics:ConferenceSeries664(2015)042051doi:10.1088/1742-6596/664/4/042051ExtendingDIRACFileManagementwithErasure-Codingforecientstora
3、ge.SamuelCadellinSkipsey,PaulinTodev,DavidBritton,DavidCrooksandGarethRoySchoolofPhysicsandAstronomy,KelvinBuilding,UniversityofGlasgow,Glasgow,G128QQE-mail:samuel.skipsey@glasgow.ac.ukAbstract.ThestateoftheartinGridstyledatamanagementistoachieveincreasedresilienceofd
4、ataviamultiplecompletereplicasofdata lesacrossmultiplestorageendpoints.Whilethisise ective,itisnotthemostspace-ecientapproachtoresilience,especiallywhenthereliabilityofindividualstorageendpointsissucientlyhighthatonlyafewwillbeinactiveatanypointintime.Wereportonwork
5、performedaspartofGridPP[1],extendingtheDiracFileCatalogueand lemanagementinterfacetoallowtheplacementoferasure-coded les:each ledistributedasNidentically-sizedchunksofdatastripedacrossavectorofstorageendpoints,encodedsuchthatanyMchunkscanbelostandtheoriginal lecanbere
6、constructed.Thetoolsdevelopedaretransparenttotheuser,and,aswellasallowingupanddownloadingofdatatoGridstorage,alsoprovidethepossibilityofparallelisingaccessacrossallofthedistributedchunksatonce,improvingdatatransferandIOperformance.Weexpectthisapproachtobeofmostinteres
7、ttosmallerVOs,whohavetighterboundsonthestorageavailabletothem,butlarger(WLCG)VOsmaybeinterestedastheirtotaldataincreasesduringRun2.Weprovideananalysisofthecostsandbene tsoftheapproach,alongwithfuturedevelopmentandimplementationplansinthisarea.Ingeneral,overheadsformul
8、tiple letransfersprovidethelargestissueforcompetitivenessofthisapproachatpresent.1.IntroductionWLCG[2]VOshavebeendistributin
