资源描述：
《!RL for Optimized Trade Execution》由会员上传分享，免费在线阅读，更多相关内容在学术论文-天天文库。
1、ReinforcementLearningforOptimizedTradeExecutionYuriyNevmyvakayuriy.nevmyvaka@lehman.comLehmanBrothers,745SeventhAv.,NewYork,NY10019,USAYiFengfengyi@cis.upenn.edu1MichaelKearnsmkearns@cis.upenn.eduUniversityofPennsylvania,Philadelphia,PA19104,USAAbstract
2、everystrategy'sprofitabilitywilldependonhowwellitisimplemented.Wepresentthefirstlarge-scaleempiricalapplicationofreinforcementlearningtotheFormostofthehistoryoftheU.S.equitymarkets,theimportantproblemofoptimizedtradeexecutiononlyinformationavailabletoan
3、agentattemptingtoinmodernfinancialmarkets.Ourexperimentsoptimizetradeexecutionwasthesequenceofpricesofarebasedon1.5yearsofmillisecondtime-scalealready-executedtrades,andthecurrentbidandask(thelimitorderdatafromNASDAQ,andbestoutstandingbuyandsellpricesof
4、fered).Butinrecentdemonstratethepromiseofreinforcementyears,electronicmarketssuchasNASDAQhavebegunlearningmethodstomarketmicrostructurereleasing,inrealtime,alloftheoutstandingbuyandsellproblems.Ourlearningalgorithmintroducesandlimitorderpricesandvolumes
5、(oftenreferredtoasorderexploitsanatural"low-impact"factorizationofbookormarketmicrostructuredata).Itisnotdifficulttothestatespace.seethatsuchdatamightbeextremelyvaluablefortheproblemofoptimizedexecution,sincethedistributionofoutstandinglimitordersmayhel
6、ppredictshort-termprice1.Introductiondirection,likelihoodofexecutionatagivenprice,buyorsellsideimbalances,andsoon.Inthedomainofquantitativefinance,therearemanycommonproblemsinwhichtherearepreciselyspecifiedInthispaper,wereportonthefirstextensiveempirica
7、lobjectivesandconstraints.Animportantexampleistheapplicationofreinforcementlearning(RL)totheproblemproblemofoptimizedtradeexecution(whichhasalsoofoptimizedexecutionusinglarge-scaleNASDAQbeenexaminedinthetheoreticalcomputersciencemarketmicrostructuredata
8、sets.Ourbasicexperimentalliteratureastheone-waytradingproblem).Previousworkmethodology(detailedinSection3)consistsoftheonthisproblemincludes(AmgenandChriss,2002),followingsteps:(BertsimasandLo,1998),(Cogginsetal.,2003),(El-1.Thei
