A reinforcement learning approach to optimal execution

References

• Akesson, B.M. and Toivonen, H.T., A neural network model predictive controller. J. Process Control, 2006, 16(9), 937–946.
   Web of Science ®Google Scholar
• Almgren, R. and Chriss, N., Optimal execution of portfolio transactions. J. Risk, 2000, 3(2), 5–39.
   Google Scholar
• Becker, S., Cheridito, P. and Jentzen, A., Deep optimal stopping. J. Mach. Learn. Res., 2019, 20, 1–25.
   Web of Science ®Google Scholar
• Becker, S., Cheridito, P. and Jentzen, A., Pricing and hedging 1796 American-style options with deep learning. J. Risk Financ. Manag., 2020, 13(7), 158, 1–12.
   Web of Science ®Google Scholar
• Becker, S., Cheridito, P., Jentzen, A. and Welti, T., Solving high-dimensional optimal stopping problems using deep learning. Eur. J. Appl. Math., 2021, 32(3), 470–514.
   Web of Science ®Google Scholar
• Bertsimas, D. and Lo, A.W., Optimal control of execution costs. J. Financ. Markets, 1998, 1(1), 1–50.
   Google Scholar
• Coggins, R., Blazejewski, A. and Aitken, M., Optimal trade execution of equities in a limit order market. IEEE Int. Conf. Comput. Intell. Financ. Eng., 2003, 10(1109), 371–378.
   Google Scholar
• Desai, V., Farias, V. and Moallemi, C., Pathwise optimization for optimal stopping problems. Manage. Sci., 2012, 58(12), 2292–2308.
   Web of Science ®Google Scholar
• El-Yaniv, R., Fiat, A., Karp, R.M. and Turpin, G., Optimal search and one-way trading online algorithms. Algorithmica, 2001, 30(1), 101–139.
   Web of Science ®Google Scholar
• Francois-Lavet, V., Rabusseau, G., Pineau, J., Ernst, D. and Fonteneau, R., On overfitting and asymptotic bias in batch reinforcement learning with partial observability. J. Artif. Intell. Res., 2019, 65, 1–30.
   Web of Science ®Google Scholar
• Gaspar, R., Lopes, S. and Sequeira, B., Neural network pricing of American put options. Risks, 2020, 8(3), 73.
   Web of Science ®Google Scholar
• Haugh, M. and Kogan, L., Pricing american options: A duality approach. Oper. Res., 2004, 52(2), 258–270.
   Web of Science ®Google Scholar
• Herrera, C., Krach, F., Ruyssen, P. and Teichmann, J., Optimal Stopping Via Randomized Neural Networks, 2021, arXiv.org:2104. 13669.
   Google Scholar
• Kearns, M. and Singh, S., Bias-variance error bounds for temporal difference updates. In COLT: Proceedings of the Thirteenth Annual Conference on Computational Learning Theory, pp. 142–147, 2000 (Morgan Kaufmann: San Francisco, CA).
   Google Scholar
• Kim, A.J., Shelton, C.R. and Poggio, T., Modeling stock order flows and learning market-making from data. Technical Report CBCL Paper No. 217 / AI Memo No. 2002-009, M.I.T., Cambridge, MA, 2002. Available at SSRN: https://ssrn.com/abstract=1171370, https://doi.org/http://doi.org/10.2139/ssrn.1171370
   Google Scholar
• Longstaff, F. and Schwartz, E., Valuing American options by simulation: A simple least-squares approach. Rev. Financ. Stud., 2001, 14(1), 113–147.
   Web of Science ®Google Scholar
• NASDAQ Stock Exchange, NASDAQ TotalView-ITCH 4.1, 2010. Available at: http://www.nasdaqtrader.com/content/technicalsupport/specifications/dataproducts/nqtv-itch-v4_1.pdf.
   Google Scholar
• Nevmyvaka, Y., Feng, Y. and Kearns, M., Reinforcement learning for optimized trade execution. Int. Conf. Mach. Learn., 2006, 673–680.
   Google Scholar
• Obizhaeva, A. and Wang, J., Optimal trading strategy and supply/demand dynamics. J. Financ. Markets, 2013, 16(1), 1–32.
   Web of Science ®Google Scholar
• Park, B. and Van Roy, B., Adaptive execution: Exploration and learning of price impact. Oper. Res., 2015, 63(5), 1058–1076.
   Web of Science ®Google Scholar
• Rogers, L.C.G., Monte Carlo valuation of American options. Math. Finance, 2002, 12(3), 271–286.
   Web of Science ®Google Scholar
• Sirignano, J.A., Deep learning for limit order books. Quant. Finance, 2019, 19(4), 549–570. https://doi.org/https://doi.org/10.1080/14697688.2018.1546053.
   Web of Science ®Google Scholar
• Sutton, R. and Barto, A., Reinforcement Learning, 1998 (MIT Press). ISBN 978-0-585-0244-5.
   Google Scholar
• Tsitsiklis, J. and Van Roy, B., Regression methods for pricing complex American-style options. IEEE Trans. Neural Netw., 2001, 12(4), 694–703.
   PubMed Web of Science ®Google Scholar
• van Hasselt, H., Double q learning. Adv. Neural Inf. Process. Syst., 2010.
   Google Scholar
• van Hasselt, H., Guez, A. and Silver, D., Deep reinforcement learning with double q-learning. In AAAI'16: Proceedings of the Thirtieth AAAI Conference on Artificial Intelligence, pp. 2094–2100, 2016.
   Google Scholar