Advanced search
Publication Cover
Journal of the American Statistical Association Volume 115, 2020 - Issue 530
Submit an article Journal homepage
3,003
Views
48
CrossRef citations to date
0
Altmetric
Theory and Methods

Estimating Dynamic Treatment Regimes in Mobile Health Using V-Learning

Daniel J. Lucketta Department of Biostatistics, University of North Carolina at Chapel Hill, Chapel Hill, NC; View further author information
,
Eric B. Laberb Department of Statistics, North Carolina State University, Raleigh, NC; View further author information
,
Anna R. Kahkoskac Department of Nutrition, University of North Carolina at Chapel Hill, Chapel Hill, NC; View further author information
,
David M. Maahsd Department of Pediatrics, Stanford University, Stanford, CAView further author information
,
Elizabeth Mayer-Davisc Department of Nutrition, University of North Carolina at Chapel Hill, Chapel Hill, NC; View further author information
&
Michael R. Kosoroka Department of Biostatistics, University of North Carolina at Chapel Hill, Chapel Hill, NC; Correspondence[email protected]
View further author information
Pages 692-706 | Received 15 Jun 2017, Accepted 27 Sep 2018, Published online: 17 Apr 2019

Citations (48)

Keep up to date with the latest research on this topic with citation updates for this article.

Subscribe to citation updates

Read on this site (14)

Doudou Zhou, Yufeng Zhang, Aaron Sonabend-W, Zhaoran Wang, Junwei Lu & Tianxi Cai. (2024) Federated Offline Reinforcement Learning. Journal of the American Statistical Association 0:0, pages 1-12.
Read now
Yi Ding, Yingying Li & Rui Song. (2024) Statistical Learning for Individualized Asset Allocation. Journal of the American Statistical Association 119:545, pages 639-649.
Read now
Wenzhuo Zhou, Ruoqing Zhu & Annie Qu. (2024) Estimating Optimal Infinite Horizon Dynamic Treatment Regimes via pT-Learning. Journal of the American Statistical Association 119:545, pages 625-638.
Read now
Chengchun Shi, Jin Zhu, Shen Ye, Shikai Luo, Hongtu Zhu & Rui Song. (2024) Off-Policy Confidence Interval Estimation with Confounded Markov Decision Process. Journal of the American Statistical Association 119:545, pages 273-284.
Read now
Chengchun Shi, Shikai Luo, Yuan Le, Hongtu Zhu & Rui Song. (2024) Statistically Efficient Advantage Learning for Offline Reinforcement Learning in Infinite Horizons. Journal of the American Statistical Association 119:545, pages 232-245.
Read now
Pratik Ramprasad, Yuantong Li, Zhuoran Yang, Zhaoran Wang, Will Wei Sun & Guang Cheng. (2023) Online Bootstrap Inference For Policy Evaluation In Reinforcement Learning. Journal of the American Statistical Association 118:544, pages 2901-2914.
Read now
Chengchun Shi, Zhengling Qi, Jianing Wang & Fan Zhou. (2023) Value Enhancement of Reinforcement Learning via Efficient and Robust Trust Region Optimization. Journal of the American Statistical Association 0:0, pages 1-15.
Read now
Chengchun Shi, Xiaoyu Wang, Shikai Luo, Hongtu Zhu, Jieping Ye & Rui Song. (2023) Dynamic Causal Effects Evaluation in A/B Testing with a Reinforcement Learning Framework. Journal of the American Statistical Association 118:543, pages 2059-2071.
Read now
Wenchuan Guo, Xiao-Hua Zhou & Shujie Ma. (2021) Estimation of Optimal Individualized Treatment Rules Using a Covariate-Specific Treatment Effect Curve With High-Dimensional Covariates. Journal of the American Statistical Association 116:533, pages 309-321.
Read now
Xinkun Nie, Emma Brunskill & Stefan Wager. (2021) Learning When-to-Treat Policies. Journal of the American Statistical Association 116:533, pages 392-409.
Read now
Peng Liao, Predrag Klasnja & Susan Murphy. (2021) Off-Policy Estimation of Long-Term Average Outcomes With Applications to Mobile Health. Journal of the American Statistical Association 116:533, pages 382-391.
Read now
Xinyu Hu, Min Qian, Bin Cheng & Ying Kuen Cheung. (2021) Personalized Policy Learning Using Longitudinal Mobile Health Data. Journal of the American Statistical Association 116:533, pages 410-420.
Read now
Yifan Cui & Eric Tchetgen Tchetgen. (2021) A Semiparametric Instrumental Variable Approach to Optimal Treatment Regimes Under Endogeneity. Journal of the American Statistical Association 116:533, pages 162-173.
Read now
Elynn Y. Chen, Rui Song & Michael I. Jordan. Reinforcement Learning in Latent Heterogeneous Environments. Journal of the American Statistical Association 0:0, pages 1-32.
Read now

Articles from other publishers (34)

Nathan Kallus & Masatoshi Uehara. (2024) Efficient evaluation of natural stochastic policies in off-line reinforcement learning. Biometrika 111:1, pages 51-69.
Crossref
Weiwei Wang, Yuqiang Li & Xianyi Wu. (2023) Off-policy evaluation for tabular reinforcement learning with synthetic trajectories. Statistics and Computing 34:1.
Crossref
Hunyong Cho, Jane She, Daniel De Marchi, Helal El-Zaatari, Edward L Barnes, Anna R Kahkoska, Michael R Kosorok & Arti V Virkud. (2024) Machine Learning and Health Science Research: Tutorial. Journal of Medical Internet Research 26, pages e50890.
Crossref
Shikai Luo, Ying Yang, Chengchun Shi, Fang Yao, Jieping Ye & Hongtu Zhu. (2024) Policy evaluation for temporal and/or spatial dependent experiments. Journal of the Royal Statistical Society Series B: Statistical Methodology.
Crossref
Alaa Awad Abdellatif, Naram Mhaisen, Amr Mohamed, Aiman Erbad & Mohsen Guizani. (2023) Reinforcement Learning for Intelligent Healthcare Systems: A Review of Challenges, Applications, and Open Research Issues. IEEE Internet of Things Journal 10:24, pages 21982-22007.
Crossref
Chengchun Shi, Runzhe Wan, Ge Song, Shikai Luo, Hongtu Zhu & Rui Song. (2023) A multiagent reinforcement learning framework for off-policy evaluation in two-sided markets. The Annals of Applied Statistics 17:4.
Crossref
Zhen Li, Jie Chen, Eric Laber, Fang Liu & Richard Baumgartner. (2023) Optimal Treatment Regimes: A Review and Empirical Comparison. International Statistical Review 91:3, pages 427-463.
Crossref
Zhishuai Liu, Jesse Clifton, Eric B. Laber, John Drake & Ethan X. Fang. (2023) Deep Spatial Q-Learning for Infectious Disease Control. Journal of Agricultural, Biological and Environmental Statistics 28:4, pages 749-773.
Crossref
J Chu, W Lu & S Yang. (2023) Targeted optimal treatment regime learning using summary statistics. Biometrika 110:4, pages 913-931.
Crossref
Soroush Saghafian. (2023) Ambiguous Dynamic Treatment Regimes: A Reinforcement Learning Approach. Management Science.
Crossref
Samuel J. Weisenthal, Sally W. Thurston & Ashkan Ertefaie. (2023) Relative sparsity for medical decision problems. Statistics in Medicine 42:18, pages 3067-3092.
Crossref
J Shi, Z Wu & W Dempsey. (2023) Assessing time-varying causal effect moderation in the presence of cluster-level treatment effect heterogeneity and interference. Biometrika 110:3, pages 645-662.
Crossref
Jiayi Wang, Zhengling Qi & Raymond K. W. Wong. (2023) Projected state-action balancing weights for offline reinforcement learning. The Annals of Statistics 51:4.
Crossref
Yuchen Hu & Stefan Wager. (2023) Off-policy evaluation in partially observed Markov decision processes under sequential ignorability. The Annals of Statistics 51:4.
Crossref
Eric J. Rose, Erica E. M. Moodie & Susan M. Shortreed. (2023) Monte Carlo sensitivity analysis for unmeasured confounding in dynamic treatment regimes. Biometrical Journal 65:5.
Crossref
Palash Ghosh, Xiaoxi Yan & Bibhas Chakraborty. (2023) A novel approach to assess dynamic treatment regimes embedded in a SMART with an ordinal outcome. Statistics in Medicine 42:7, pages 1096-1111.
Crossref
Chao Yu, Jiming Liu, Shamim Nemati & Guosheng Yin. (2021) Reinforcement Learning in Healthcare: A Survey. ACM Computing Surveys 55:1, pages 1-36.
Crossref
Yuhe Gao, Chengchun Shi & Rui Song. (2023) Deep spectral Q‐learning with application to mobile health. Stat 12:1.
Crossref
Peng Liao, Zhengling Qi, Runzhe Wan, Predrag Klasnja & Susan A. Murphy. (2022) Batch policy learning in average reward Markov decision processes. The Annals of Statistics 50:6.
Crossref
Haozheng Luo, Tianyi Wu, Colin Feiyu Han & Zhijun Yan. (2022) IGN : Implicit Generative Networks. IGN : Implicit Generative Networks.
Nathan Kallus & Masatoshi Uehara. (2022) Efficiently Breaking the Curse of Horizon in Off-Policy Evaluation with Double Reinforcement Learning. Operations Research 70:6, pages 3282-3302.
Crossref
Mingyang Liu, Xiaotong Shen & Wei Pan. (2022) Deep reinforcement learning for personalized treatment recommendation. Statistics in Medicine 41:20, pages 4034-4056.
Crossref
William Hua, Hongyuan Mei, Sarah Zohar, Magali Giral & Yanxun Xu. (2022) Personalized Dynamic Treatment Regimes in Continuous Time: A Bayesian Approach for Optimizing Clinical Decisions with Timing. Bayesian Analysis 17:3.
Crossref
Eun Jeong Oh, Min Qian & Ying Kuen Cheung. (2022) Generalization error bounds of dynamic treatment regimes in penalized regression-based learning. The Annals of Statistics 50:4.
Crossref
Alan Mackey & Eoghan Furey. (2022) Artificial Pancreas Control for Diabetes using TD3 Deep Reinforcement Learning. Artificial Pancreas Control for Diabetes using TD3 Deep Reinforcement Learning.
Tianhao Li, Zhishun Wang, Wei Lu, Qian Zhang & Dengfeng Li. (2022) Electronic health records based reinforcement learning for treatment optimizing. Information Systems 104, pages 101878.
Crossref
Nina Deliu & Bibhas Chakraborty. 2022. The Elements of Joint Learning and Optimization in Operations Management. The Elements of Joint Learning and Optimization in Operations Management 391 444 .
Tianchen Qian, Hyesun Yoo, Predrag Klasnja, Daniel Almirall & Susan A Murphy. (2021) Estimating time-varying causal excursion effects in mobile health with binary outcomes. Biometrika 108:3, pages 507-527.
Crossref
Tze Leung Lai & Hongsong Yuan. (2021) Stochastic Approximation: From Statistical Origin to Big-Data, Multidisciplinary Applications. Statistical Science 36:2.
Crossref
Alessandra Mattei, Fabrizia Mealli & Anahita Nodehi. 2020. Handbook of Labor, Human Resources and Population Economics. Handbook of Labor, Human Resources and Population Economics 1 41 .
Matthew D. Koslovsky, Emily T. Hébert, Michael S. Businelle & Marina Vannucci. (2020) A Bayesian time-varying effect model for behavioral mHealth data. The Annals of Applied Statistics 14:4.
Crossref
John Sperger, Nikki L. B. Freeman, Xiaotong Jiang, David Bang, Daniel de Marchi & Michael R. Kosorok. (2020) The future of precision health is data‐driven decision support. Statistical Analysis and Data Mining: The ASA Data Science Journal 13:6, pages 537-543.
Crossref
Lin Dong, Eric Laber, Yair Goldberg, Rui Song & Shu Yang. (2020) Ascertaining properties of weighting in the estimation of optimal treatment regimes under monotone missingness. Statistics in Medicine 39:25, pages 3503-3520.
Crossref
Jesse CliftonEric Laber. (2020) Q-Learning: Theory and Applications. Annual Review of Statistics and Its Application 7:1, pages 279-301.
Crossref

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Order Reprints Request Corporate Permissions

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

Request Academic Permissions

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.

Related research

People also read lists articles that other readers of this article have read.

Recommended articles lists articles that we recommend and is powered by our AI driven recommendation engine.

Cited by lists all citing articles based on Crossref citations.
Articles with the Crossref icon will open in a new tab.