289
Views
0
CrossRef citations to date
0
Altmetric
Research Articles

FMASketch: Freehand Mid-Air Sketching in AR

, , , , , & show all
Pages 2142-2152 | Received 30 Nov 2022, Accepted 06 Jun 2023, Published online: 22 Jun 2023

References

  • Arora, R., Kazi, R. H., Grossman, T., Fitzmaurice, G. W., & Singh, K. (2018). SymbiosisSketch: Combining 2D & 3D sketching for designing detailed 3D objects in situ. In R. L. Mandryk, M. Hancock, M. Perry, & A. L. Cox (Eds.), Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, CHI 2018, Montreal, QC, Canada, April 21–26, 2018 (p. 185). ACM.
  • Assets, Z. (2018). Paint Space AR. Google. Retrieved from https://www.paintspacear.com/
  • Aytricks, V. (2018). PaintDrawAR. Apple. Retrieved from https://apps.apple.com/cn/app/id1364822776
  • Bai, H., Lee, G. A., Mukundan, R., & Billinghurst, M. (2014). 3D gesture interaction for handheld augmented reality. In SIGGRAPH Asia 2014 Mobile Graphics and Interactive Applications, Shenzhen, China, December 3–6, 2014 (pp. 7:1–7:6). ACM. https://doi.org/10.1145/2669062.2669073
  • Billinghurst, M., Piumsomboon, T., & Bai, H. (2014). Hands in space: Gesture interaction with augmented-reality interfaces. IEEE Computer Graphics and Applications, 34(1), 77–80. https://doi.org/10.1109/MCG.2014.8
  • Chen, Z., Ma, X., Peng, Z., Zhou, Y., Yao, M., Ma, Z., Wang, C., Gao, Z., & Shen, M. (2018). User-defined gestures for gestural interaction: Extending from hands to other body parts. International Journal of Human–Computer Interaction, 34(3), 238–250. https://doi.org/10.1080/10447318.2017.1342943
  • Cherlin, J. J., Samavati, F., Sousa, M. C., & Jorge, J. A. (2005). Sketch-based modeling with few strokes. In B. Jüttler (Ed.), Spring Conference on Computer Graphics, SCCG 2005, Budmerice Castle, Slovakia, May 12–14, 2005 (pp. 137–145). ACM. https://doi.org/10.1145/1090122.1090145
  • Chun, W. H., & Höllerer, T. (2013). Real-time hand interaction for augmented reality on mobile phones. In J. Kim, J. Nichols, & P. A. Szekely (Eds.), 18th International Conference on Intelligent User Interfaces, IUI 2013, Santa Monica, CA, USA, March 19–22, 2013 (pp. 307–314). ACM. https://doi.org/10.1145/2449396.2449435
  • Entem, E., Barthe, L., Cani, M., Cordier, F., & van de Panne, M. (2015). Modeling 3D animals from a side-view sketch. Computers & Graphics, 46(2015), 221–230. https://doi.org/10.1016/j.cag.2014.09.037
  • Faleel, S. A. M., Gammon, M., Sakamoto, Y., Menon, C., & Irani, P. (2020). User gesture elicitation of common smartphone tasks for hand proximate user interfaces. In M. Choukou, R. Täıar, P. Irani, & J. Seigneur (Eds.), AH ’20: 11th Augmented Human International Conference, Winnipeg, Manitoba, Canada, May 27–28, 2020 (pp. 6:1–6:8). ACM.
  • Feng, L., Yang, X., & Xiao, S. (2017). Magictoon: A 2D-to-3D creative cartoon modeling system with mobile AR. In E. S. Rosenberg (Eds.), 2017 IEEE Virtual Reality, VR 2017, Los Angeles, CA, USA, March 18–22, 2017 (pp. 195–204). IEEE Computer Society. https://doi.org/10.1109/VR.2017.7892247
  • Gombac, L., Pucihar, K. C., Kljun, M., Coulton, P., & Grbac, J. (2016). 3D virtual tracing and depth perception problem on mobile AR. In J. Kaye, A. Druin, C. Lampe, D. Morris, & J. P. Hourcade (Eds.), Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, San Jose, CA, USA, May 7–12, 2016, Extended Abstracts (pp. 1849–1856). ACM. https://doi.org/10.1145/2851581.2892412
  • Gustafson, S., Rabe, B., & Baudisch, P. (2013). Understanding palm-based imaginary interfaces: The role of visual and tactile cues when browsing. In W. E. Mackay, S. A. Brewster, & S. Bødker (Eds.), 2013 ACM SIGCHI Conference on Human Factors in Computing Systems, CHI ’13, Paris, France, April 27–May 2, 2013 (pp. 889–898). ACM.
  • Higuchi, M., & Komuro, T. (2015). Multi-finger AR typing interface for mobile devices using high-speed hand motion recognition. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems (pp. 1235–1240). Association for Computing Machinery. https://doi.org/10.1145/2702613.2732741
  • Igarashi, T., Matsuoka, S., & Tanaka, H. (2006). Teddy: A sketching interface for 3D freeform design. In ACM SIGGRAPH 2006 Courses (pp. 11–es). Association for Computing Machinery. https://doi.org/10.1145/1185657.1185772
  • Jackson, B., & Keefe, D. F. (2016). Lift-off: Using reference imagery and freehand sketching to create 3d models in VR. IEEE Transactions on Visualization and Computer Graphics, 22(4), 1442–1451. https://doi.org/10.1109/TVCG.2016.2518099
  • Kim, Y., An, S.-G., Lee, J. H., & Bae, S.-H. (2018). Agile 3D sketching with air scaffolding. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems (p. 1). Association for Computing Machinery.
  • Kwan, K. C., & Fu, H. (2019). Mobi3dsketch: 3D sketching in mobile AR. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (pp. 1–11). Association for Computing Machinery.
  • Lab, G. C. (2018). Just a line. Author. Retrieved from https://justaline.withgoogle.com/
  • Liu, H. (2021). AR + Brush. Google. Retrieved from https://itunes.apple.com/nz/app/ar-brush/id1273579764?mt=8
  • Piumsomboon, T., Clark, A., Billinghurst, M., & Cockburn, A. (2013). User-defined gestures for augmented reality. In CHI ’13 Extended Abstracts on Human Factors in Computing Systems (pp. 955–960). Association for Computing Machinery. https://doi.org/10.1145/2468356.2468527
  • Qian, J., Zhou, T., Young-Ng, M., Ma, J., Cheung, A., Li, X., Gonsher, I., & Huang, J. (2021). Portalware: Exploring free-hand AR drawing with a dual-display smartphone-wearable paradigm. In W. Ju, L. Oehlberg, S. Follmer, S. E. Fox, & S. Kuznetsov (Eds.), DIS ’21: Designing Interactive Systems Conference 2021, Virtual Event, USA, June 28–July 2, 2021 (pp. 205–219). ACM. https://doi.org/10.1145/3461778.3462098
  • Shin, H., & Igarashi, T. (2007). Magic canvas: Interactive design of a 3-D scene prototype from freehand sketches. In Proceedings of Graphics Interface 2007 (pp. 63–70). Association for Computing Machinery. https://doi.org/10.1145/1268517.1268530
  • Suzuki, R., Kazi, R. H., Wei, L., DiVerdi, S., Li, W., & Leithinger, D. (2020). RealitySketch: Embedding responsive graphics and visualizations in AR through dynamic sketching. In Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology (pp. 166–181). Association for Computing Machinery.
  • Wacker, P., Nowak, O., Voelker, S., & Borchers, J. O. (2019). Arpen: Mid-air object manipulation techniques for a bimanual AR system with pen & smartphone. In S. A. Brewster, G. Fitzpatrick, A. L. Cox, & V. Kostakos (Eds.), Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, CHI 2019, Glasgow, Scotland, UK, May 4–9, 2019 (p. 619). ACM. https://doi.org/10.1145/3290605.3300849
  • Wacker, P., Wagner, A., Voelker, S., & Borchers, J. O. (2020). Heatmaps, shadows, bubbles, rays: Comparing mid-air pen position visualizations in handheld AR. In R. Bernhaupt (Ed.), CHI ’20: CHI Conference on Human Factors in Computing Systems, Honolulu, HI, USA, April 25–30, 2020 (pp. 1–11). ACM. https://doi.org/10.1145/3313831.3376848
  • Wobbrock, J. O., Morris, M. R., & Wilson, A. D. (2009). User-defined gestures for surface computing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp. 1083–1092). Association for Computing Machinery. https://doi.org/10.1145/1518701.1518866
  • Xin, M., Sharlin, E., & Sousa, M. C. (2008). Napkin sketch: Handheld mixed reality 3D sketching. In Proceedings of the 2008 ACM Symposium on Virtual Reality Software and Technology (pp. 223–226). Association for Computing Machinery.
  • Xu, P., Fu, H., Zheng, Y., Singh, K., Huang, H., & Tai, C. (2019). Model-guided 3D sketching. IEEE Transactions on Visualization and Computer Graphics, 25(10), 2927–2939. https://doi.org/10.1109/TVCG.2018.2860016
  • Yee, B., Ning, Y., & Lipson, H. (2009). Augmented reality in-situ 3D sketching of physical objects. In Intelligent UI Workshop on Sketch Recognition (Vol. 1).
  • Zhou, Y., Zong, L., Xu, X., Lai, W., Chen, Y., Feng, G., & Liu, J. (2022). GesmoSketch: A system for 3D sketching in AR with one mobile device. In 2022 8th International Conference on Virtual Reality (ICVR) (pp. 7–14). https://doi.org/10.1109/ICVR55215.2022.9848003

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.