289
Views
0
CrossRef citations to date
0
Altmetric
Research Articles

FMASketch: Freehand Mid-Air Sketching in AR

, , , , , & show all
Pages 2142-2152 | Received 30 Nov 2022, Accepted 06 Jun 2023, Published online: 22 Jun 2023
 

Abstract

Sketching is a common way to depict design ideas freely. Augmented reality technology extends the human–computer interaction space from the screen to the real world, providing a new application space for 3D sketching. However, due to the difficulty of depth perception, it is difficult for sketching strokes to maintain good planar and spatial consistency, making drawing 3D sketches in AR challenging. In this article, we propose FMASketch—a method of drawing mid-air sketches similar to building blocks. The auxiliary surfaces can ensure that the strokes drawn by users can always stay on the same plane as drawing in 2D space. Gestures are used to stitch together multiple drawing planes, and the strokes on the planes form a 3D sketch, which is very similar to how 3D modeling is done on the desktop by drawing different views and assembling them. Experiments have verified the effectiveness of the auxiliary surface generation method and gesture operations in this article. The mid-air sketching method is easy to learn and provides a new idea for rapid modeling in AR scenarios.

Disclosure statement

No potential conflict of interest was reported by the author(s).

Additional information

Notes on contributors

Yang Zhou

Yang Zhou is currently pursuing a doctoral degree in Software Institute of Nanjing University. He received his master’s degree in Software Engineering at Nanjing University in 2022. His research interests include interaction in Augmented Reality and sketch-based content generation.

Peixin Yang

Peixin Yang is currently a master student in Software Institute, Nanjing University. He received his bachelor’s degree in Software Engineering at Nanjing University in 2022. His research interests are interaction in Augmented Reality.

Xinchi Xu

Xinchi Xu is currently a master student in Software Institute, Nanjing University. He received his bachelor’s degree in Software Engineering at Dalian University of Technology University in 2020. His research interests include 3D sketching in Virtual Reality.

Bingchan Shao

Bingchan Shao is currently a master student in Software Institute, Nanjing University. She received her bachelor’s degree in Information Engineering at Tianjin University of Finance and Economics in 2020. Her research interests are interaction design for children.

Guihuan Feng

Guihuan Feng is currently working as an associate professor of Software Institute, Nanjing University. In 2009, she got her Ph.D. degree in Computer Science and Technology Department, Nanjing University. Her research interests include VR/AR interaction, pen-based interaction, software usability, AIGC etc.

Jie Liu

Jie Liu is currently working as an associate research fellow at Institute of Software, Chinese Academy of Sciences. In 2016, he got his Ph.D. degree at the Chinese Academy of Sciences. His research interests include intelligent perception, brain-like multimodal information intelligence processing, and big data intelligence analysis.

Bin Luo

Bin Luo is currently working as a professor at the Software Institute, Nanjing University. His research interests lie in Intelligent operating Systems and databases and Human-computer interaction.

Log in via your institution

Log in to Taylor & Francis Online

PDF download + Online access

  • 48 hours access to article PDF & online version
  • Article PDF can be downloaded
  • Article PDF can be printed
USD 61.00 Add to cart

Issue Purchase

  • 30 days online access to complete issue
  • Article PDFs can be downloaded
  • Article PDFs can be printed
USD 306.00 Add to cart

* Local tax will be added as applicable

Related Research

People also read lists articles that other readers of this article have read.

Recommended articles lists articles that we recommend and is powered by our AI driven recommendation engine.

Cited by lists all citing articles based on Crossref citations.
Articles with the Crossref icon will open in a new tab.