1,964
Views
2
CrossRef citations to date
0
Altmetric
Special Issue: Invited Paper

Fabrication technology for light field reconstruction in glasses-free 3D display

, &
Pages 13-29 | Received 07 Jun 2022, Accepted 17 Aug 2022, Published online: 08 Sep 2022

ABSTRACT

Light field 3D display has attracted great attention as the hardware interface for a virtual 3D application. The design and fabrication of light-modulating structures directly affect the authenticity of the reconstructed 3D image. The critical challenges in 3D display, such as visual fatigue, limited motion parallax, and insufficient light efficiency, are closely related to the inaccurate phase or angular reconstruction of the virtual light field. While the designs of light field modulators are widely introduced in all kinds of studies, the importance of fabrication for 3D display is usually under-estimated. Large format, small feature size, and high precision in shape are the three critical requirements of fabrication for 3D display. In this paper, we focus on the fabrication technologies for light-modulating structures. Fabrication tools for both microstructures and nanostructures are introduced. The fabrication capability, critical challenges and its applications in light field 3D display are discussed. Finally, the future development of 3D display related fabrication technologies are highlighted.

1. Introduction for light field 3D display

With the advent of a 3D world, people have become dissatisfied by the visual perception of 2D imagery. Creating a virtual 3D universe has been man’s dream for 150 years since C. Wheatstone first invented stereoscopy [Citation1]. A virtual 3D image can be reconstructed by discretizing a continuously distributed light field and creating multiple views based on either ray-tracing method or wavefront approach. The term ‘light field' used here either refers to the light ray collection of a 3D scene from the perspective of geometric optics or to the amplitude and phase information of a wavefront in wave optics. With properly arranged views, 3D images with motion parallax and stereo parallax can be visualized by integrating an optical element with a flat panel. Different from other technologies including holographic display and volumetric display, light field 3D display has a compact form factor compatible with portable electronic devices. The function of the optical element in a light field 3D display is to modulate the phase information of light field and generate a finite number of views, while the display panel refreshes the amplitude information. Notably, the modulated phase information of a view in diffractive optics-based 3D display not only refers to the angular deflection, but also includes light intensity distribution, angular separation, and view shape. As illustrated in Figure , parallax barriers, lenticular lens arrays, microlens array, directional backlight, multi-layer LCDs and diffractive optical elements (e.g. diffractive gratings, metasurfaces, etc) have been extensively studied for creating multiple views.

Figure 1. Several approaches of light field reconstruction display. (a) Parallax barrier-based 3D display. (b) Cylindrical lens array-based 3D display. (c) MLA-based 3D display. (d) Spatio-temporal multiplexing-based 3D display. (e) Multi-layer LCD-based 3D display. (f) Diffractive optics-based 3D display. (f) Reproduced with permission [Citation2]. Copyright 2022, Optica Publishing Group.

Figure 1. Several approaches of light field reconstruction display. (a) Parallax barrier-based 3D display. (b) Cylindrical lens array-based 3D display. (c) MLA-based 3D display. (d) Spatio-temporal multiplexing-based 3D display. (e) Multi-layer LCD-based 3D display. (f) Diffractive optics-based 3D display. (f) Reproduced with permission [Citation2]. Copyright 2022, Optica Publishing Group.

Parallax barrier-based 3D display was first developed by F. E. Ives in 1902 [Citation3]. A shaded screen was adopted in front of a screen to orient the emitted light and create parallax, as shown in Figure (a) [Citation4]. Although the parallax barrier has been applied to 3D display owing to its advantages of easily accessible fabrication and low cost, low light efficiency hinders its further development. Cylindrical lens-based 3D display was then employed, as shown in Figure (b), to improve the light efficiency. Similar to the parallax barrier-based 3D display, the direction of light is modulated by the cylindrical lens, forming multiple views in space (Figure (b)). Based on binocular disparity, the 3D images can be formed in the human brain. Despite the limited motion parallax provided by cylindrical lens, it is the technology that is closest to the industrial sector. Most recently, Huang et al. used a head tracking system to expand the FOV to 56.5°, as shown in Figure (c) [Citation5].

Figure 2. (a) Schematic of parallax barrier-based 3D display. Reproduced with permission [Citation4]. Copyright 2015, Optica Publishing Group. (b) Schematic of cylindrical lens array-based 3D display. (c) Images from different perspectives. Reproduced with permission [Citation5]. Copyright 2019, Optica Publishing Group. (d) MLA-based light field 3D display system and corrected elemental image. (e) 3D light-field display results of a 3D image. Reproduced with permission [Citation18]. Copyright 2018, Optica Publishing Group.

Figure 2. (a) Schematic of parallax barrier-based 3D display. Reproduced with permission [Citation4]. Copyright 2015, Optica Publishing Group. (b) Schematic of cylindrical lens array-based 3D display. (c) Images from different perspectives. Reproduced with permission [Citation5]. Copyright 2019, Optica Publishing Group. (d) MLA-based light field 3D display system and corrected elemental image. (e) 3D light-field display results of a 3D image. Reproduced with permission [Citation18]. Copyright 2018, Optica Publishing Group.

Cylindrical lens-based 3D display only provides horizontal parallax, while light field display based on microlens array (MLA) produces full parallax. First proposed by G. Lippmann in 1908 [Citation6], the MLA-based 3D display is realized by recording and reproducing the light field from 3D objects [Citation7–12], based on the optical reversibility theorem (Figure (d)). In recent studies, various novel optical elements [Citation13–15], such as quarter-overlapped MLAs (QOMLA) [Citation16], have been introduced to improve display performance. For example, a bionic compound eye structure was proposed to obtain an FOV of 28° and 22° in the horizontal direction and vertical direction, respectively [Citation17]. A holographic functional screen is used with lens-array to spread beam and recompose the light distribution [Citation18], as shown in Figure (e). MLA is further adopted in near-eye displays to solve vergence and accommodation conflict [Citation19].

Spatio-temporal multiplexing-based 3D display employs a directional backlight and a high-speed liquid crystal display (LCD) panel to achieve full-resolution 3D parallax [Citation20–22]. In spatio-temporal multiplexing-based 3D display, the perspective images are projected to the left and right eyes consecutively through a high-speed LCD in a time-multiplexing manner (Figure (d)). Initially, spatio-temporal multiplexing 3D display is limited to a single user. To solve this problem, an inverted trapezoidal microstructure was designed to split each view into three views for multi-user application [Citation23]. Aside from surface-relief structures, volume-holographic optical elements (VHOEs) were proposed to control the direction of light at a time-multiplexed manner [Citation24]. The schematics of the system are shown in Figure (a).

Figure 3. (a) Schematic of the spatio-temporal multiplexing-based 3D display for multi-users. (b) Schematic of the VHOE-based time-sequential 3D display (c) Demonstrated photographs from the left and right eyes. Reproduced with permission [Citation24]. Copyright 2014, Optica Publishing Group.

Figure 3. (a) Schematic of the spatio-temporal multiplexing-based 3D display for multi-users. (b) Schematic of the VHOE-based time-sequential 3D display (c) Demonstrated photographs from the left and right eyes. Reproduced with permission [Citation24]. Copyright 2014, Optica Publishing Group.

In multi-layer LCD-based 3D display, or so called ‘tensor display,' stacked liquid crystal (LC) panels are implemented as attenuating layers to define the emitting angle of light beam from the 3D screen, as shown in Figure (e) [Citation25]. In another light-efficient design, a stack of LCDs is sandwiched between a single pair of crossed linear polarizers. The LCDs function as polarization rotators, instead of light attenuators. In a dynamic prototype, an FOV of 10° and views of 7 × 7 [Citation26] were achieved. Optimization algorithms were further developed to improve the optical performance of a tensor display [Citation27,Citation28].

Diffractive optics provide a new approach to reconstructing the light field at a wide viewing angle. Fattal et al. [Citation29] proposed a periodic nanogratings-based 3D display with an FOV of 90°and views of 64. The work paves the way for research on 3D display based on diffractive optical waveguides. To increase the light efficiency and expand the viewing angle, multilevel diffractive optics was subsequently introduced [Citation30–33]. Metalenses, which benefit from their excellent light field modulation capabilities, were used to correct chromatic aberrations in images at an ultra-thin form factor [Citation34]. 1D metagrating with varied spatial frequency and orientation is also adopted as light field modulator to manipulate the angular deflection pixel by pixel. As a result, the angular separation and view arrangement can be freely tailored. Later on, 2D metagrating matrix was adopted in 3D display to reduce crosstalk, increase viewing angle, and manipulate the view distribution [Citation31,Citation35–41].

3D display is the art of light modulation using structures. The design and fabrication of light field modulators directly affect the authenticity of the reconstructed 3D image. Critical challenges, such as visual fatigue, limited motion parallax, insufficient light efficiency, are closely related to the inaccurate phase (or angular) reconstruction of the virtual light field. While designs of light field modulators are widely introduced in all kinds of studies, the importance of fabrication for 3D display is usually under-estimated. In this paper, we focus on the fabrication technologies for light field modulator. The patterning of light field modulator for 3D display clearly falls into the category of extreme fabrication. Firstly, a functional 3D display is in the format of 6–100 inch [Citation33,Citation41,Citation42]. The minimum feature size is in the range of 100 nm–10 mm [Citation18,Citation29,Citation43]. Secondly, to precisely reconstruct the phase information of light field, the tuning capability of surface profile or periodic arrangement of structures is required ideally below 1 nm for precise angular modulation. Therefore, large format, small feature size, and high precision in profiling are the three critical requirements of light field modulator fabrication. Benefiting from the fast growth of fabrication technology, there are several tools that fit the fabrication of structures depending on the scale. For example, MLA is usually fabricated by screening printing [Citation44,Citation45], thermal reflow technology [Citation46–50], ultra-precision machining [Citation51,Citation52], and laser direct writing (LDW). Electron beam lithography (EBL), interferential lithography, and two-photon polymerization lithography (TPL) are widely used to fabricate nanostructures-based light field modulator. In Table , the characteristics of several light field modulators are listed. Geometric optics-based light field modulators have a larger typical structural size, ranging from tens of microns to a few millimeters. In comparison, diffractive optics-based light field modulators offer a larger viewing angle, with smaller typical feature size. In Sections 2 and 3, we highlight multiple fabrication methods and their capability range. Finally, prospects, challenges, and future directions are addressed in Section 4.

Table 1. Characteristics of light field modulators in light field 3D display.

2. Fabrication technology for microstructures and above

2.1. Ultraprecision machining methods

Ultraprecision machining technologies, such as diamond micro-milling and single-point diamond turning (SPDT), are effective methods of fabricating geometric optical elements, including cylindrical lens array and MLA [Citation42,Citation59–66]. All-ending milling usually utilizes single crystal diamond tools to remove metallic materials or polymers [Citation60,Citation67]. After the patterning process, the structured sheet is stripped off and inserted into an injection mold. The geometric optical elements are then mass produced by injection molding process. Based on this method, the surface roughness is less than 10 nm and the peak-to-valley (PV-value) is less than 0.150 µm [Citation68]. Figure (a) shows an MLA processed by a lathe. Although diamond micro-milling has been shown to be an effective fabrication method, inhomogeneity still exists on the turning surface. The most critical issue related to inhomogeneity is the induced vibration of the servo motion in the turning process, which is caused by the inevitable non-smooth trajectory during fabrication [Citation69,Citation70]. To suppress the vibration induced by non-smooth motion, one potential solution is to slow down the moving velocity, which in turn may lead to extremely low machining efficiency. A quasi-elliptical tool servo (QETS) diamond turning technique was proposed by properly decomposing the non-smooth servo motion into two quasi-harmonic smooth motions. The QETS provides the capability to eliminate undesired motion vibrations without reducing the cutting efficiency [Citation71]. Mechanical machining is capable of fabricating cylindrical lens and MLAs with precisely controlled surface profiling. Therefore, aberrations in 3D display can be effectively suppressed, especially at a large viewing angle [Citation72]. Benefiting from the precision profiling capability of diamond turning process, a freeform multi-focal MLA is fabricated to extend the depth of field in 3D display, as shown in Figure (b–e) [Citation52]. Diamond turning is also adopted to fabricate grooved light guide in spatio-temporal multiplexing-based 3D display for separation of views [Citation21]. In addition to fabricating smooth surfaces, ultra-precision machining is also adopted to pattern discontinuous structures, such as Fresnel lens arrays and directional micro grating arrays, by combining the multiple translational and the rotational servo motions [Citation73].

Figure 4. (a) Turning of microlens array on the mental sheet. Reproduced with permission [Citation51]. Copyright 2018, Springer Nature. (b) Schematic of multi- central depth plane 3D display system. (c) Photograph of fabricated MLA. Captured images of virtual 3D targets at different diopters: (d) Focused at 1 diopter, (e) Focused at 1.82 diopter. Reproduced with permission [Citation52]. Copyright 2021, Optica Publishing Group.

Figure 4. (a) Turning of microlens array on the mental sheet. Reproduced with permission [Citation51]. Copyright 2018, Springer Nature. (b) Schematic of multi- central depth plane 3D display system. (c) Photograph of fabricated MLA. Captured images of virtual 3D targets at different diopters: (d) Focused at 1 diopter, (e) Focused at 1.82 diopter. Reproduced with permission [Citation52]. Copyright 2021, Optica Publishing Group.

2.2. Inkjet printing and screen printing

Inkjet printing is an additive manufacturing process. Because it is low-cost and easy to operate, the fabrication of MLA has been extensively studied and used [Citation74–77]. In 1994, M. Frlanea et al. [Citation78] proposed a method for preparing MLAs using microjet technology. As shown in Figure (a) [Citation79], droplets are dispensed by a high-frequency microdroplet jetting head. The UV-sensitive resin microdroplets reach the substrate and solidified to form MLA after UV curing. The frequency of injection and the moving speed of the sample platform determine the periodicity of the microlens array, while the volume of droplets and the surface energy of the substrate affects the optical power of MLA. The consistency of surface profiling and positioning accuracy represent a critical challenge in inkjet printing. Y. Peng et al. [Citation80] proposed a fabrication technique of MLAs by combining photolithography with inkjet printing. Hole arrays were prepared by photolithography to define the shape and position of MLA. UV resin droplets were then dispensed into the hole arrays so that a good consistency of geometry parameters was achieved. Despite the simplicity of the preparation process, the technology is usually limited by the viscosity of resin, which in turn limits the refractive index of MLA.

Figure 5. (a) Schematic processes of inkjet printing. Reproduced with permission [Citation79]. Copyright 2011, Optica Publishing Group. (b) Schematic processes of screen printing. (c) 3D perspective images of a microlens. (d) Evolution of NA and radius of MLAs with the reflow time. A photo of 3D reconstruction image viewed from the left 45° direction (e) and right 45° direction (f). Reproduced with permission [Citation81]. Copyright 2011, Springer Nature.

Figure 5. (a) Schematic processes of inkjet printing. Reproduced with permission [Citation79]. Copyright 2011, Optica Publishing Group. (b) Schematic processes of screen printing. (c) 3D perspective images of a microlens. (d) Evolution of NA and radius of MLAs with the reflow time. A photo of 3D reconstruction image viewed from the left 45° direction (e) and right 45° direction (f). Reproduced with permission [Citation81]. Copyright 2011, Springer Nature.

Although multiple jetting head can be adopted to increase the fabrication throughput inkjet printing, screen printing provides a higher fabrication efficiency with the use of a blade or a squeegee to transfer the UV resin onto a substrate. MLA could be obtained after reflow and UV curing. MLAs with diameter ranging from 200 µm to several millimeters were fabricated over large areas at a low cost [Citation44]. Square microlens arrays were also fabricated by adopting a screen with square apertures [Citation57]. Furthermore, the numerical aperture (NA) of the MLA was increased from 0.036 to 0.096 by inverted reflow configuration [Citation81] (Figure (b–f)). Although the geometric parameters of MLAs prepared by inkjet printing and screen printing is controllable to a certain extent by the wettability of the substrate, the dispensed resin volume, and resin viscosity, it is difficult to fabricate freeform optical elements with high precision.

2.3. Thermal reflow technology

Thermal reflow technology, also called photoresist thermal reflow, was proposed by Zoran et al. in 1988 [Citation82]. Photoresist is heated to a molten state and then cooled to form microlenses. The method of fabricating MLAs by photoresist thermal reflow technology utilizes the surface tension of the liquid, i.e. the surface area of the liquid always tends to be minimal (Figure (a,b)) [Citation51]. This method has low equipment requirements, low cost, is simple and easy to implement, and consequently, it is commonly used in the microlens fabrication process [Citation13,Citation46,Citation83–85]. However, several critical challenges exist. First, for the photoresist column with low aspect ratio, a dip will turn up at the center of the lens during thermal reflow process, which makes it very difficult to produce MLA with large F number [Citation84], as shown in Figure (c,d). A thermal reflow method with an additional UV flood exposure and upside down reflow configuration was introduced to eliminate central dip and fabricate MLA with high F number (9.7) [Citation86]. Secondly, although various processing parameters such as the fluidity of photoresist droplets, surface tension and contact angle with the substrate, directly affect the optical power of MLA, the shape precision is relatively low when compared with ultraprecision machining [Citation87]. Extensive studies have been delivered on the influence of substrate wettability and reflow conditions. A contact angle in the range of 2°–76° was obtained [Citation88]. In addition, the filling factor of MLA is limited, because the molten photoresist is prone to fuse during the thermal reflow process when the adjacent photoresist column is too close to each other. The F number, the optical power and filling factors are all important parameters that greatly affect the viewing angle, viewing depth, and stray light in MLA-based 3D display. C. Lin et al. [Citation89] took the lead in melting the hexagonal columnar photoresist structure by thermal reflow, and fabricated a high filling factor honeycomb-arranged hexagonal MLA. In MLA-based 3D display, thermal reflow prepared MLA has been adopted to integrate with pinhole arrays. The proposed system provided an improved image contrast and a MTF50 by up to 32% [Citation90,Citation91], as shown in Figure (e,f).

Figure 6. (a) Schematic processes of thermal reflow technology. Reproduced with permission [Citation51]. Copyright 2018, Springer Nature. (b) SEM image of microlens. (c) Central dips occuring in the microlenses. (d) Profiles of microlenses. (e) MTF curves comparison between the proposed and conventional systems. (f) Light-field image comparison with (top) and without (bottom) MIM-OA. (c) and (d) Reproduced with permission [Citation86], Copyright 2015, RSC Publishing. (b), (e) and (f) Reproduced with permission [Citation91]. Copyright 2021, John Wiley and Sons.

Figure 6. (a) Schematic processes of thermal reflow technology. Reproduced with permission [Citation51]. Copyright 2018, Springer Nature. (b) SEM image of microlens. (c) Central dips occuring in the microlenses. (d) Profiles of microlenses. (e) MTF curves comparison between the proposed and conventional systems. (f) Light-field image comparison with (top) and without (bottom) MIM-OA. (c) and (d) Reproduced with permission [Citation86], Copyright 2015, RSC Publishing. (b), (e) and (f) Reproduced with permission [Citation91]. Copyright 2021, John Wiley and Sons.

2.4. LDW lithography

LDW lithography fabricate microstructures by illuminating photosensitive material using laser beams [Citation92–96]. As a result, the computer-generated image is transferred to a thin layer of photoresist by controlling the dose of exposure through the laser beam. The minimum achievable feature size is a key parameter in the LDW system: (1) R=cλNA(1) where λ is the illuminating wavelength; NA is the numerical aperture of the system; and c is a constant determined by the fabrication process and material properties of photoresist. From the equation, lasers with shorter wavelengths contribute to a smaller minimum feature size R [Citation97]. Since the typical value of c is 0.4, the R of LDW system is about half of the wavelength. As a result, the typical R for LDW technique is around 0.5 µm. To improve fabrication throughput, multiple beams were introduced as a parallelization strategy. A 160 µm hexagonal compound eye with a high filling factor (100%), large NA (0.4), ultralow surface roughness (2.5 nm), and aspherical profile was fabricated within 0.85 h [Citation98]. Another parallelization method is based on spatial light modulator (SLM). Instead of writing dot by dot in a single beam LDW system, the SLM-based LDW system fabricates structures frame by frame. Another benefit of the SLM-based LDW is that a wide range of intensity depth can be achieved by SLM. The SLM, therefore, serves as a digital grayscale mask for the patterning of 3D structures [Citation99,Citation100]. Alternatively, the 3D morphology can be fabricated by slicing the contours into multiple binary masks and accumulating corresponding exposure doses, as shown in Figure (a–c). Because of the irreplaceable advantages of high throughput and dynamically adjustable exposure dose, SLM-based LDW lithography is widely studied [Citation101,Citation102] to fabricate microstructures with high complexity. A compound-eye imaging system based on the diffractive microlens array is designed and fabricated based on SLM-based LDW lithography [Citation103]. The fabricated diffractive microlens features high relative aperture (1), thin component thickness (structural height 1.5 µm and high diffraction efficiency (80%). Most recently, intertwined grayscale diffractive lenses were fabricated as a light field modulator for extended focal depth and high light efficiency (82%). A full-color 3D display was demonstrated with expanded viewing range from 24 to 90 cm, as shown in Figure (d,e).

Figure 7. (a) Schematic of 3D laser direct writing. (b) Pulse width modulation based on 8-bit planes. (c) Fabrication procedure based on grayscale mask exposure. Reproduced with permission [Citation100]. Copyright 2017, MDPI. (d) Micrograph of the intertwined flat lens on the light field modulator. (e) Reconstructions of 3D images of ‘ABC' and cube. Reproduced with permission [Citation2]. Copyright 2022, Optica Publishing Group.

Figure 7. (a) Schematic of 3D laser direct writing. (b) Pulse width modulation based on 8-bit planes. (c) Fabrication procedure based on grayscale mask exposure. Reproduced with permission [Citation100]. Copyright 2017, MDPI. (d) Micrograph of the intertwined flat lens on the light field modulator. (e) Reconstructions of 3D images of ‘ABC' and cube. Reproduced with permission [Citation2]. Copyright 2022, Optica Publishing Group.

3. Fabrication technology for nanostructures

3.1. Electron beam lithography (EBL)

EBL is a nano-processing technology developed from scanning electron microscopy in the early 1960s. A well-focused accelerated electron beam is used to scan directly on a resist layer (Figure (a)). EBL has become an ideal tool for fabricating high-precision masks in integrated circuit manufacturing process. It is also recognized as the most well-established means to fabricate nanostructures in academia [Citation34,Citation104]. Benefiting from the extremely short wavelength, it has been confirmed that a feature size of 2 nm and a half-pitch of 5 nm can be achieved in hydrogen silsesquioxane resist by EBL [Citation105]. Moreover, arrays of vertically oriented gold and copper nanopillars with diameters down to 25 nm were successfully created by EBL and electroplating [Citation106]. To correct chromatic aberration in light field 3D displays, a single polarization-insensitive broadband achromatic metalens was proposed and fabricated [Citation34]. Each achromatic metalens has a diameter of 14 µm, with a focusing efficiency of 47% on average. By composing a 60 × 60 metalenses in a rectangular lattice, a broadband achromatic light field display was demonstrated under white light illumination, as shown in Figure (b–d). Not surprisingly, a metalens array made of gallium nitride (GaN) nano-antennas was fabricated to eliminate chromatic aberration in light field imaging as well [Citation104]. Compared with achromatic doublet lens, metalens arrays with a feature size in the scale of tens of nanometer provide compact solutions for 3D display and imaging. Extensive efforts of EBL are being made to improve the throughput, maximum working distance, material complexity, and structural fidelity [Citation107–109].

Figure 8. (a) Schematic of the EBL fabrication for metalens. (b) Schematic of the broadband achromatic metalens array for MLA-based 3D display. (c) Micrograph and SEM image of fabricated metalens. (d) Reconstructed images on the same depth plane or on different depth planes, respectively. Scale bar, 100 µm. Reproduced with permission [Citation34]. Copyright 2019, Springer Nature.

Figure 8. (a) Schematic of the EBL fabrication for metalens. (b) Schematic of the broadband achromatic metalens array for MLA-based 3D display. (c) Micrograph and SEM image of fabricated metalens. (d) Reconstructed images on the same depth plane or on different depth planes, respectively. Scale bar, 100 µm. Reproduced with permission [Citation34]. Copyright 2019, Springer Nature.

3.2. Interferential photolithography

When two coherent light beams meet, they form a non-uniform light distribution. Interferential photolithography is the fabrication method that records such interference patterns on photosensitive materials. It does not require a physical mask and is an efficient method to record the wavefront of light field over a large area. Interferential lithography has been adopted in augmented reality (AR) 3D display to fabricate holographic optical elements (HOE) with high diffraction efficiency [Citation110]. In the HOE fabrication process, a signal beam passes through the recording optical element and interferes with a reference beam (Figure (a)). The wavefront information of the optical element is then recorded in the photopolymer. As the HOE modulates only Bragg-matched lights, Bragg mismatched lights directly pass through the HOE without deflection, which is of great benefit to the see-through light field 3D display. Similar HOE recoding and reconstruction process is adopted in MLA-based HOE and diffusers-based HOE for integrated display and compressive light field display, respectively [Citation111–113]. Most recently, an AR-3D display prototype based on pixelated volume HOE with diffraction efficiency of 78.59% and high transmission (>80%) was realized [Citation114] (Figure (b,c)). As a competitive technique for see-through light field display, HOEs offer the advantages of high transparency and capability of 2D/3D conversion [Citation115].

Figure 9. (a) Schematic of the recording process of the volume HOE. ES-electronic shutter; BS-beam splitter; M-mirror; SF-spatial filter; CL-collimating lens; PP-photopolymer plate. (b) Optical see-through effect of volume HOE (left) and blank glass (right). (c) Reconstructions of 3D images of the indicator and fusion effect with real object (car). Reproduced with permission [Citation114]. Copyright 2022, Optica Publishing Group. (d) Schematic of the homemade interferential LDW system. Reproduced with permission [Citation116]. Copyright 2016, Optica Publishing Group. (e) SEM for the fabricated metagratings in the light field modulator. (f) Reconstructions of 3D images of whales and logos. Reproduced with permission [Citation41]. Copyright 2020, Elsevier. (g) Schematic of the homemade versatile interferential LDW system. (h) Micrograph of the RGB two-dimensional metagratings on the light field modulator. (i) Reconstructions of 3D images of ‘Albert Einstein' images. Reproduced with permission [Citation58]. Copyright 2021, Springer Nature.

Figure 9. (a) Schematic of the recording process of the volume HOE. ES-electronic shutter; BS-beam splitter; M-mirror; SF-spatial filter; CL-collimating lens; PP-photopolymer plate. (b) Optical see-through effect of volume HOE (left) and blank glass (right). (c) Reconstructions of 3D images of the indicator and fusion effect with real object (car). Reproduced with permission [Citation114]. Copyright 2022, Optica Publishing Group. (d) Schematic of the homemade interferential LDW system. Reproduced with permission [Citation116]. Copyright 2016, Optica Publishing Group. (e) SEM for the fabricated metagratings in the light field modulator. (f) Reconstructions of 3D images of whales and logos. Reproduced with permission [Citation41]. Copyright 2020, Elsevier. (g) Schematic of the homemade versatile interferential LDW system. (h) Micrograph of the RGB two-dimensional metagratings on the light field modulator. (i) Reconstructions of 3D images of ‘Albert Einstein' images. Reproduced with permission [Citation58]. Copyright 2021, Springer Nature.

Notably, a versatile form of interferential lithography was developed to pattern nanostructures pixel by pixel (field by field). The so-called spatial frequency variable lithography system is composed of two Fourier transform lenses and a diffractive optical element. The orientation of the interference patterns can be varied by rotating the diffractive optical element along the optical axis at an accuracy of ± 0.05°. The period of the interference pattern is adjustable by shifting the diffractive optical element back and forward along the optical axis. The periodic accuracy is below 1 nm. Nanostructures with period in the range of 30 nm–1 µm can be fabricated at the speed of 20 mm2/min, as shown in Figure (d) [Citation116]. Based on the spatial frequency variable lithography system, a super-multiview (SMV) 3D display based on pixelated metagratings was proposed with an angular separation of 0.9°. The accommodating distance of single eye was 60 mm, alleviating the vertigo caused by vergence and accommodation conflict [Citation38]. A holographic sampling 3D display system was proposed based on metagratings [Citation41], as shown in Figure (e,f). The metagratings on the light field modulator fabricated by the spatial frequency variable lithography were designed for R, G, and B wavelengths, respectively, to reconstruct the light field information at each sampled view. A full-color 3D display with a size ranged from 12.7 to 81.28 cm (5–32 inch) was achieved with a maximum viewing angle of 96°. By replacing the diffractive grating in Figure (d) with binary optical elements (BOE) in Figure (g), complex nanostructures are patterned frame by frame. The dot/linear/rectangular hybrid views were created by light field modulator covered with 2D metagratings [Citation58]. A video rate full-color foveated 3D display system with an unprecedented FOV up to 160° was demonstrated, as shown in Figure (h–i). Spatial frequency variable lithography was further adopted in AR 3D display to fabricate a see-through optical element. A 32-inch full-color, glasses-free AR 3D display with a viewing angle of 47° and a transmittance of 75% [Citation33] was achieved. The study suggests that unique nanofabrication technique provides promising solutions for 3D display.

3.3. Two-photon polymerization lithography

Traditional photolithography utilizes single-photon absorption (usually UV light) of photoresist to create arbitrary 2D or 3D patterns [Citation117]. Unlike the above-mentioned single-photon absorption-based techniques (Figure (a)), TPL takes advantage of the nonlinear dependence of material to light excitation (Figure (b)). Since the laser intensity exceeds the two-photon polymerization threshold only at the region of the focal spot, the minimum achievable volume size was proven to be λ/10 [Citation118–120]. The main parameters that influence minimum achievable volume size include the energy of the laser, exposure time, numerical aperture of the focusing lens, and polarization of the illumination [Citation121]. With a minimum feature size beyond the diffraction limit, TPL is one of the most versatile and precise additive manufacturing processes. Another distinguishing feature of TPL is that complex 3D structures can be fabricated directly from computer-aided-design (CAD) models [Citation122]. The TPL and micromolding techniques were combined to produce dissolving and hydrogel-forming microneedle arrays [Citation123]. Furthermore, freeform micro-optics were patterned by TPL for optical coherence tomography (OCT) fiber probes [Citation124]. Leveraging on TPL, high-resolution light field print was created by fabricating microlenses and structural color pixels in one patterning step [Citation125], as shown in Figure (c–e). The light field print features a spatial resolution of 29–45 µm and an angular resolution of ∼1.6°. As shown in Figure (c), the TPL-based light field print sets an example of how nanofabrication techniques advance 3D virtual imagery. Despite the outstanding performance in 3D structuring, TPL has been criticized for the limited fabrication rate attributed to the serial dot-by-dot patterning mode. Researchers have explored parallel processing methods [Citation126,Citation127]. Without doubt, TPL will continuously innovate the design and fabrication of functional devices in the future.

Figure 10. (a) Schematic of traditional UV photolithography. (b) Schematic of two-photon polymerization lithography (TPL). Reproduced with permission [Citation117]. Copyright 2019, Optica Publishing Group. (c) Micrograph and SEM images of fabricated MLAs. (d) Schematic of light field print 3D display. (e) Reconstructed 3D images at different perspectives. Reproduced with permission [Citation125]. Copyright 2021, Springer Nature.

Figure 10. (a) Schematic of traditional UV photolithography. (b) Schematic of two-photon polymerization lithography (TPL). Reproduced with permission [Citation117]. Copyright 2019, Optica Publishing Group. (c) Micrograph and SEM images of fabricated MLAs. (d) Schematic of light field print 3D display. (e) Reconstructed 3D images at different perspectives. Reproduced with permission [Citation125]. Copyright 2021, Springer Nature.

4. Conclusion and outlook

3D display entails the study of how to reconstruct the wavefront of light field. The fabrication technique directly determines the manipulation precision of light field by controlling the surface morphology or the refractive index variation. The advancements in fabrication have promoted the development of 3D display. Various commercially available 3D screens are developed by exploiting the state-of-the-art fabrication technologies [Citation140,Citation141]. HOLOVizio features a 72-inch glasses-free 3D display with a viewing range of 70° and an image resolution of 1280 × 768 [Citation142]. Looking Glass Portrait from Looking Glass Factory realizes a full-color 3D display with a field of view (FOV) of 58° [Citation143]. Commercially available 3D tablet and 3D monitor are built by Leia based on diffractive backlighting [Citation144,Citation145].

Still, current 3D displays more or less suffer from various critical challenges, such as crosstalk, visual fatigue, limited viewing angle, insufficient light efficiency, or bulky volume. Because of the precise control of light field phase information, structures with controllable surface morphology have the ability to modulate the light field with a higher degree of freedom. This makes realistic 3D display effect of large FOV feasible, with a large viewing range, low crosstalk and high resolution, as shown in Table .

In this review, the fabrication technologies of light field modulators used in 3D display are discussed. Table  comprehensively summarizes the typical characteristics of the fabrication techniques mentioned above. Ultraprecision machining methods, such as diamond turning, have been widely used to manufacture all kinds of optical devices with feature size at the scale of hundreds of microstructures and above. The capability to accurately control the surface morphology is beneficial in tackling the critical challenges in 3D display. Screen printing and ink-jet printing are effective fabrication means to manufacture MLA over a large scale at high throughput and low cost. LDW lithography, as an important means of precise fabrication of microstructures, can be organically combined with nanoimprint and soft lithography to access flexible processing and mass production. EBL is the most well-established tool used to fabricate nanostructures. Interferential lithography provides an effective solution for fabricating nanostructures over a large size. TPL is also an attractive technique used in fabricating 3D nanostructures.

Table 2. Summary of the fabrication techniques for light field modulators.

Extensive studies suggest that a breakthrough in the fabrication tool will be detrimental to the advancement of 3D display. However, in spite of the inspirational and rapid-pace developments, micro-/nano-fabrication technology is still in its infancy stage. The manufacture of complex micro- or nano-structures over a large-format remains an extremely difficult science and engineering problem. For example, Figure  shows the data volume required for patterning a light field modulator with full coverage of micro-/nano-structures. If the minimum feature size of nanograting is 100 nm, the required data resolution will be 20 nm per pixel or higher. Consequently, the data volume required to produce a 6-inch light field modulator is about 3 TB. At least 3 portable hard disks each with a data volume of 1TB will be needed to store such huge data, not to mention the potential difficulties in data processing and data transmission. In another example, 256-level diffractive optical elements with a minimum feature size of 200 nm correspond to a data volume of 30 TB. In other words, big data is the first nontrivial problem for nanofabrication when the device format goes up to several inches. Efforts are being made in terms of the minimum feature size, patterning precision, fabrication throughput, structural fidelity, and material complexity.

Figure 11. Relationship between the size of light field modulators and the data volume.

Figure 11. Relationship between the size of light field modulators and the data volume.

Aside from fabrication technologies, 3D display performance is improved from both software and hardware innovations. Light field reconstruction high resolution can be effectively improved by using high refreshable display panel combined with time multiplexing technology or eye tracking methods [Citation65,Citation146]. Spatially variant information density over the observation window improved the resolution at the central region and enlarged the FOV of the system [Citation58]. Deep-learning algorithm were adopted to optimize the display performance by pre-calibration [Citation135,Citation147,Citation148].

Opportunities coexist with challenges. We believe that advances in communication technology, flat panel display screen, and micro-/nano-fabrication technology will lead the innovation and development of light field reconstruction technology for 3D display.

Disclosure statement

No potential conflict of interest was reported by the author(s).

Additional information

Funding

National Key Research and Development Program of China (2021YFB3600500, 2021YFB2802200); National Natural Science Foundation of China (61975140, 62075145); Key Research and Development Project in Jiangsu Province (BE2021010); Leading Technology of Jiangsu Basic Research Plan (BK20192003); Priority Academic Program Development of Jiangsu Higher Education Institutions.

Notes on contributors

Fengbin Zhou

Fengbin Zhou received his B.S. Degree from Nanjing University of Information Science and Technology. He is now a Ph.D candidate in Soochow University. His research focuses on glasses-free 3D display and design of diffractive optical elements.

Wen Qiao

Wen Qiao is a professor and doctoral supervisor from the School of Opto-electronic Science and Engineering, Soochow University. She holds a doctoral degree in entrepreneurship and innovation in Jiangsu Province, a high-level talent in short supply in Suzhou, and one of the first outstanding young scholars of the College of Optics and Electronics. She won the second prize in the Optical Science and Technology Award of the Chinese Optical Society in 2019 and the 22nd China Patent Excellence Award in 2021. In 2013, she graduated from the University of California, San Diego with a Ph.D. degree. In 2014, she joined Soochow University, mainly engaging in research on micro-nano optics, new display, micro-nano manufacturing, and micro-nano sensing technology, among others. As project leader, she undertook more than 10 projects including national projects for the Natural Science Foundation of China and other key national research and development projects. She has published more than 30 papers, including submissions in internationally renowned academic journals such as Advanced Materials, Light Science and Applications, and Nanophotonics.

Linsen Chen

Linsen Chen is a professor and doctoral supervisor at the School of Opto-electronic Science and Engineering, Soochow University. In 2001, he founded SVG Optronics Co., Ltd and served as its chairman. He has been engaged in micro-nano optics and flexible manufacturing research and development, production and sales since then. Related patents provide a framework layout for the core technology methods and functional material design and manufacturing in the field of micro-nano flexible manufacturing, involving the basic methods of micro-nano manufacturing, new micro-nano direct writing lithography device and other fields. He has won numerous recognitions including the China Patent Award, Jiangsu Excellent Patent Gold Award, National Science and Technology Progress Second Prize award, First Prize for Science and Technology of Jiangsu Province, Technological Innovation First Prize award of Enterprises of Jiangsu Province, Technological Invention Second Prize in the Outstanding Scientific and Technological Achievements of the Ministry of Education.

References