Home

Traditional desktop computing relies on the established WIMP (Windows, Icons, Menus, Pointing device) paradigm, where icons serve as the most universal interface elements across both physical and digital contexts (Bermejo et al., 2021). However, the direct adaptation of these 2D desktop metaphors to virtual 3D environments creates a significant user experience gap between virtual and physical reality.

The fundamental challenge comes from the mapping process required between conventional 2D input devices—such as mouse cursors or touchscreens—and three-dimensional virtual spaces (Caputo, 2019). Traditional approaches often attempt to relate actions performed in two-dimensional input spaces to three-dimensional transformations, creating an inherent disconnect. When 3D content must be displayed through 2D rendered images on conventional displays, this further compromises content perception and user understanding.

Modern advances in user tracking technology have opened new possibilities for more intuitive interaction methods. By monitoring the spatial position of users' heads, limbs, and hands, VR systems can enable direct interactions that closely mirror real-world object manipulation (Caputo, 2019). This technological capability allows for interactions that feel more natural and immediate compared to traditional input methods.

The three-dimensional nature of VR interfaces necessitates consideration of multiple factors including hardware dependencies, technological constraints, and environmental variables—elements that extend far beyond the requirements of conventional two-dimensional interfaces (Jian and Fucheng, 2022). Users naturally possess cognitive and manipulative abilities for three-dimensional interaction, developed through their experience with physical space, which VR systems should leverage rather than constrain. VR interaction design typically organizes user activities into three primary categories: selection and manipulation tasks, system control functions, and navigation operations (Jian and Fucheng, 2022). This framework reflects how users naturally engage with three-dimensional environments and provides a foundation for designing coherent interaction systems.

The significance of three-dimensional interaction extends beyond mere functionality—it represents the primary method through which users experience the dimensional characteristics that define virtual reality (Jian and Fucheng, 2022). Unlike 2D interface interactions, VR design must account for fundamental human factors including psychological and physiological capabilities, limitations, and users' existing knowledge and experience.

VR environments present design challenges that differ substantially from flat screen interfaces. Key considerations include field of view limitations, user orientation tracking, the absence of defined reference planes, and depth-related perception issues (Kaur et al., 2019). These factors create cognitive workload considerations that are largely absent from traditional interface design.

The transition from 2D to 3D interaction introduces an increase in degrees of freedom—expanding from two to six degrees—due to the simulation of three-dimensional space where users can interact freely (WeiB et al., 2018). Additionally, the constant adaptation of viewing perspective based on head orientation provides enhanced immersion but also increased complexity.

Current three-dimensional graphical user interfaces lack comprehensive design heuristics, creating challenges for designers attempting to optimize usability (Kaur et al., 2020). Factors such as field of view constraints, physical demands, and mental workload that specifically impact three-dimensional interface interaction require careful consideration during the design process.

VR systems combine interactive 3D graphics, specialized visual display devices, and three-dimensional input devices—particularly position tracking systems—to create the illusion of presence within virtual environments (Kharoub et al., 2019). This integration requires input processing that generates 3D scenes rendered from the user's perspective and delivered through head-mounted displays.

Unlike standard 2D interfaces found on desktop computers and mobile devices, VR environments lack fixed boundaries for user interface placement, making traditional UI design knowledge less directly applicable (Pandey and Sorathia, 2024). Studies exploring different UI design strategies in 3D spaces reveal that approaches focusing solely on either 2D or 3D methodologies each present distinct advantages and limitations.

The design philosophy for VR should not simply involve transferring 2D practices into 3D space, but rather establishing entirely new paradigms (Shoikova and Peshev, 2017). This requires designers to expand their expertise into diverse fields including psychology, architecture, sound design, lighting design, and physics to create fully controlled experiences that guide users effectively within virtual environments.

Despite rapid advancement in novel gesture-based interface components, traditional windows, icons, menus, and pointer-based user interfaces continue to maintain popularity in VR implementations (Yeo et al., 2024). This persistence suggests that while new interaction paradigms are emerging, familiar interface elements still serve important functions in bridging user expectations between traditional and virtual environments. The evolution toward truly effective VR interaction design requires moving beyond conditional transfers of screen-interaction guidelines and developing approaches specifically tailored to the unique characteristics and opportunities presented by immersive virtual environments (WeiB et al., 2018).