Extended reality interface

[0001] This application claims the benefit of provisional application Ser. No. 63/352,692 filed Jun. 16, 2022.

[0002] The present disclosure is directed to the improved extended reality interface and particularly to an extended reality interface hardware controller.

[0003] Extended reality (XR) is an emerging umbrella term for all the immersive technologies, such as augmented reality (AR), virtual reality (VR), and mixed reality (MR) plus those that are still to be created. Immersive technologies extend the reality experienced by people by either blending the virtual and “real” worlds or by creating a fully immersive experience.

[0004] In augmented reality, virtual information and objects are overlaid on the real world. This experience enhances the real world with digital details such as images, text, and animation. You can access the experience through AR glasses or via screens, tablets, and smartphones. Users are not isolated from the real world and can still interact and see what's going on in front of them.

[0005] In contrast to augmented reality, in a virtual reality experience, users are fully immersed in a simulated digital environment. Individuals must put on a VR headset or head-mounted display to get a 360-degree view of an artificial world that fools their brain into believing they are, e.g., walking on the moon, swimming under the ocean or stepped into whatever new world the VR developers created. The gaming and entertainment industry were early adopters of this technology; however, companies in several industries such as healthcare, construction, engineering, the military, and more are finding VR to be very useful.

[0006] In mixed reality, digital and real-world objects co-exist and can interact with one another in real-time. This is the latest immersive technology and is sometimes referred to as hybrid reality. It requires an MR headset and a lot more processing power than VR or AR. Microsoft's HoloLens is a great example that, e.g., allows you to place digital objects into the room you are standing in and give you the ability to spin it around or interact with the digital object in any way possible.

[0007] It is essential that the wearable devices that allow a full XR experience are fashionable and comfortable as well as always connected, intelligent, and immersive. There are significant technical and hardware issues to solve that include but are not limited to the display, power and thermal, motion tracking, connectivity and common illumination—where virtual objects in a real world are indistinguishable from real objects especially as lighting shifts.

[0008] What is needed is an ergonometric handheld controller that enables a full XR experience.

[0009] In accordance with the present disclosure, there is provided an extended reality interface controller comprising a controller including a body 32 formed by a frame 34; the frame 34 having a first main body section 54 and second main body section 56 substantially bisecting the frame 34 and a cap section 58 spanning over the first main body section 54 and second main body section 56; multidirectional switches 38 operatively coupled to the frame; internal electronics 36 housed within the frame 34; and a processor 14 operatively coupled to the multidirectional switches 38.

[0010] A further embodiment of any of the foregoing embodiments may additionally and/or alternatively include the frame forms a thumb region opposite a base region.

[0011] A further embodiment of any of the foregoing embodiments may additionally and/or alternatively include the multidirectional switches are located in the thumb region and along the frame between the thumb region and the base region.

[0012] A further embodiment of any of the foregoing embodiments may additionally and/or alternatively include multidirectional switches comprise a thumb switch locate in the thumb region, an index finger switch, a middle finger switch, a ring finger switch and a pinkie finger switch each being configured aligned for each finger of a hand.

[0013] A further embodiment of any of the foregoing embodiments may additionally and/or alternatively include the extended reality interface controller further comprising strap coupled to the frame adjacent the thumb region and the base via a strap mounting slot 70.

[0014] A further embodiment of any of the foregoing embodiments may additionally and/or alternatively include the frame comprises at least one specialized form factor, including size, configuration, and physical arrangement that optimizes a fit into a hand and use of the controller by the user.

[0015] A further embodiment of any of the foregoing embodiments may additionally and/or alternatively include the extended reality interface controller further comprising an A button switch 50 and a B button switch 52 operatively coupled to the frame adjacent the thumb region.

[0016] In accordance with the present disclosure, there is provided an extended reality system comprising a controller operatively coupled to a processor; the controller including a body 32 formed by a frame 34; the frame 34 having a first main body section 54 and second main body section 56 substantially bisecting the frame 34 and a cap section 58 spanning over the first main body section 54 and second main body section 56; multidirectional switches 38 operatively coupled to the frame.

[0017] A further embodiment of any of the foregoing embodiments may additionally and/or alternatively include the extended reality system further comprising a tangible, non-transitory memory configured to communicate with the processor, the tangible, non-transitory memory having instructions stored therein that, in response to execution by the processor, cause the processor to perform operations comprising receiving, by the processor, data from the multidirectional switches; receiving, by the processor, the data with graphics and video imaging information.

[0018] A further embodiment of any of the foregoing embodiments may additionally and/or alternatively include the cap section is proximate a thumb region, the thumb region 60 including a sloped profile 62 configured for access to the switches.

[0019] A further embodiment of any of the foregoing embodiments may additionally and/or alternatively include the sloped profile 62 includes an angle α (Alpha) relative to a longitudinal axis L of the frame; the angle α places the orientation of the cap section 58 to allow for a thumb switch 48 as well as an A button switch 50 and a B button switch 52 to be manipulated by a thumb.

[0020] A further embodiment of any of the foregoing embodiments may additionally and/or alternatively include the extended reality system further comprising a base region 64 located on the frame 34 opposite the thumb region 60 along an axis L; the base region 64 being configured to support a strap 68 that extends from a first strap mounting slot 70 proximate the base region 64 to a second strap mounting slot 72 proximate the thumb region 60; wherein the base region 64 includes a strap release 74 that is configured to release and/or secure the strap 68 for adjustment.

[0021] A further embodiment of any of the foregoing embodiments may additionally and/or alternatively include the base region 64 includes a flair 78 configured for hand retention and an angle for the strap mounting slot 70; wherein the flair 78 being configured for different sized hands to grip the frame 34 along different locations so that a palm of the hand attains a comfortable grip.

[0022] A further embodiment of any of the foregoing embodiments may additionally and/or alternatively include the frame 38 is substantially tapered along a longitudinal axis L from a relatively larger sized thumb region 60 along the frame 34 to the base region 64; wherein the taper 80 is configured to match the shape of a palm of the hand and relative lengths of fingers to allow for an ergonomic feel placing the hand in a more neutral closed position.

[0023] A further embodiment of any of the foregoing embodiments may additionally and/or alternatively include the extended reality system further comprising a key plate 82 mounted interchangeable with the frame between the thumb region and the base region; the key plate having a variety of sizes to allow for the adjustment of the multidirectional switch locations and orientation on the frame 34; wherein the orientation of the multidirectional switches 38 is configured to be offset and/or staggered relative to an axis L to allow for the various finger lengths, so that a more neutral finger placement is achieved.

[0024] A further embodiment of any of the foregoing embodiments may additionally and/or alternatively include the extended reality system further comprising a thumb groove 84 located proximate the thumb region 60 and near the forefinger switch 40; the thumb groove 84 comprising a flat surface configured for a palm of a hand proximate a thumb to set into and grip to prevent relative rotation of the frame 34 in the palm of the hand.

[0025] A further embodiment of any of the foregoing embodiments may additionally and/or alternatively include the extended reality system further comprising a convex surface 86 that is configured to conform to a palm of a hand for ergonomic fit; and an oblong cross-section, formed in the frame configured for a natural shape of a hand near a palm and fingers at knuckles, such that a neutral grip can be attained.

[0026] A further embodiment of any of the foregoing embodiments may additionally and/or alternatively include the extended reality system further comprising an input/output connector 88 formed in the frame 34 configured for connectivity of the controller with power sources for charging or data transfer via a cable.

[0027] A further embodiment of any of the foregoing embodiments may additionally and/or alternatively include the extended reality system further comprising a motion tracking system 94 operatively coupled to the controller; wherein the motion tracking system 94 is at least one of internally mounted within the body 32 or externally mounted to the body 32.

[0028] A further embodiment of any of the foregoing embodiments may additionally and/or alternatively include the extended reality system of claim 8, wherein the multidirectional switches 38 are configured as analog joysticks; the multidirectional switches 38 can be configured to be aligned for each digit of a hand; the multidirectional switches 38 comprising an index finger switch 40, a middle finger switch 42, a ring finger switch 44, a pinkie switch 46 and a thumb switch 48.

[0029] Other details of the extended reality interface are set forth in the following detailed description and the accompanying drawings wherein like reference numerals depict like elements.

[0036] Referring now to FIG. 1, there is illustrated a schematic of an exemplary extended reality system 10. The extended reality system 10 can include an extended reality interface or simply a controller 12 operatively coupled to a processor or processors 14 as well as data gathering components 16. The controller 12 can be a handheld controller 12. The controller 12 can be operatively coupled to the processor 14 and data gathering components 16 via a wireless communication link 18.

[0037] The controller 12 is configured to allow a user (not shown) to manipulate the controller 12 with the hand to stimulate sensors 20 that create controller data 22 sent via controller output signals 24, such as commands, for the processor 14 and/or data gathering components 16 to initiate a variety of actions responsive to the output signals 24. The controller 12 can also receive processor data 26 communication input signals 28 from the processor 14 and/or the data gathering components 16. The processor data 26 can stimulate the controller 12 to provide the user feedback information 30, such as a vibration.

[0038] Also referring to FIGS. 2-6, the controller 12 is shown in multiple views. The controller 12 is a device that is configured for efficient interface within the extended reality system 10. The controller 12 can be configured as a single handheld controller or as a pair of handheld controllers 12. The controller 12 includes a frame 34 that houses internal electronics 36 and supports each of five keys or multidirectional switches 38. The internal electronics can include a chipset for processor 14, battery pack, motion tracking devices, vibration generator, wireless card and the like.

[0039] The multidirectional switches 38 can be configured as analog joysticks. The multidirectional switches 38 can be configured to be aligned for each digit of the hand (not shown). A fore finger or index finger switch 40, middle finger switch 42, ring finger switch 44, pinkie switch 46 and thumb switch 48 are shown in the figures.

[0040] The switches 38 can be configured as different styles of analog switches 38. For example, the thumb switch 48 can be a three-dimension analog joystick with a large size, the pinkie switch 46 can be a mini joystick design, such as a five-way momentary tactile switch, the forefinger switch 40, middle finger switch 42, and ring finger switch 44 can be multidirectional multi-stick style switches, such as a PSP-2-axis switch. It is contemplated that the switches can also be 4-D and even 5-D switches, with the capacity to include a press-down function and even time dependent, responsive to the timing of the push or even the resistance of the push from a finger. It is contemplated that the switches 38 can be tailored to meet the needs of the user's hands. In addition to the multidirectional switches 38, the controller 12 can include an A button switch 50 and a B button switch 52 that function to send out signals for system navigation and operational control of the processor 14. The A button switch 50 and B button switch 52 can also have the same configuration as the pinkie finger switch 46. The A button switch 50 and B button switch 52 can be a binary motion activation or multi-directional activation.

[0041] The frame 34 can be fabricated in multiple sections for ease of assembly. In an exemplary embodiment, the frame 34 can include a first main body section 54 and second main body section 56 substantially bisecting the frame 34 and a cap section 58 spanning over the first main body section 54 and second main body section 56. The frame 34 includes specialized form factors, including size, configuration, and physical arrangement that optimizes the fit into the hand and use of the controller 12 by the user. The form function of the frame 34 allows for a general symmetry along the vertical axis L (FIG. 5) allowing for an easy stowage and carry capability.

[0042] A thumb region 60 proximate the cap section 58 includes the thumb switch 48 and the A button switch 50 and B button switch 52. The thumb region 60 can include a sloped profile 62 that allows for proper access to the switches 48, 50, 52. The sloped profile 62 includes an angle α (Alpha) relative to the longitudinal axis L as seen in FIG. 5. The angle α places the orientation of the cap section 58 to allow for the thumb switch 48 as well as the A button switch 50 and B button switch 52 to be more easily manipulated by the thumb. The thumb switch 48 can be oriented substantially along the angle α for improved thumb access.

[0043] A base region 64 is located on the frame 34 opposite the thumb region 60 along the axis L. The base region 64 is configured to support a strap 68 that extends from a first strap mounting slot 70 proximate the base region 64 to a second strap mounting slot 72 proximate the thumb region 60 as shown in FIG. 6. The base region 64 includes a strap release 74 that is configured to release and/or secure the strap 68 for adjustment. The strap mounting slots 70, 72 are also configured oriented along an angle β (Beta) to attach the strap 68 with an orientation that is curved to allow for a gap 76 between the strap 68 and frame 34 that conforms with the back of the hand (not shown). The strap 68 can be adjusted to snugly fit the back of the hand to secure the controller 12 in the hand(s). In an exemplary embodiment, the strap 68 can be a flexible fabric covered elastic flexible material that allows for flexure of the strap 68 and comfort.

[0044] The base region 64 includes a flair 78 that allows for hand retention as well as the angle for the strap mounting slot 70. The flair 78 allows for different sized hands to grip the frame 34 along different locations so that the palm of the hand attains a comfortable grip. The base region 64 also includes a smaller diameter D than the thumb region 60. The frame 38 is substantially tapered along the longitudinal axis L from a relatively larger sized thumb region 60 along the frame 34 to the base region 64. The taper 80 is configured to match the shape of the palm of the hand and the fingers relative lengths to allow for a comfortable ergonomic feel placing the hand in a more neutral closed position.

[0045] The orientation of the multidirectional switches 38 relative to the frame 38 can be adjusted to fit various hand sizes. A key plate 82 can be interchangeable and made in a variety of sizes to allow for the adjustment of the multidirectional switch 38 locations and orientation on the frame 34. The orientation of the multidirectional switches 38 can also be offset and/or staggered relative to the axis L to allow for the various finger lengths, so that the more neutral finger placement is achieved.

[0046] The frame 34 also includes a thumb groove 84 located proximate thumb region 60 and near the forefinger switch 40. The thumb groove 84 is a relatively flat surface that allows for the palm of the hand proximate the thumb to set into and grip to prevent the unnecessary relative rotation of the frame 34 in the palm of the hand. The thumb groove 84 allows the frame 34 to be anchored in the hand.

[0047] The frame 34 includes a convex surface 86 that is configured to conform to the palm of the hand for improved ergonomic fit. The frame 34 also has an oblong cross-section, not a perfect circular shape allowing for the natural shape of the hand near the palm and the fingers at the knuckles, such that a comfortable neutral grip is attained.

[0048] An input/output connector 88 is provided in the frame 34 allowing for connectivity of the controller 12 with power sources for charging or data transfer via cable.

[0049] Data 22, 26 may be transmitted to one or more processors 14 (e.g., computer systems having a central processing unit and memory) for recording, processing and storing the data received from the switches 38, data gathering components 16 and the like. Processor 14 may include a general-purpose processor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination thereof. Processor 14 may be in communication (such as electrical communication) with switches 34, data gathering components 16 and the like and may be configured to receive input, such as key strokes and/or control information from controller 12. Processor 14 may receive data 22 transmitted by the controller 12 via a communication channel 90. Upon receiving the data 22, the processor 14 may process data 22 from controller 12 to perform operations.

[0050] In an exemplary embodiment, the processor 14 can be housed in the body 32. Since the body 32 contains substantially greater volume than a typical cell phone, ample space is provided for the processor 14 and auxiliary components that support the processor, such as cooling fans and the like. There is a technical advantage to housing the processor 14 in the body 32 eliminating the need for hard wire connections or a separate processor housing. The controller 12 with processor 14 within housing 32 can be coupled to a digital display 92, such as glasses.

[0051] A modular attachable motion tracking system 94 can be operatively coupled to the controller 12, as shown in FIG. 3. The modular attachable motion tracking system 94 can be configured as a loop or ring that includes electronics. The tracking system 94 can be internally mounted within the body 32 or as shown, externally mounted.

[0052] A technical advantage of the extended reality system can include analog control capacity allowing for an interface for people to work efficiently and quickly using a hand control rather than a virtual control. Current solutions are largely technology that requires controls that are volumetric, being a projection in the digital display. Those controls are slower more awkward and less precise than the currently disclose system.

[0053] Another technical advantage includes tactile feedback, similar to a physical keyboard, the switch or key motion or depression allows for a positive indicator of input which aids in the efficiency of operator use without view of the device.

[0054] Another technical advantage of the extended reality system can include the capability for precise text and character input, for use in typing to create written works, such as word documents.

[0055] There has been provided an extended reality interface. While the extended reality interface has been described in the context of specific embodiments thereof, other unforeseen alternatives, modifications, and variations may become apparent to those skilled in the art having read the foregoing description. Accordingly, it is intended to embrace those alternatives, modifications, and variations which fall within the broad scope of the appended claims.