Augmented reality glasses include any eyewear or, in some cases, headwear that offers users enriched details about their environment and even allows users to interact with virtual and real worlds.
Augmented reality glasses include any eyewear or, in some cases, headwear that offers users with enriched details about their environment, and even allows the users to interact with those virtual and real-worldsreal worlds.
Augmented reality (AR), unlike virtual reality, is not limited to a specific device but has been tested and developed on various devices. However, even amongstAmong these devices, augmented reality glasses have the most potential for adoption and use in consumer, enterprise, and industrial applications. AR glasses allow users to interact with real and virtual worlds., Thiswhich is done through high-level imaging and sensing technologies whichthat superimpose elements, images, videos, and 3D holograms, among other things, to enhance the wearer's experience. To create this enriched view, the AR glasses require interacting systems such as cameras or head-mounted display sensors capable of scanning and capturing natural scenes of the user's environment and enriching that environment through virtual elements often personal to the user.
For a long time, augmented reality was something of science fiction, and the idea of augmented reality glasses was something similar to what was seen in movies from the 1980s and 1990s, such as Terminator and RoboCop. Characters in these films were fed necessary information about their environment and the people in that environment through overlays of data whichthat allowsallow them to make better decisions. And thisThis functionality is what AR glasses work to achieve, as well as hands-free manipulation of the environment.
More traditionally, augmented reality can be achieved through computers, tablets, or smartphones, and offers an enhanced version of the real world through the use of digital elements, sound, or other sensory stimuli. One of the most popular examples and implementations of augmented reality is the smartphone game Pokémon GO Pokémon GO, which immerses players in their world but includes digital creatures that can be caught and later battled against each other.
Augmented reality (AR) glasses offer the same or similar, if not enhanced, functionality of other augmented technologies but in the shape of glasses. Often they displaythe information is projected on the lenses of the glasses, placing that information in the wearer's real environment whichthat the wearer can control through voice or gesture controls. The functionality of a given pair of AR glasses depends on the intended use case. For example, glasses designed for a consumer may have integrations with social media and smart assistants to help keep the consumer connected, while a pair of glasses designed for a warehouse or logistics operation may include an RF scanner and warehouse mapping. Examples of the kind of functionality companies are working on include the following:
AR glasses are seen as being developed in two distinct paths: AR for social applications and collaborative technologies for professionals. The former is more distinctly understood as smartglasses, often with limited functionality, while the latter is on a steeper development curve and seeing adoption across various industries to help work in various places. For example, a professional in design, field service, or other collaborative and primarily visual fields could have their work changed and freed up to work almost anywhere. Companies like Microsoft and RealWear are capitalizing on this trend in professional use cases, developing AR glass platforms that have a variety of applications and professional use cases.
Meanwhile, Google, which has worked on AR glasses since 2013, and has focused its development on features such as language translation that provide consumers tangible value. The company's strides in other AR systems, such as its phones, search, and Lens imaging system, suggestssuggest many of these functionalities could be carried over to the company's glasses, with its focus on practical utility. This new focus, which is understood as a move away from floating dinosaurs or magic experiences, is seen as a push in the industry from impractical but fun experiences to turning the wearable glasses into a desired and function-focused product, still capable of delivering those magical experiences if the wearer wishes. Similarly, Beijing-based Nreal has developed AR glasses that offloadsoffload the computation to the smartphone through a cable, allowing the glasses to look similar to sunglasses,. andThey are working to develop a practical and entertainment capableentertainment-capable product with little to no lag, thanks to the offboard computation.
Google and Qualcomm also have efforts towards developing AR glasses with simplified operations that rely on smartphones for their computation, offering AR glasses advanced operations without the need for bulky headgear, or, as Nreal uses, cables. This can also increase the battery life of AR glasses without needing large or interchangeable battery packs. And, despiteDespite many of these proposed solutions suffering from a lack of seamless flow from the phone to the glasses; but, there is a promise based on Google and Android's investment in ambient technology that works to increase the flow between applications and services between services such as speakers, screens, and watches. AR glasses can fit into this picture as well.
AR glasses and smartglasses are often confused as the same thing. However, often smartglassesSmartglasses are considered similar to other wearable devices capable of offering useful information to the wearer, such as a text messagemessages, heart rate, name of an incoming phone call, presentation ofand turn-by-turn directions. With smart glasses, or offer similarthese functions asoccur through a head-mounted heads-up display (HUD)., Informationand for smartthe glassesinformation areis oftenusually projected onto the lenses of the glasses. In many cases, AR glasses are seen as the end goal of the development of smartglasses, while the form factor of smartglasses (smaller, compact, and sleek) are the goal of AR glasses, as that form factor is expected to lead to greater consumer adoption.
Whereas, augmented reality (AR) glasses go further than being simple head-mounted HUDs. Their primary function is an augmented reality display, offering digital information presented as if it exists in reality. This means smartglasses cannot formally be considered AR glasses until the glasses are capable of sensing the world around the wearer to present information as if it is present in reality, not just projected onto a transparent screen. This is ahigher lotlevel of computation, as noted above, and that often requires a bulkier glasses system,. thatThey are often referred to as AR headsets"glasses" as often as they are glasses"AR headsets," creating which furthers themore confusion between the terms. EspeciallyThis confusion will grow as the industry works to developdevelops AR headsets small enough to be considered glasses, and to develop smartglasses capablethat enoughare sufficient to be considered AR glasses.
Part of the confusion between AR glasses and smartglasses, as explored above, is down to the companies developing the products and conflating the terms. As early as the introduction of the Google Glass, the terms were used interchangeably, even though the Google Glass was best understood as smartglasses. Further, theThe confusion can also stem from consumers' lack of interaction with augmented reality, which means when reading about AR glasses or smartglasses, an individual may not be ableunable to distinguish between competing descriptions conflating the terms.
The confusion has led to a proliferation of other terms used to describe AR glasses, which has arguably compounded the confusion. Media reporting has conflated the terms AR glasses and smartglasses, and furtherhas led to some companies repurposing terms to distinguish their AR glasses from consumer smart glasses; popular among these terms are 'holographic"holographic,'" 'mixed"mixed reality,'" 'merged"merged reality,'" and even 'extended"extended reality.'"
Augmented reality glasses are considered a part of the increasing portfolio of smart connected products (SCPs). The spread of these devices allowallows AR glasses to monitor product operations and conditions in real-timereal time, control, and customize product operations remotely, and optimize product performance using real-time data. In some cases, intelligence and connectivity allow SCPs to be autonomous, while AR glasses magnify the value created by those capabilities. Some of the key capabilities AR glasses could provide users include the following:
The necessary computation and processor speed for AR glasses is demanding, with a need for processors to be small, lightweight, and power-efficient so they can be placed in an eyewear frame that is comfortable for a user to wear. Further, they need to be able to respond to real-time stimuli in a meaningful way, so that any necessary information a user may want or need in regardsregard to their physical environment is displayed almost immediately, rather than after a few seconds delay, at which point the wearer may have moved on to other stimuli. Further, thestimuli.The glasses also require eye-tracking capabilities and reliable voice and gesture recognition, which on their own are difficult and can be costly in terms of battery consumption and heat production.
This process has been described as fitting a supercomputer in the lens of glasses. And some solutions have involved hand-off of the computation to a nearby device, such as a smartphone through a Bluetooth connection or a cloud compute scenario (although the network and processing speed in the latter example could create too costly time delays). Either scenario requires powerful connectivity speeds and processing speed in order to respond to the stimuli the glasses are looking at. Further, thisThis kind of hand-off increases any delay, as it increases the steps involved, and could be an interim solution until the necessary onboard processors can reach the necessary speeds to have the glasses compute for themselves.
Another challenge to developing AR glasses is the ability to track the user's viewpoint, especially to make content appear to be fixed in space. This would allow a user to look at specific items and receive information about them, but when the user looks away, have the information disappear in a way to make it, in part, look fixed around that object. There have been a few concepts to solve this problem, such as using mechanical and ultrasonic trackers to measure where the user's head is and render virtual imagery from that same position. Another has been tracking the user's viewpoint without knowing visual features such as vision-based SLAM tracking with GPS and inertial sensors that can be combined for a more robust result. This is another challenge that is being handed orfoff to cloud computing, where features captured by a user's device are uploaded to the cloud and fused to provide a ubiquitous tracking service.
A lotMany of the above challenges are solved through cloud-hosted services, which allow the AR glasses to remain smaller in design with longer battery life, but require uninterrupted bandwidth and coverage for the AR devices to work. And there are environments where AR glasses are worn or could be worn, where the availability of reliable WiFi or related networks isare limited, which require more robust solutions for offline functionality to make the AR glasses more usable. However, even in the case where a network is available and robust, there is a need for both device and network to have high-security standards, especially in sensitive environments where proprietary information could be misplaced over an unsecured network or device. These security challenges are shared by other wearable and smart devices in the market.
When used in the right setting, AR glasses have important advantages over computers, tablets, and other existing technology: contextualized information, increased workflow standardization, hands-free assistance, and documentation. They offer a hands-free approach to perform work by providing data and virtual instructions; the latter offeringoffer increased standardization to workflows in industries with seasonseasonal labor changes or to rapidly changing tasks.
Through audio and video capabilities, AR glasses allow workers to collaborate with each other and seek assistance from each other on complex issues. Workers are also able to summon interactive on-demand training videos, which can be overlaid on the environment and offer the user real-time step-by-step instruction. That type of on-demand instruction can be especially useful in industries facing aging workforces and knowledge loss.
Part of the value proposition for AR glasses for different industries is based on the devices themselves, and ensuring an organization selects the best device based on their use case. This involves various considerations, including:
People learn differently, and AR can help people based on their preferred learning style:, such as visual learning, auditory learning, and kinesthetic learning. But no one style applies to every person, which makes it important to offer several approaches to learning and solving tasks to help learners reach their full potential. Students often encounter trouble in school because they are expected to learn in the same way, despite the differences, and AR glasses can offer new individuated methods of learning. AR glasses can also offer teachers various benefits. Overall, AR in education can offer:
Similar to education, AR glasses offer a chance to develop hands-on training without access to real-life machinery, which can be a difficult part of employee training. Further, AR glasses offer a company a chance tocan provide employees with necessary instructions regarding safety procedures and the tasks that they are unfamiliar with.
The U.S.US military has already conducted tests with AR glasses to provide more immersive training for soldiers, while also offering the military athe chanceability, during training, to keep track of a military personnel's heartbeat rate during the training,heartrate and a more in-depth understanding of the soldier's behavior during the training. And the AR glasses have been used for training in the medical and pharmacy industry to use the glasses to perform diagnoses of the body, training sessions for making incisions and dissections, and to provide feedback to students and professionals.
AR glasses have been adopted into healthcare settings with several early applications, including hands-free photo and video documentation, Electronicelectronic Healthhealth Recordrecord retrieval and input, rapid diagnostic test analysis, education, and live broadcasting. As well, as telemedicine increases, the use of AR glasses can be used to bring up records on demand, interact with and share data with wearables for patients may wear, and to collect key health data, either in personin-person or remotely, which could further increase the efficiency of doctor'sdoctors with patients, and allow doctors to see more patients in a day.
Further,Hospitals hospitalscan have a chance toalso benefit from AR glasses, as they would be able to streamline many of the operations of the hospital functions, such as the transfer of patient documents, which can further improve a doctor's performance and improve the overall quality of patient care. As well, AR glasses can make deciphering a doctor's handwriting obsolete, they will reduce the necessity of having experts travel to patients, they will allow doctors to annotate see-what-I-see videos to share key findings, and AR glasses can help complement other technologies used in hospitals, even providing key alerts for different patients, and allowallowing for more seamless communication among hospital staff and doctors.
AR glasses also offer a chance to increase the accessibility of healthcare to regions where reaching a hospital or having a physician or doctor travel to a patient can limit their overall ability to do their job. AR glasses can bring a physician, doctor, or specialist to a patient in seconds and allow them to provide specialized healthcare regardless of where a patient lives. Other examples of use cases of AR glasses in healthcare include the following:
Another advantage of AR glasses is they can allow users to access relevant information without interrupting their work. In healthcare settings, this can help a physician, nurse, or doctor to provide more relevant care more quickly through accessible necessary data or documentation. However, AR glasses can also offer a chance for an attending physician to take better and more standardized documentation, including recording a patient's physical complaints, and taketaking pictures of a patient's body without contact, and providing notes. These could be then better disseminated through staffing and for follow-up shifts to ensure information is transferred to essential parties as needed.
Further, AR glasses could also provide automated performance documentation. Similar to other industries where quality checks are required, and where AR glasses could provide automated checks to ensure employees follow the appropriate practices and standards. This could also take a burden off of nursing staff as they would be able to automate their documentation of services provided through the AR glasses.
AR glasses have also been suggested, similar to VR, to treat types of phobias. Treatment of some phobias requires exposure to what the patient is anxious about, and this can be hard to achieve. AR glasses offer a safe and often more accessible way of achieving exposure. ThisThe patient can take a patientparticipate in a relatively safe environment and exposebe themexposed to their phobia in a safe way that could, lessen the patient's phobia over time, lessen the patient's phobia. Although, as the patient is braver in simulated situations, they would at some timepoint have to expose themselves to the real-world phobia, but with the new memories from the simulated exposure can help combat the phobia and influence of older memories.
AR glasses have been suggested for use in warehousing and logistics chains. Especially in warehousing, these glasses could help workers in picking, displaying step-by-step instructions in the worker's field of view, and offering "pick-by-vision" solutions that could display the necessary information in the worker's field of view. This could include highlighting the specific item in a warehouse that needs to be picked, offering directions to the specific item, offering hands-free scanning of the item as it is picked, and further provide confirmation of packaging once it has reached its destination. This could be done through gestures or voice commands, but some are suggesting that the glasses could have automated systems to aid pickers in these cases.
By eliminating the time that is otherwise used for a worker to stop and read a device screen, enter key data, or handle a scanner, AR glasses-enabled picking could create a more efficient picking process. And itThey could further increase worker safety, as different AR glasses could communicate to each other, log potential hazards in the warehouse, or allow workers to highlight concerns, and flag the wearer when the activity they are engaging in is unsafe.
Manufacturers are also investing more in human-and-machine interaction, with leading manufacturers continuing to increase their automation to handle simple, repetitive tasks, and track data. However, in most manufacturing, manual processes remain important and relevant, with many of those manual tasks becoming increasingly complex and requiring workers to be increasingly agile to work variation. This requires workers to deal with more complex problem solving and the ability to connect these workers with augmentation, data, and related solutions can further empower and increase the efficiency and productivity of these workers. AR glasses offer this connection, can track manual processes, increase a new understanding of a company's operations, and provide workers with guidance for work they are not used to doing, while also keeping those workers safer.
Further, AR glasses can also record manufacturing work to help reduce the need for inspections and to verify proper steps and procedures were taken in the manufacturing process. This kind of system can also provide snapshots with integrated 3D vision cameras and machine learning for added assurance. Further, with augmentedAugmented reality displays in glasses, itcan allowsallow workers to see the necessary information as they need, which can increase the ergonomics of the workspace for workers, as they do not necessarily need to stoop or reach to find screens with the knowledge they require.
Often there are more machines than there are qualified maintenance and repair technicians. This could include repairs for difficult machines such as nuclear reactors (or related systems), and medical technologies (such as x-ray or MRI machines). AR glasses offer technicians athe chanceability to not only view inside the machinery and offer techniciansbut a chancealso to perform repairs without needing to dismantle the object. Data generated from technicians wearing AR glasses could further help companies recognize potential faults and breakdowns, increasing the efficiency of service calls, or even reducing those calls overall.
As well, rather than companies requiring highly skilled technicians to come out to maintain or repair a piece of equipment, increasing the downtime of a machine, AR glasses would allow the company to hire a more local and, potentially, lower-skilled technician to the site to resolve the problem instead. And theseThese technicians would wear AR glasses to receive the necessary documentation and guidance to fix the machine, even using a remote high-skilled technician to guide them through the repair without the high-skilledhighly skilled technician needing to travel.
Augmented reality has already changed the boundaries of traditional marketing and created new experiences in marketing. AR glasses promiseoffer toopportunities expand this further, as it can be used to further revolutionize marketing, product engagement, and customer experience. AR glasses can allow customers to visualize products and can create an immersive experience to allow customers to engage with their products before they have purchased them, potentially reducing return rates, boosting sales, and strengthening customer relationships.
AR glasses can also use persistent anchors, such as buildings, to offer content and ad locations to wearers with AR glasses, allowing users to navigate through the streets while also receiving personalized AR ads as they walk around the city. For example, if a wearer is going on their lunch, they could receive advertisements to popular lunch spots or and coffee shops, or advertisementsa touser can receive ads for grocery stores at the end of a wearer'stheir work day. Similarly, with user'sutilizing data analytics, when they walk past a specific wall or bus stop with ad space, the AR glasses can be used to host thousands of ads on the same billboards, and non-competing companies would no longer need to bid for the same ad space but can virtually exist on the same wall or billboard. Further, theseThese glasses could also translate ads in other languages to allow users to see personalized ads in various locations.
AR glasses could also allow for new types of advertising, such as ads appearing out of thin air, offering 3D and holographic experiences, with engaging and game-like experiences, and create better impressions than boards, TV ads, or city-lights. This could further increase the emotional level and establish a stronger connection between the viewer and the brand. And, byBy moving advertising to the AR space, brands could place the ads where they can have the most effect, and only target the wearers who are, based on user data, more likely to positively engage with these kinds of advertisements.
Virtual and augmented reality glasses are being used increasingly in the armed forces to more easily work remotely, and to support remote training and maintenance. These glasses have also been used as a way of storing and exploring documents and mission-critical software that can further assist servicemembers in areas with no internet connection.
This has led some to consider the military, especially the U.S.US Armed Forces, as one of the first industries to fully realize the many different use cases for AR glasses. In the defense industry, AR glasses have been used in manufacturing, engineering, remote assistance, soldier collaboration, and as part of training and upskilling for soldiers. They have also been used to enhance a soldier's situational awareness and reaction time. As part of this, in 2021, the U.S.US Army awarded Microsoft a contract to build custom augmented reality headsets to enable soldiers to fight, rehearse, and train in a single system.
Operated remotely, drones have proved invaluable tools for military operations, and with the right AR technology and AR glasses, drones offer the potential for object recognition and sophisticated tracking systems of people, objects, and military vehicles. MIlitary drone data feeds could identify suspicious enemy movements with additional images, text, or marks, to give soldiers greater situational intelligence with further contextual information similar to a Google street map.
Training pilots is important, and military planes are costly, while pilots benefit from being trained in AR and VR before ever flying an actual plane. FurtherAlso, with an AR-assisted 3D overlay, pilots can visualize navigation systems, work with air-traffic control, experience weather conditions, and even understand the terrain, giving the pilot greater contextual information and upgrading the traditional HUD system. Further, AR glasses or headsets can offeralso assist pilots in take-off and landing procedures. AR glasses can also be used for aircraft ground maintenance crews and increasing their efficiency and productivity.
Navies have unique requirements, often including a lack of access to networks while still wishing to have the benefits of AR glasses. For example, such as for bridge officers. A bridge officer keepskeep watch on the ship and keep's the ship on course., and Traditionallytraditionally, these officers request information via radio to verify what they physically see. This system is inefficient when a bridge officer could use AR glasses to receive the same information without needing to call anyone, reducing their workload, and keeping them focused on the safety of the ship. Further, radarRadar operators, sonar operators, and deck gunnery teams could also use the AR technology to increase thetheir efficiency of these teams.
Because warfare is evolving, armies, especially frontline soldiers, have to keep up and look for opportunities to get ahead of their enemies. With the expanding possibilities of AR glasses, they could provide soldiers with more data and combat information to make the soldier's view look more like a first-person shooter game. This could include various types of data, and multiple solutions have been suggested, including the following:
Another application of AR glasses has been in the development of the CV90 battle station, a tank that uses AR glasses with 360-degree images in real time to allow thosetroops inside to see what is occurring outside, includingas 360-degreeif imagesthey were moving in real-time and to make any battle vehiclea transparent for an operatorbox. Further, the The AR headset can overlay furtheradditional information for better situational awareness.
Military working dogs often scout areas for hazards, such as explosive devices, and assist in rescue operations. But giving the necessary commands for dogs to perform these tasks can place the soldier in harm's way. However, augmented reality glasses offer a chance to change this. One such project, through the Small Business Innovation Research Program and managed by the Army Research Office, has provided working dogs with augmented reality goggles that give the dog's handler a chance to give the dog specific directional commands. Further, thisThis allows the handler to be within sight of the dog, and allows the handler to maintain audio communication to help direct the canine and offer greater protection for the dog in inclement conditions and aerial deployments. According to Dr. Stephen Lee, an ARO senior scientist working on the project:
Augmented reality glasses include any eyewear or, in some cases, headwear that offers users with enriched details about their environment, and even allows the users to interact with those virtual and real-worlds.
Augmented reality (AR), unlike virtual reality, is not limited to a specific device but has been tested and developed on various devices. However, even amongst these devices, augmented reality glasses have the most potential for adoption and use in consumer, enterprise, and industrial applications. AR glasses allow users to interact with real and virtual worlds. This is done through high-level imaging and sensing technologies which superimpose elements, images, videos, and 3D holograms, among other things to enhance the wearer's experience. To create this enriched view, the AR glasses require interacting systems such as cameras or head-mounted display sensors capable of scanning and capturing natural scenes of the user's environment and enriching that environment through virtual elements often personal to the user.
For a long time augmented reality was something of science fiction, and the idea of augmented reality glasses was something similar to what was seen in movies from the 1980s and 1990s such as Terminator and RoboCop. Characters in these films were fed necessary information about their environment and the people in that environment through overlays of data which allows them to make better decisions. And this functionality is what AR glasses work to achieve, as well as hands-free manipulation of the environment.
More traditionally, augmented reality can be achieved through computers, tablets, or smartphones, and offers an enhanced version of the real world through the use of digital elements, sound, or other sensory stimuli. One of the most popular examples and implementations of augmented reality is the smartphone game Pokémon GO which immerses players in their world but includes digital creatures that can be caught and later battled against each other.
Augmented reality (AR) glasses offer the same or similar, if not enhanced, functionality of other augmented technologies but in the shape of glasses. Often they display information projected on the lenses of the glasses, placing that information in the wearer's real environment which the wearer can control through voice or gesture controls. The functionality of a given pair of AR glasses depends on the intended use case. For example, glasses designed for a consumer may have integrations with social media and smart assistants to help keep the consumer connected, while a pair of glasses designed for a warehouse or logistics operation may include an RF scanner and warehouse mapping. Examples of the kind of functionality companies are working on include:
AR glasses are seen as being developed in two distinct paths: AR for social applications and collaborative technologies for professionals. The former is more distinctly understood as smartglasses, often with limited functionality, while the latter is on a steeper development curve and seeing adoption across various industries to help work in various places. For example, a professional in design, field service, or other collaborative and primarily visual fields could have their work changed and freed up to work almost anywhere. Companies like Microsoft and RealWear are capitalizing on this trend in professional use cases, developing AR glass platforms that have a variety of applications and use cases.
Meanwhile, Google, which has worked on AR glasses since 2013, has focused its development on features such as language translation that provide consumers tangible value. The company's strides in other AR systems, such as its phones, search, and Lens imaging system suggests many of these functionalities could be carried over to the company's glasses, with its focus on practical utility. This new focus, which is understood as a move away from floating dinosaurs or magic experiences, is seen as a push in the industry from impractical but fun experiences to turning the wearable glasses into a desired and function-focused product, still capable of delivering those magical experiences if the wearer wishes. Similarly, Beijing-based Nreal has developed AR glasses that offloads the computation to the smartphone through a cable, allowing the glasses to look similar to sunglasses, and working to develop a practical and entertainment capable product with little to no lag thanks to the offboard computation.
Google and Qualcomm also have efforts towards developing AR glasses with simplified operations that rely on smartphones for their computation, offering AR glasses advanced operations without the need for bulky headgear, or, as Nreal uses, cables. This can also increase the battery life of AR glasses without needing large or interchangeable battery packs. And, despite many of these proposed solutions suffering from a lack of seamless flow from the phone to the glasses; but there is a promise based on Google and Android's investment in ambient technology that works to increase the flow between applications and services between services such as speakers, screens, and watches. AR glasses can fit into this picture as well.
AR glasses and smartglasses are often confused as the same thing. However, often smartglasses are considered similar to wearable devices capable of offering useful information to the wearer, such as a text message, heart rate, name of an incoming phone call, presentation of turn-by-turn directions, or offer similar functions as a head-mounted heads-up display (HUD). Information for smart glasses are often projected onto the lenses of the glasses. In many cases, AR glasses are seen as the end goal of the development of smartglasses, while the form factor of smartglasses (smaller, compact, and sleek) are the goal of AR glasses, as that form factor is expected to lead to greater consumer adoption.
Whereas, augmented reality (AR) glasses go further than being simple head-mounted HUDs. Their primary function is an augmented reality display, offering digital information presented as if it exists in reality. This means smartglasses cannot formally be considered AR glasses until the glasses are capable of sensing the world around the wearer to present information as if it is present in reality, not just projected onto a transparent screen. This is a lot of computation, as noted above, and that often requires a bulkier glasses system, that are often referred to as AR headsets as often as they are glasses, which furthers the confusion between the terms. Especially as the industry works to develop AR headsets small enough to be considered glasses, and to develop smartglasses capable enough to be considered AR glasses.
Part of the confusion between AR glasses and smartglasses, as explored above, is down to the companies developing the products and conflating the terms. As early as the introduction of the Google Glass, the terms were used interchangeably, even though the Google Glass was best understood as smartglasses. Further, the confusion can stem from consumers' lack of interaction with augmented reality, which means when reading about AR glasses or smartglasses an individual may not be able to distinguish between competing descriptions conflating the terms.
The confusion has led to a proliferation of other terms used to describe AR glasses, which has arguably compounded the confusion. Media reporting has conflated the terms AR glasses and smartglasses, and further led to some companies repurposing terms to distinguish their AR glasses from consumer smart glasses; popular among these terms are 'holographic,' 'mixed reality,' 'merged reality,' and even 'extended reality.'
Augmented reality glasses are considered a part of the increasing portfolio of smart connected products (SCPs). The spread of these devices allow AR glasses to monitor product operations and conditions in real-time, control, and customize product operations remotely, and optimize product performance using real-time data. In some cases, intelligence and connectivity allow SCPs to be autonomous, while AR glasses magnify the value created by those capabilities. Some of the key capabilities AR glasses could provide users include:
While the interest and potential applications for AR glasses continue to expand, the challenges in developing AR glasses have seen the physical implementation of the glasses not keep pace with the flowering applications. One of the most popular failures in the development of AR glasses was the Google Glass, which was initially released in 2013 and was off the market a few years later. Part of the failure of this product was attributed to the look of the glasses, which many felt were ugly and clunky. since then, there have been other, similar products, which have been developed but focused on enterprise use, where their appearance would not impact sales as much, while much of the consumer market has seen the introduction of smart glasses such as Facebook and RayBan's collaboration and Snap Inc.'s Spectacles. These smart glasses have offered slim bodies with "natural" eyeglass looks, rather than the necessary technology required to merge the real and virtual, such as the battery power, chips, boards, and necessary onboard computation which creates the larger AR glasses.
The necessary computation and processor speed for AR glasses is demanding, with a need for processors to be small, lightweight, and power-efficient so they can be placed in an eyewear frame that is comfortable for a user to wear. Further, they need to be able to respond to real-time stimuli in a meaningful way, so that any necessary information a user may want or need in regards to their physical environment is displayed almost immediately, rather than after a few seconds delay, at which point the wearer may have moved on to other stimuli. Further, the glasses require eye-tracking capabilities and reliable voice and gesture recognition, which on their own are difficult and can be costly in terms of battery consumption and heat production.
This process has been described as fitting a supercomputer in the lens of glasses. And some solutions have involved hand-off of the computation to a nearby device, such as a smartphone through a Bluetooth connection or a cloud compute scenario (although the network and processing speed in the latter example could create too costly time delays). Either scenario requires powerful connectivity speeds and processing speed in order to respond to the stimuli the glasses are looking at. Further, this kind of hand-off increases any delay, as it increases the steps involved, and could be an interim solution until the necessary onboard processors can reach the necessary speeds to have the glasses compute for themselves.
Another challenge to developing AR glasses is the ability to track the user's viewpoint, especially to make content appear to be fixed in space. This would allow a user to look at specific items and receive information about them, but when the user looks away, have the information disappear in a way to make it, in part, look fixed around that object. There have been a few concepts to solve this problem, such as using mechanical and ultrasonic trackers to measure where the user's head is and render virtual imagery from that same position. Another has been tracking the user's viewpoint without knowing visual features such as vision-based SLAM tracking with GPS and inertial sensors that can be combined for a more robust result. This is another challenge that is being handed orf to cloud computing, where features captured by a user's device are uploaded to the cloud and fused to provide a ubiquitous tracking service.
A lot of the above challenges are solved through cloud-hosted services, which allow the AR glasses to remain smaller in design with longer battery life, but require uninterrupted bandwidth and coverage for the AR devices to work. And there are environments where AR glasses are worn or could be worn, where the availability of reliable WiFi or related networks is limited which require more robust solutions for offline functionality to make the AR glasses more usable. However, even in the case where a network is available and robust, there is a need for both device and network to have high-security standards, especially in sensitive environments where proprietary information could be misplaced over an unsecured network or device. These security challenges are shared by other wearable and smart devices in the market.
When used in the right setting, AR glasses have important advantages over computers, tablets, and other existing technology: contextualized information, increased workflow standardization, hands-free assistance, and documentation. They offer a hands-free approach to perform work by providing data and virtual instructions; the latter offering increased standardization to workflows in industries with season labor changes or to rapidly changing tasks.
Through audio and video capabilities, AR glasses allow workers to collaborate with each other and seek assistance from each other on complex issues. Workers are also able to summon interactive on-demand training videos which can be overlaid on the environment and offer the user real-time step-by-step instruction. That type of on-demand instruction can be especially useful in industries facing aging workforces and knowledge loss.
AR glasses can also capture video of an employee performing job duties, which can be archived and used as evidence during inspections to improve standardization and to prove necessary or regulated steps were followed. This can increase the speed at which detailed quality examinations can be performed, and can be used to standardize quality and safety workflows while making the information hands-free.
Part of the value proposition for AR glasses for different industries is based on the devices themselves, and ensuring an organization selects the best device based on their use case. This involves various considerations, including:
People learn differently, and AR can help people based on their preferred learning style: such as visual learning, auditory learning, and kinesthetic learning. But no one style applies to every person, which makes it important to offer several approaches to learning and solving tasks to help learners reach their full potential. Students often encounter trouble in school because they are expected to learn in the same way, despite the differences, and AR glasses can offer new individuated methods of learning. AR glasses can also offer teachers various benefits. Overall, AR in education can offer:
Similar to education, AR glasses offer a chance to develop hands-on training without access to real-life machinery, which can be a difficult part of employee training. Further, AR glasses offer a company a chance to provide employees with necessary instructions regarding safety procedures and the tasks that they are unfamiliar with.
The U.S. military has already conducted tests with AR glasses to provide more immersive training for soldiers, while also offering the military a chance to keep track of a military personnel's heartbeat rate during the training, and a more in-depth understanding of the soldier's behavior during the training. And the AR glasses have been used for training in the medical and pharmacy industry to use the glasses to perform diagnoses of the body, training sessions for making incisions and dissections, and to provide feedback to students and professionals.
AR glasses have been adopted into healthcare settings with several early applications, including hands-free photo and video documentation, Electronic Health Record retrieval and input, rapid diagnostic test analysis, education, and live broadcasting. As well, as telemedicine increases, the use of AR glasses can be used to bring up records on demand, interact with and share data with wearables patients may wear, and to collect key health data, either in person or remotely, which could further increase the efficiency of doctor's with patients, and allow doctors to see more patients in a day.
Further, hospitals have a chance to benefit from AR glasses, as they would be able to streamline many of the operations of the hospital, such as the transfer of patient documents, which can further improve a doctor's performance and improve the overall quality of patient care. As well, AR glasses can make deciphering a doctor's handwriting obsolete, they will reduce the necessity of having experts travel to patients, they will allow doctors to annotate see-what-I-see videos to share key findings, and AR glasses can help complement other technologies used in hospitals, even providing key alerts for different patients, and allow for more seamless communication among hospital staff and doctors.
AR glasses also offer a chance to increase the accessibility of healthcare to regions where reaching a hospital or having a physician or doctor travel to a patient can limit their overall ability to do their job. AR glasses can bring a physician, doctor, or specialist to a patient in seconds and allow them to provide specialized healthcare regardless of where a patient lives. Other examples of use cases of AR glasses in healthcare include:
Another advantage of AR glasses is they can allow users to access relevant information without interrupting their work. In healthcare settings, this can help a physician, nurse, or doctor to provide more relevant care more quickly through accessible necessary data or documentation. However, AR glasses can also offer a chance for an attending physician to take better and more standardized documentation, including recording a patient's physical complaints, and take pictures of a patient's body without contact, and providing notes. These could be then better disseminated through staffing and for follow-up shifts to ensure information is transferred to essential parties as needed.
Further, AR glasses could provide automated performance documentation. Similar to other industries where quality checks are required, and where AR glasses could provide automated checks to ensure employees follow the appropriate practices and standards. This could also take a burden off of nursing staff as they would be able to automate their documentation of services provided through the AR glasses.
AR glasses have also been suggested, similar to VR, to treat types of phobias. Treatment of some phobias requires exposure to what the patient is anxious about and this can be hard to achieve. AR glasses offer a safe and often more accessible way of achieving exposure. This can take a patient in a relatively safe environment and expose them to their phobia in a safe way that could, over time, lessen the patient's phobia. Although, as the patient is braver in simulated situations, they would at some time have to expose themselves to the real-world phobia, but with the new memories from the simulated exposure can help combat the phobia and influence of older memories.
AR glasses have been suggested for use in warehousing and logistics chains. Especially in warehousing, these glasses could help workers in picking, displaying step-by-step instructions in the worker's field of view, and offering "pick-by-vision" solutions that could display the necessary information in the worker's field of view. This could include highlighting the specific item in a warehouse that needs to be picked, offering directions to the specific item, offering hands-free scanning of the item as it is picked, and further provide confirmation of packaging once it has reached its destination. This could be done through gestures or voice commands, but some are suggesting that the glasses could have automated systems to aid pickers in these cases.
By eliminating the time that is otherwise used for a worker to stop and read a device screen, enter key data, or handle a scanner, AR glasses-enabled picking could create a more efficient picking process. And it could further increase worker safety, as different AR glasses could communicate to each other, log potential hazards in the warehouse, or allow workers to highlight concerns, and flag the wearer when the activity they are engaging in is unsafe.
Manufacturers are also investing more in human-and-machine interaction, with leading manufacturers continuing to increase their automation to handle simple, repetitive tasks, and track data. However, in most manufacturing, manual processes remain important and relevant, with many of those manual tasks becoming increasingly complex and requiring workers to be increasingly agile to work variation. This requires workers to deal with more complex problem solving and the ability to connect these workers with augmentation, data, and related solutions can further empower and increase the efficiency and productivity of these workers. AR glasses offer this connection, can track manual processes, increase a new understanding of a company's operations, and provide workers with guidance for work they are not used to doing, while also keeping those workers safer.
Further, AR glasses can record manufacturing work to help reduce the need for inspections and to verify proper steps and procedures were taken in the manufacturing process. This kind of system can also provide snapshots with integrated 3D vision cameras and machine learning for added assurance. Further, with augmented reality displays in glasses, it allows workers to see the necessary information as they need, which can increase the ergonomics of the workspace for workers, as they do not necessarily need to stoop or reach to find screens with the knowledge they require.
Often there are more machines than there are qualified maintenance and repair technicians. This could include repairs for difficult machines such as nuclear reactors (or related systems), and medical technologies (such as x-ray or MRI machines). AR glasses offer technicians a chance to not only view inside the machinery and offer technicians a chance to perform repairs without needing to dismantle the object. Data generated from technicians wearing AR glasses could further help companies recognize potential faults and breakdowns, increasing the efficiency of service calls, or even reducing those calls overall.
As well, rather than companies requiring highly skilled technicians to come out to maintain or repair a piece of equipment, increasing the downtime of a machine, AR glasses would allow the company to hire a more local and, potentially, lower-skilled technician to the site to resolve the problem instead. And these technicians would wear AR glasses to receive the necessary documentation and guidance to fix the machine, even using a remote high-skilled technician to guide them through the repair without the high-skilled technician needing to travel.
Augmented reality has already changed the boundaries of traditional marketing and created new experiences in marketing. AR glasses promise to expand this further, as it can be used to further revolutionize marketing, product engagement, and customer experience. AR glasses can allow customers to visualize products and can create an immersive experience to allow customers to engage with their products before they have purchased them, potentially reducing return rates, boosting sales, and strengthening customer relationships.
AR glasses can also use persistent anchors such as buildings to offer content and ad locations to wearers with AR glasses, allowing users to navigate through the streets while also receiving personalized AR ads as they walk around the city. For example, if a wearer is going on their lunch, they could receive advertisements to popular lunch spots or coffee shops, or advertisements to grocery stores at the end of a wearer's work day. Similarly, with user's data analytics, when they walk past a specific wall or bus stop with ad space, the AR glasses can be used to host thousands of ads on the same billboards, and non-competing companies would no longer need to bid for the same ad space but can virtually exist on the same wall or billboard. Further, these glasses could translate ads in other languages to allow users to see personalized ads in various locations.
AR glasses could also allow for new types of advertising, such as ads appearing out of thin air, offering 3D and holographic experiences, with engaging and game-like experiences, and create better impressions than boards, TV ads, or city-lights. This could further increase the emotional level and establish a stronger connection between the viewer and the brand. And, by moving advertising to the AR space, brands could place the ads where they can have the most effect, and only target the wearers who are, based on user data, more likely to positively engage with these kinds of advertisements.
Virtual and augmented reality glasses are being used increasingly in the armed forces to more easily work remotely, and to support remote training and maintenance. These glasses have also been used as a way of storing and exploring documents and mission-critical software that can further assist servicemembers in areas with no internet connection.
This has led some to consider the military, especially the U.S. Armed Forces, as one of the first industries to fully realize the many different use cases for AR glasses. In the defense industry, AR glasses have been used in manufacturing, engineering, remote assistance, soldier collaboration, and as part of training and upskilling for soldiers. They have also been used to enhance a soldier's situational awareness and reaction time. As part of this, in 2021, the U.S. Army awarded Microsoft a contract to build custom augmented reality headsets to enable soldiers to fight, rehearse, and train in a single system.
Operated remotely, drones have proved invaluable tools for military operations, and with the right AR technology and AR glasses, drones offer the potential for object recognition and sophisticated tracking systems of people, objects, and military vehicles. MIlitary drone data feeds could identify suspicious enemy movements with additional images, text, or marks, to give soldiers greater situational intelligence with further contextual information similar to a Google street map.
Training pilots is important and military planes are costly, while pilots benefit from being trained in AR and VR before ever flying an actual plane. Further, with an AR-assisted 3D overlay, pilots can visualize navigation systems, work with air-traffic control, experience weather conditions, and even understand the terrain, giving the pilot greater contextual information and upgrading the traditional HUD system. Further, AR glasses or headsets can offer pilots in take-off and landing procedures. AR glasses can also be used for aircraft ground maintenance crews and increasing their efficiency and productivity.
Navies have unique requirements, often including a lack of access to networks while still wishing to have the benefits of AR glasses, such as for bridge officers. A bridge officer keeps watch on the ship and keep's the ship on course. Traditionally these officers request information via radio to verify what they physically see. This system is inefficient when a bridge officer could use AR glasses to receive the same information without needing to call anyone, reducing their workload, and keeping them focused on the safety of the ship. Further, radar operators, sonar operators, and deck gunnery teams could also use the AR technology to increase the efficiency of these teams.
Because warfare is evolving, armies, especially frontline soldiers have to keep up and look for opportunities to get ahead of their enemies. With the expanding possibilities of AR glasses, they could provide soldiers with more data and combat information to make the soldier's view look more like a first-person shooter game. This could include various types of data, and multiple solutions have been suggested, including:
Another application of AR glasses has been in the development of the CV90 battle station, a tank that uses AR glasses to allow those inside to see what is occurring outside, including 360-degree images in real-time and to make any battle vehicle transparent for an operator. Further, the AR headset can overlay further information for better situational awareness.
Military working dogs often scout areas for hazards, such as explosive devices, and assist in rescue operations. But giving the necessary commands for dogs to perform these tasks can place the soldier in harm's way. However, augmented reality glasses offer a chance to change this. One such project, through the Small Business Innovation Research Program and managed by the Army Research Office, has provided working dogs with augmented reality goggles that give the dog's handler a chance to give the dog specific directional commands. Further, this allows the handler to be within sight of the dog, and allows the handler to maintain audio communication to help direct the canine and offer greater protection for the dog in inclement conditions and aerial deployments. According to Dr. Stephen Lee, an ARO senior scientist working on the project:
The military working dog community is very excited about the potential of this technology. This technology really cuts new ground and opens up possibilities that we haven't considered yet.
Augmented reality glasses include any eyewear or, in some cases, headwear that offers users enriched details about their environment and even allows users to interact with virtual and real worlds.
Augmented reality glasses include any eyewear or, in some cases, headwear that offers users enriched details about their environment and even allows users to interact with virtual and real worlds.