How 5G, AI, VR AR and Blockchain Converge to Dramatically Change Our World
How AR, AI, Sensors & Blockchain are Converging Into Web 3.0
How each of us sees the world is about to change dramatically…
For all of human history, the experience of looking at the world was roughly the same for everyone. But boundaries between the digital and physical are beginning to fade.
The world around us is gaining layer upon layer of digitized, virtually overlaid information — making it rich, meaningful, and interactive. As a result, our respective experiences of the same environment are becoming vastly different, personalized to our goals, dreams, and desires.
Welcome to Web 3.0, aka The Spatial Web. In version 1.0, static documents and read-only interactions limited the internet to one-way exchanges. Web 2.0 provided quite an upgrade, introducing multimedia content, interactive web pages, and participatory social media. Yet, all this was still mediated by 2D screens.
And today, we are witnessing the rise of Web 3.0, riding the convergence of high-bandwidth 5G connectivity, rapidly evolving AR eyewear, an emerging trillion-sensor economy, and ultra-powerful AIs.
As a result, we will soon be able to superimpose digital information atop any physical surrounding—freeing our eyes from the tyranny of the screen, immersing us in smart environments, and making our world endlessly dynamic.
In this third blog of our five-part series on augmented reality, we will explore the convergence between AR, AI, sensors, and blockchain, diving into the implications through a key use case in manufacturing.
A Tale of Convergence
Let’s deconstruct everything beneath the sleek AR display.
It all begins with Graphics Processing Units (GPUs) — electric circuits that perform rapid calculations to render images. (GPUs can be found in mobile phones, game consoles, and computers.)
However, because AR requires such extensive computing power, single GPUs will not suffice. Instead, blockchain can now enable distributed GPU processing power, and blockchains specifically dedicated to AR holographic processing are on the rise.
Next up, cameras and sensors will aggregate real-time data from any environment to seamlessly integrate physical and virtual worlds. Meanwhile, body-tracking sensors are critical for aligning a user’s self-rendering in AR with a virtually enhanced environment. Depth sensors then provide data for 3D spatial maps, while cameras absorb more surface-level, detailed visual input. In some cases, sensors might even collect biometric data, such as heart rate and brain activity, to incorporate health-related feedback in our everyday AR interfaces and personal recommendation engines.
The next step in the pipeline involves none other than AI. Processing enormous volumes of data instantaneously, embedded AI algorithms will power customized AR experiences in everything from artistic virtual overlays to personalized dietary annotations.
In retail, AIs will use your purchasing history, current closet inventory, and possibly even mood indicators to display digitally rendered items most suitable for your wardrobe, tailored to your measurements.
In healthcare, smart AR glasses will provide physicians with immediately accessible and maximally relevant information (parsed from the entirety of a patient’s medical records and current research) to aid in accurate diagnoses and treatments, freeing doctors to engage in the more human-centric tasks of establishing trust, educating patients and demonstrating empathy.
Source: PHD Ventures.
Convergence in Manufacturing
One of the nearest-term use cases of AR is manufacturing, as large producers begin dedicating capital to enterprise AR headsets. And over the next ten years, AR will converge with AI, sensors, and blockchain to multiply manufacturer productivity and employee experience.
Source: Microsoft – Dynamics 365 Blog.
(1) Convergence with AI
In initial application, digital guides superimposed on production tables will vastly improve employee accuracy and speed, while minimizing error rates.
Already, the International Air Transport Association (IATA) — whose airlines supply 82 percent of air travel — recently implemented industrial tech company Atheer’s AR headsets in cargo management. And with barely any delay, IATA reported a whopping 30 percent improvement in cargo handling speed and no less than a 90 percent reduction in errors.
With similar success rates, Boeing brought Skylight’s smart AR glasses to the runway, now used in the manufacturing of hundreds of airplanes. Sure enough—the aerospace giant has now seen a 25 percent drop in production time and near-zero error rates.
Beyond cargo management and air travel, however, smart AR headsets will also enable on-the-job training without reducing the productivity of other workers or sacrificing hardware. Jaguar Land Rover, for instance, implemented Bosch’s Re’flekt One AR solution to gear technicians with “x-ray” vision: allowing them to visualize the insides of Range Rover Sport vehicles without removing any dashboards.
And as enterprise capabilities continue to soar, AIs will soon become the go-to experts, offering support to manufacturers in need of assembly assistance. Instant guidance and real-time feedback will dramatically reduce production downtime, boost overall output, and even help customers struggling with DIY assembly at home.
Perhaps one of the most profitable business opportunities, AR guidance through centralized AI systems will also serve to mitigate supply chain inefficiencies at extraordinary scale. Coordinating moving parts, eliminating the need for manned scanners at each checkpoint, and directing traffic within warehouses, joint AI-AR systems will vastly improve workflow while overseeing quality assurance.
After its initial implementation of AR “vision picking” in 2015, leading courier company DHL recently announced it would continue to use Google’s newest smart lens in warehouses across the world. Motivated by the initial group’s reported 15 percent jump in productivity, DHL’s decision is part of the logistics giant’s $300 million investment in new technologies.
And as direct-to-consumer e-commerce fundamentally transforms the retail sector, supply chain optimization will only grow increasingly vital. AR could very well prove the definitive step for gaining a competitive edge in delivery speeds.
As explained by Vital Enterprises CEO Ash Eldritch, “All these technologies that are coming together around artificial intelligence are going to augment the capabilities of the worker and that’s very powerful. I call it Augmented Intelligence. The idea is that you can take someone of a certain skill level and by augmenting them with artificial intelligence via augmented reality and the Internet of Things, you can elevate the skill level of that worker.”
Already, large producers like Goodyear, thyssenkrupp, and Johnson Controls are using the Microsoft HoloLens 2—priced at $3,500 per headset—for manufacturing and design purposes.
Perhaps the most heartening outcome of the AI-AR convergence is that, rather than replacing humans in manufacturing, AR is an ideal interface for human collaborationwith AI. And as AI merges with human capital, prepare to see exponential improvements in productivity, professional training, and product quality.
(2) Convergence with Sensors
On the hardware front, these AI-AR systems will require a mass proliferation of sensors to detect the external environment and apply computer vision in AI decision-making.
To measure depth, for instance, some scanning depth sensors project a structured pattern of infrared light dots onto a scene, detecting and analyzing reflected light to generate 3D maps of the environment. Stereoscopic imaging, using two lenses, has also been commonly used for depth measurements. But leading technology like Microsoft’s HoloLens 2 and Intel’s RealSense 400-series camera implement a new method called “phased time-of-flight” (ToF).
In ToF sensing, the HoloLens 2 uses numerous lasers, each with 100 milliwatts (mW) of power, in quick bursts. The distance between nearby objects and the headset wearer is then measured by the amount of light in the return beam that has shifted from the original signal. Finally, the phase difference reveals the location of each object within the field of view, which enables accurate hand-tracking and surface reconstruction.
With a far lower computing power requirement, the phased ToF sensor is also more durable than stereoscopic sensing, which relies on the precise alignment of two prisms. The phased ToF sensor’s silicon base also makes it easily mass-produced, rendering the HoloLens 2 a far better candidate for widespread consumer adoption.
To apply inertial measurement—typically used in airplanes and spacecraft—the HoloLens 2 additionally uses a built-in accelerometer, gyroscope, and magnetometer. Further equipped with four “environment understanding cameras” that track head movements, the headset also uses a 2.4MP HD photographic video camera and ambient light sensor that work in concert to enable advanced computer vision.
For natural viewing experiences, sensor-supplied gaze tracking increasingly creates depth in digital displays. Nvidia’s work on Foveated AR Display, for instance, brings the primary foveal area into focus, while peripheral regions fall into a softer background— mimicking natural visual perception and concentrating computing power on the area that needs it most.
Gaze tracking sensors are also slated to grant users control over their (now immersive) screens without any hand gestures. Conducting simple visual cues, even staring at an object for more than three seconds, will activate commands instantaneously.
And our manufacturing example above is not the only one. Stacked convergence of blockchain, sensors, AI and AR will disrupt almost every major industry.
Take healthcare, for example, wherein biometric sensors will soon customize users’ AR experiences. Already, MIT Media Lab’s Deep Reality group has created an underwater VR relaxation experience that responds to real-time brain activity detected by a modified version of the Muse EEG. The experience even adapts to users’ biometric data, from heart rate to electro dermal activity (inputted from an Empatica E4 wristband).
Now rapidly dematerializing, sensors will converge with AR to improve physical-digital surface integration, intuitive hand and eye controls, and an increasingly personalized augmented world. Keep an eye on companies like MicroVision, now making tremendous leaps in sensor technology.
While I’ll be doing a deep dive into sensor applications across each industry in our next blog, it’s critical to first discuss how we might power sensor- and AI-driven augmented worlds.
(3) Convergence with Blockchain
Because AR requires much more compute power than typical 2D experiences, centralized GPUs and cloud computing systems are hard at work to provide the necessary infrastructure. Nonetheless, the workload is taxing and blockchain may prove the best solution.
A major player in this pursuit, Otoy aims to create the largest distributed GPU network in the world, called the Render Network RNDR. Built specifically on the Ethereum blockchain for holographic media, and undergoing Beta testing, this network is set to revolutionize AR deployment accessibility.
Alphabet Chairman Eric Schmidt (an investor in Otoy’s network), has even said, “I predicted that 90% of computing would eventually reside in the web based cloud… Otoy has created a remarkable technology which moves that last 10%—high-end graphics processing—entirely to the cloud. This is a disruptive and important achievement. In my view, it marks the tipping point where the web replaces the PC as the dominant computing platform of the future.”
Leveraging the crowd, RNDR allows anyone with a GPU to contribute their power to the network for a commission of up to $300 a month in RNDR tokens. These can then be redeemed in cash or used to create users’ own AR content.
In a double win, Otoy’s blockchain network and similar iterations not only allow designers to profit when not using their GPUs, but also democratize the experience for newer artists in the field.
And beyond these networks’ power suppliers, distributing GPU processing power will allow more manufacturing companies to access AR design tools and customize learning experiences. By further dispersing content creation across a broad network of individuals, blockchain also has the valuable potential to boost AR hardware investment across a number of industry beneficiaries.
On the consumer side, startups like Scanetchain are also entering the blockchain-AR space for a different reason. Allowing users to scan items with their smartphone, Scanetchain’s app provides access to a trove of information, from manufacturer and price, to origin and shipping details.
Based on NEM (a peer-to-peer cryptocurrency that implements a blockchain consensus algorithm), the app aims to make information far more accessible and, in the process, create a social network of purchasing behavior. Users earn tokens by watching ads, and all transactions are hashed into blocks and securely recorded.
The writing is on the wall—our future of brick-and-mortar retail will largely lean on blockchain to create the necessary digital links.
Integrating AI into AR creates an “auto-magical” manufacturing pipeline that will fundamentally transform the industry, cutting down on marginal costs, reducing inefficiencies and waste, and maximizing employee productivity.
Bolstering the AI-AR convergence, sensor technology is already blurring the boundaries between our augmented and physical worlds, soon to be near-undetectable. While intuitive hand and eye motions dictate commands in a hands-free interface, biometric data is poised to customize each AR experience to be far more in touch with our mental and physical health.
And underpinning it all, distributed computing power with blockchain networks like RNDR will democratize AR, boosting global consumer adoption at plummeting price points.
As AR soars in importance—whether in retail, manufacturing, entertainment, or beyond—the stacked convergence discussed above merits significant investment over the next decade. Already, 52 Fortune 500 companies have begun testing and deploying AR/VR technology. And while global revenue from AR/VR stood at $5.2 billion in 2016, market intelligence firm IDC predicts the market will exceed $162 billion in value by 2020.
The augmented world is only just getting started.
(1) A360 Executive Mastermind: Want even more context about how converging exponential technologies will transform your business and industry? Consider joining Abundance 360, a highly selective community of 360 exponentially minded CEOs, who are on a 25-year journey with me — or as I call it, a “countdown to the Singularity.” If you’d like to learn more and consider joining our 2020 membership, apply here.
Share this with your friends, especially if they are interested in any of the areas outlined above.
(2) Abundance-Digital Online Community: I’ve also created a Digital/Online community of bold, abundance-minded entrepreneurs called Abundance-Digital. Abundance-Digital is Singularity University’s ‘onramp’ for exponential entrepreneurs — those who want to get involved and play at a higher level. Click here to learn more.
(Both A360 and Abundance-Digital are Singularity University programs.)
American Movie Company provided me with high quality service when I needed a teleprompter for my event. I would... definitely recommend anyone to work with and I certainly look forward to working with them in the future.read more
American Movie Co. was very helpful in getting our production set up with an interrotron. I appreciated Bill's... responsiveness and ability to work with our unpredictable production schedule. Highly recommend!read more
Bill Milling’s work has always impressed me with his level of care for the subject matter, as well as his hands on... attention to detail and ability to bring humor into any scenario without loosing its content or forgetting the needs of the crew and cast. I would enjoy working with him on any project. Ed Mathews IATSE Stagehand.read more
I had a great experience with American Movie Company. The night before my flight from the east coast to California, I... realized I would need a teleprompter for my project in two days. I was able to get them on the phone that evening and they had the teleprompter delivered to my hotel the next day. The equipment was just as advertised and the client was happy. American Movie Company really came through in a pinch and I wouldn't hesitate to use them again.read more
Absolutely a pleasure working with the entire American Movie Company from start to finish. Everyone was super... accommodating and very communicative. I will certainly work with them again the future.read more
Couple Damaged Items but the 2 movers whee great at what they do. We had 3 flights of stairs and they showed no... weakness when move our heavy items. The service was great, fast, and got things done.read more
What a fabulous place to work. Everything needed for your TV., Video and Commercial needs. Great staff to help you with... your needs and problems if any occur. Largest green screen studios in NYC.read more
Today bought tickets passes to see sonic movie had a wonderful experience Nice Clean Movie AMC was pleasant clean... bathrooms staff was very helpful and the kids had a ball I love this place Highly recommend visiting.read more
Great experience with American Movie Company! We had a last-minute request, and they were very professional and helpful... throughout the entire process! Zack, from their AV team, was extremely helpful! Would highly recommend Bill and his team!read more
Bill and his team are the cream of the crop when it comes to excellence and delivery. They really know how to treat... someone right. I would recommend this company to anyone. It’s an absolute pleasure to know them.read more
AMC did an absolutely stellar job producing a series of construction project videos for us. We provided references for... the general look we were after and they took care of literally everything else. All my team had to do was show up and talk about our project. They also recommended adding drone footage to highlight the progress of our builds over the life of the project, which wound up adding production value we didn't realize we needed.read more
Had a great experience. My company and i were scrambling last minute for a teleprompter and AMC was the only place that... could help us out for a reasonable and fair price. The pick up was easy too. I like how accommodating they were and the selection of equipment at hand. Would recommend!read more
Firstly, I have a Facebook page, that I created to serve as a specialized social platform for all persons involved in... the film/entertainment industry, ranging from filmmakers, producers, actors to ones behind the scenes. American Movie Company is one of my favorites that I love to post on my Facebook page whenever I receive a new update; simply, because it offers a plethora of invaluable information to my friends in the aforementioned industry. I give American Movie Company a thumbs.read more
Working with AMC is synonymous with working with top notch professionals. Whatever the size of your project you can... expect to be treated with respect. I personally, feel that they have treated my projects with care & attention. They offer a full range of production services and are always willing to work with your budget. I recommend them as one of the most fair, efficient and professional Production companies in NYC.read more
Bill Milling at American Movie Co is a true professional and his company provides excellent customer service. He is... kind and incredibly informed. He answers my call every time I call his cell phone. He is generous with his time, gives great advice and provides the most competitive prices. I can always count on him and experience to give me the best scenario for my project. It's a pleasure doing business with them.read more
This is the most inexpensive Green Screen Studio around. Professional staff that worked with our budget. They also have... a machine (TriCaster) that let us preview our future virtual set in real time; this allowed us to make modifications to our lighting which helped in post. The end product was perfect. The 4K was crystal clear and the RED camera was priced more reasonably than anywhere else.read more
I have used AMC's Prompter services, in multiple cities, for press events of various sizes. They have always provided top notch personnel and equipment. I would recommend them highly for your next project.
18:51 09 Sep 20
American Movie Company provided me with high quality service when I needed a teleprompter for my event. I would definitely recommend anyone to work with and I certainly look forward to working with them in the future.
02:07 09 Sep 20
Great people and who really know what they are doing thanks again guys👍🏾
22:08 22 Aug 20
19:58 20 Aug 20
The people at American Movie Company do a fantastic job working with their clients. Their studio is top notch!
15:55 19 Aug 20
17:43 11 Aug 20
Bill offers a great customized service and very responsive.
01:34 04 Aug 20
Wonderful company!Very professional,and very nice experience!
Andrew Fly Samples
02:20 31 Jul 20
Amazing place, rich of professionals who are looking to reach new opportunities
00:00 31 Jul 20
Great teamAlways on timeVery thorough DependableProfessional and trustworthyKudos!!!!!!!
Mary Jo Iannotta
02:06 27 Jul 20
Excellent company! Super people to work with. Totally recommend them!
04:32 26 Jul 20
Although I have not used their services at the studio, American Movie Company. My plan would be 95% of my project could be done with their studio technologies. I have a story by Sego Ayah a futuristic action adventure, EXTREME MISSION: KONDA MASON.
16:23 22 Jul 20
American Movie Co. was very helpful in getting our production set up with an interrotron. I appreciated Bill's responsiveness and ability to work with our unpredictable production schedule. Highly recommend!
12:03 27 Jun 20
Bill Milling’s work has always impressed me with his level of care for the subject matter, as well as his hands on attention to detail and ability to bring humor into any scenario without loosing its content or forgetting the needs of the crew and cast. I would enjoy working with him on any project. Ed Mathews IATSE Stagehand.
03:36 27 Jun 20
I went to American Movie Company, It's very useful and very fast responsive
20:45 26 Jun 20
AMC does a great job Friendly, professional. The production team has always been a pleasure to work with
19:50 26 Jun 20
Good quality movies.
19:27 26 Jun 20
I had a great experience with American Movie Company. The night before my flight from the east coast to California, I realized I would need a teleprompter for my project in two days. I was able to get them on the phone that evening and they had the teleprompter delivered to my hotel the next day. The equipment was just as advertised and the client was happy. American Movie Company really came through in a pinch and I wouldn't hesitate to use them again.
00:50 21 Mar 20
08:01 12 Mar 20
23:34 10 Mar 20
15:46 10 Mar 20
HYUN TAEK KIM
06:25 10 Mar 20
04:49 07 Mar 20
23:45 03 Mar 20
Absolutely a pleasure working with the entire American Movie Company from start to finish. Everyone was super accommodating and very communicative. I will certainly work with them again the future.
04:00 03 Mar 20
10:40 02 Mar 20
Anne Maria Tafoya
04:51 29 Feb 20
16:54 27 Feb 20
09:27 20 Feb 20
14:43 18 Feb 20
What a fabulous place to work. Everything needed for your TV., Video and Commercial needs. Great staff to help you with your needs and problems if any occur. Largest green screen studios in NYC.
05:45 18 Feb 20
Charlyn Gaztambide Janer
05:33 07 Feb 20
17:36 05 Feb 20
Excellent Festival , Great people , Live Your Passion .
18:33 02 Feb 20
02:21 27 Jan 20
Great company for all of your production needs. I highly recommend this company!
21:15 21 Jan 20
15:58 20 Jan 20
11:18 20 Jan 20
Thank you!I really like it! Good Organized and friendly Correspondence
04:34 16 Jan 20
As a professional Actor I'm excited to be in the radar of American Movie Company and all their benefits, film screenings opportunities and more!
Debra Marie Francis
23:26 12 Jan 20
Love going to the movies-AMC was a beautiful theatre.
23:20 10 Jan 20
Everyone on the American Move Team was so nice and responsive to our last minute request. Their operator and equipment were top-notch. I would highly recommend them to anyone.
I frequently work with AMC on coroporate shoots. Their... teleprompter operators are always highly professional in their interactions with my clients, and they always manage to put the talent at ease. We recently shot at one of their studios in Chelsea, and it was a great experience!read more
The American Movie Company in Tribeca is the one place to... call when in need of renting a Teleprompter or an Interrotron. We did just that over the Fourth of July weekend. A foreign television producer was in Manhattan to cover Macy's Fireworks Spectacular and to interview those in charge at Macy's. They were impressed with the staff at American Movie who took them to the glorious Brooklyn Bridge which served as the backdrop for the fireworks. The operator was dedicated and knowledgeable - plans were made to come back for the Labor Day weekend. I recommend this company - it never let us down. They are reliable. That's not a small feat.read more
It's great to work with people with passion about their... jobs. Every new gig is met with anticipation. Am so happy to tell you that clients' feedback is so positive. Am lucky to have found a job I love!read more