How 5G, AI, VR AR and Blockchain Converge to Dramatically Change Our World
How AR, AI, Sensors & Blockchain are Converging Into Web 3.0
How each of us sees the world is about to change dramatically…
For all of human history, the experience of looking at the world was roughly the same for everyone. But boundaries between the digital and physical are beginning to fade.
The world around us is gaining layer upon layer of digitized, virtually overlaid information — making it rich, meaningful, and interactive. As a result, our respective experiences of the same environment are becoming vastly different, personalized to our goals, dreams, and desires.
Welcome to Web 3.0, aka The Spatial Web. In version 1.0, static documents and read-only interactions limited the internet to one-way exchanges. Web 2.0 provided quite an upgrade, introducing multimedia content, interactive web pages, and participatory social media. Yet, all this was still mediated by 2D screens.
And today, we are witnessing the rise of Web 3.0, riding the convergence of high-bandwidth 5G connectivity, rapidly evolving AR eyewear, an emerging trillion-sensor economy, and ultra-powerful AIs.
As a result, we will soon be able to superimpose digital information atop any physical surrounding—freeing our eyes from the tyranny of the screen, immersing us in smart environments, and making our world endlessly dynamic.
In this third blog of our five-part series on augmented reality, we will explore the convergence between AR, AI, sensors, and blockchain, diving into the implications through a key use case in manufacturing.
A Tale of Convergence
Let’s deconstruct everything beneath the sleek AR display.
It all begins with Graphics Processing Units (GPUs) — electric circuits that perform rapid calculations to render images. (GPUs can be found in mobile phones, game consoles, and computers.)
However, because AR requires such extensive computing power, single GPUs will not suffice. Instead, blockchain can now enable distributed GPU processing power, and blockchains specifically dedicated to AR holographic processing are on the rise.
Next up, cameras and sensors will aggregate real-time data from any environment to seamlessly integrate physical and virtual worlds. Meanwhile, body-tracking sensors are critical for aligning a user’s self-rendering in AR with a virtually enhanced environment. Depth sensors then provide data for 3D spatial maps, while cameras absorb more surface-level, detailed visual input. In some cases, sensors might even collect biometric data, such as heart rate and brain activity, to incorporate health-related feedback in our everyday AR interfaces and personal recommendation engines.
The next step in the pipeline involves none other than AI. Processing enormous volumes of data instantaneously, embedded AI algorithms will power customized AR experiences in everything from artistic virtual overlays to personalized dietary annotations.
In retail, AIs will use your purchasing history, current closet inventory, and possibly even mood indicators to display digitally rendered items most suitable for your wardrobe, tailored to your measurements.
In healthcare, smart AR glasses will provide physicians with immediately accessible and maximally relevant information (parsed from the entirety of a patient’s medical records and current research) to aid in accurate diagnoses and treatments, freeing doctors to engage in the more human-centric tasks of establishing trust, educating patients and demonstrating empathy.
Source: PHD Ventures.
Convergence in Manufacturing
One of the nearest-term use cases of AR is manufacturing, as large producers begin dedicating capital to enterprise AR headsets. And over the next ten years, AR will converge with AI, sensors, and blockchain to multiply manufacturer productivity and employee experience.
Source: Microsoft – Dynamics 365 Blog.
(1) Convergence with AI
In initial application, digital guides superimposed on production tables will vastly improve employee accuracy and speed, while minimizing error rates.
Already, the International Air Transport Association (IATA) — whose airlines supply 82 percent of air travel — recently implemented industrial tech company Atheer’s AR headsets in cargo management. And with barely any delay, IATA reported a whopping 30 percent improvement in cargo handling speed and no less than a 90 percent reduction in errors.
With similar success rates, Boeing brought Skylight’s smart AR glasses to the runway, now used in the manufacturing of hundreds of airplanes. Sure enough—the aerospace giant has now seen a 25 percent drop in production time and near-zero error rates.
Beyond cargo management and air travel, however, smart AR headsets will also enable on-the-job training without reducing the productivity of other workers or sacrificing hardware. Jaguar Land Rover, for instance, implemented Bosch’s Re’flekt One AR solution to gear technicians with “x-ray” vision: allowing them to visualize the insides of Range Rover Sport vehicles without removing any dashboards.
And as enterprise capabilities continue to soar, AIs will soon become the go-to experts, offering support to manufacturers in need of assembly assistance. Instant guidance and real-time feedback will dramatically reduce production downtime, boost overall output, and even help customers struggling with DIY assembly at home.
Perhaps one of the most profitable business opportunities, AR guidance through centralized AI systems will also serve to mitigate supply chain inefficiencies at extraordinary scale. Coordinating moving parts, eliminating the need for manned scanners at each checkpoint, and directing traffic within warehouses, joint AI-AR systems will vastly improve workflow while overseeing quality assurance.
After its initial implementation of AR “vision picking” in 2015, leading courier company DHL recently announced it would continue to use Google’s newest smart lens in warehouses across the world. Motivated by the initial group’s reported 15 percent jump in productivity, DHL’s decision is part of the logistics giant’s $300 million investment in new technologies.
And as direct-to-consumer e-commerce fundamentally transforms the retail sector, supply chain optimization will only grow increasingly vital. AR could very well prove the definitive step for gaining a competitive edge in delivery speeds.
As explained by Vital Enterprises CEO Ash Eldritch, “All these technologies that are coming together around artificial intelligence are going to augment the capabilities of the worker and that’s very powerful. I call it Augmented Intelligence. The idea is that you can take someone of a certain skill level and by augmenting them with artificial intelligence via augmented reality and the Internet of Things, you can elevate the skill level of that worker.”
Already, large producers like Goodyear, thyssenkrupp, and Johnson Controls are using the Microsoft HoloLens 2—priced at $3,500 per headset—for manufacturing and design purposes.
Perhaps the most heartening outcome of the AI-AR convergence is that, rather than replacing humans in manufacturing, AR is an ideal interface for human collaborationwith AI. And as AI merges with human capital, prepare to see exponential improvements in productivity, professional training, and product quality.
(2) Convergence with Sensors
On the hardware front, these AI-AR systems will require a mass proliferation of sensors to detect the external environment and apply computer vision in AI decision-making.
To measure depth, for instance, some scanning depth sensors project a structured pattern of infrared light dots onto a scene, detecting and analyzing reflected light to generate 3D maps of the environment. Stereoscopic imaging, using two lenses, has also been commonly used for depth measurements. But leading technology like Microsoft’s HoloLens 2 and Intel’s RealSense 400-series camera implement a new method called “phased time-of-flight” (ToF).
In ToF sensing, the HoloLens 2 uses numerous lasers, each with 100 milliwatts (mW) of power, in quick bursts. The distance between nearby objects and the headset wearer is then measured by the amount of light in the return beam that has shifted from the original signal. Finally, the phase difference reveals the location of each object within the field of view, which enables accurate hand-tracking and surface reconstruction.
With a far lower computing power requirement, the phased ToF sensor is also more durable than stereoscopic sensing, which relies on the precise alignment of two prisms. The phased ToF sensor’s silicon base also makes it easily mass-produced, rendering the HoloLens 2 a far better candidate for widespread consumer adoption.
To apply inertial measurement—typically used in airplanes and spacecraft—the HoloLens 2 additionally uses a built-in accelerometer, gyroscope, and magnetometer. Further equipped with four “environment understanding cameras” that track head movements, the headset also uses a 2.4MP HD photographic video camera and ambient light sensor that work in concert to enable advanced computer vision.
For natural viewing experiences, sensor-supplied gaze tracking increasingly creates depth in digital displays. Nvidia’s work on Foveated AR Display, for instance, brings the primary foveal area into focus, while peripheral regions fall into a softer background— mimicking natural visual perception and concentrating computing power on the area that needs it most.
Gaze tracking sensors are also slated to grant users control over their (now immersive) screens without any hand gestures. Conducting simple visual cues, even staring at an object for more than three seconds, will activate commands instantaneously.
And our manufacturing example above is not the only one. Stacked convergence of blockchain, sensors, AI and AR will disrupt almost every major industry.
Take healthcare, for example, wherein biometric sensors will soon customize users’ AR experiences. Already, MIT Media Lab’s Deep Reality group has created an underwater VR relaxation experience that responds to real-time brain activity detected by a modified version of the Muse EEG. The experience even adapts to users’ biometric data, from heart rate to electro dermal activity (inputted from an Empatica E4 wristband).
Now rapidly dematerializing, sensors will converge with AR to improve physical-digital surface integration, intuitive hand and eye controls, and an increasingly personalized augmented world. Keep an eye on companies like MicroVision, now making tremendous leaps in sensor technology.
While I’ll be doing a deep dive into sensor applications across each industry in our next blog, it’s critical to first discuss how we might power sensor- and AI-driven augmented worlds.
(3) Convergence with Blockchain
Because AR requires much more compute power than typical 2D experiences, centralized GPUs and cloud computing systems are hard at work to provide the necessary infrastructure. Nonetheless, the workload is taxing and blockchain may prove the best solution.
A major player in this pursuit, Otoy aims to create the largest distributed GPU network in the world, called the Render Network RNDR. Built specifically on the Ethereum blockchain for holographic media, and undergoing Beta testing, this network is set to revolutionize AR deployment accessibility.
Alphabet Chairman Eric Schmidt (an investor in Otoy’s network), has even said, “I predicted that 90% of computing would eventually reside in the web based cloud… Otoy has created a remarkable technology which moves that last 10%—high-end graphics processing—entirely to the cloud. This is a disruptive and important achievement. In my view, it marks the tipping point where the web replaces the PC as the dominant computing platform of the future.”
Leveraging the crowd, RNDR allows anyone with a GPU to contribute their power to the network for a commission of up to $300 a month in RNDR tokens. These can then be redeemed in cash or used to create users’ own AR content.
In a double win, Otoy’s blockchain network and similar iterations not only allow designers to profit when not using their GPUs, but also democratize the experience for newer artists in the field.
And beyond these networks’ power suppliers, distributing GPU processing power will allow more manufacturing companies to access AR design tools and customize learning experiences. By further dispersing content creation across a broad network of individuals, blockchain also has the valuable potential to boost AR hardware investment across a number of industry beneficiaries.
On the consumer side, startups like Scanetchain are also entering the blockchain-AR space for a different reason. Allowing users to scan items with their smartphone, Scanetchain’s app provides access to a trove of information, from manufacturer and price, to origin and shipping details.
Based on NEM (a peer-to-peer cryptocurrency that implements a blockchain consensus algorithm), the app aims to make information far more accessible and, in the process, create a social network of purchasing behavior. Users earn tokens by watching ads, and all transactions are hashed into blocks and securely recorded.
The writing is on the wall—our future of brick-and-mortar retail will largely lean on blockchain to create the necessary digital links.
Integrating AI into AR creates an “auto-magical” manufacturing pipeline that will fundamentally transform the industry, cutting down on marginal costs, reducing inefficiencies and waste, and maximizing employee productivity.
Bolstering the AI-AR convergence, sensor technology is already blurring the boundaries between our augmented and physical worlds, soon to be near-undetectable. While intuitive hand and eye motions dictate commands in a hands-free interface, biometric data is poised to customize each AR experience to be far more in touch with our mental and physical health.
And underpinning it all, distributed computing power with blockchain networks like RNDR will democratize AR, boosting global consumer adoption at plummeting price points.
As AR soars in importance—whether in retail, manufacturing, entertainment, or beyond—the stacked convergence discussed above merits significant investment over the next decade. Already, 52 Fortune 500 companies have begun testing and deploying AR/VR technology. And while global revenue from AR/VR stood at $5.2 billion in 2016, market intelligence firm IDC predicts the market will exceed $162 billion in value by 2020.
The augmented world is only just getting started.
(1) A360 Executive Mastermind: Want even more context about how converging exponential technologies will transform your business and industry? Consider joining Abundance 360, a highly selective community of 360 exponentially minded CEOs, who are on a 25-year journey with me — or as I call it, a “countdown to the Singularity.” If you’d like to learn more and consider joining our 2020 membership, apply here.
Share this with your friends, especially if they are interested in any of the areas outlined above.
(2) Abundance-Digital Online Community: I’ve also created a Digital/Online community of bold, abundance-minded entrepreneurs called Abundance-Digital. Abundance-Digital is Singularity University’s ‘onramp’ for exponential entrepreneurs — those who want to get involved and play at a higher level. Click here to learn more.
(Both A360 and Abundance-Digital are Singularity University programs.)
We highly recommend American Movie Company. We have been doing business with them for about a year. They are professional, and reliable. They are a pleasure to do business with.
08:38 23 Oct 20
Almost able to work together then the pandemic hit. Open communication with quick accurate responses. Will update when we do work together.
20:26 11 Oct 20
Very Professional and helpful
17:11 08 Oct 20
01:09 22 Sep 20
19:32 17 Sep 20
A very professional experience with a great crew.
19:05 14 Sep 20
I have used AMC's Prompter services, in multiple cities, for press events of various sizes. They have always provided top notch personnel and equipment. I would recommend them highly for your next project.
18:51 09 Sep 20
American Movie Company provided me with high quality service when I needed a teleprompter for my event. I would definitely recommend anyone to work with and I certainly look forward to working with them in the future.
02:07 09 Sep 20
Great people and who really know what they are doing thanks again guys👍🏾
22:08 22 Aug 20
19:58 20 Aug 20
The people at American Movie Company do a fantastic job working with their clients. Their studio is top notch!
15:55 19 Aug 20
17:43 11 Aug 20
Bill offers a great customized service and very responsive.
01:34 04 Aug 20
Wonderful company!Very professional,and very nice experience!
Andrew Fly Samples
02:20 31 Jul 20
Amazing place, rich of professionals who are looking to reach new opportunities
00:00 31 Jul 20
Great teamAlways on timeVery thoroughDependableProfessional and trustworthyKudos!!!!!!!
Mary Jo Iannotta
02:06 27 Jul 20
Excellent company! Super people to work with. Totally recommend them!
04:32 26 Jul 20
Although I have not used their services at the studio, American Movie Company. My plan would be 95% of my project could be done with their studio technologies. I have a story by Sego Ayah a futuristic action adventure, EXTREME MISSION: KONDA MASON.
16:23 22 Jul 20
American Movie Co. was very helpful in getting our production set up with an interrotron. I appreciated Bill's responsiveness and ability to work with our unpredictable production schedule. Highly recommend!
12:03 27 Jun 20
Bill Milling’s work has always impressed me with his level of care for the subject matter, as well as his hands on attention to detail and ability to bring humor into any scenario without loosing its content or forgetting the needs of the crew and cast. I would enjoy working with him on any project.Ed Mathews IATSE Stagehand.
03:36 27 Jun 20
I went to American Movie Company, It's very useful and very fast responsive
20:45 26 Jun 20
AMC does a great job Friendly, professional. The production team has always been a pleasure to work with
19:50 26 Jun 20
Good quality movies.
19:27 26 Jun 20
I had a great experience with American Movie Company. The night before my flight from the east coast to California, I realized I would need a teleprompter for my project in two days. I was able to get them on the phone that evening and they had the teleprompter delivered to my hotel the next day. The equipment was just as advertised and the client was happy. American Movie Company really came through in a pinch and I wouldn't hesitate to use them again.
00:50 21 Mar 20
08:01 12 Mar 20
23:34 10 Mar 20
15:46 10 Mar 20
HYUN TAEK KIM
06:25 10 Mar 20
04:49 07 Mar 20
23:45 03 Mar 20
Absolutely a pleasure working with the entire American Movie Company from start to finish. Everyone was super accommodating and very communicative. I will certainly work with them again the future.
04:00 03 Mar 20
10:40 02 Mar 20
Anne Maria Tafoya
04:51 29 Feb 20
16:54 27 Feb 20
09:27 20 Feb 20
14:43 18 Feb 20
What a fabulous place to work. Everything needed for your TV., Video and Commercial needs. Great staff to help you with your needs and problems if any occur. Largest green screen studios in NYC.
05:45 18 Feb 20
Charlyn Gaztambide Janer
05:33 07 Feb 20
17:36 05 Feb 20
Excellent Festival , Great people , Live Your Passion .
'Had a great experience as an actor shooting at American... Movie Company, we did green screen work and I used two teleprompters simultaneously placed in appropriate positions - the staff was very efficient and Bill Milling really knows hot to get things done! Recommended!!read more
Supremely helpful team with the best equipment. They're... flexible enough to support a creative team's vision and smart enough to help the team reach higher than expected. Economical. Efficient. Effective. And friendly. I recommend them highly.read more
Bill and his team are some of the best people I have worked... for in the entertainment industry. They helped me produce a particularly challenging project and with their expertise we handled it with ease. All their facilities and equipment are top of the line and the cost is very reasonable. Where other companies in New York will overcharge you on everything, they work with your budget and make sure you are able to deliver a top quality product to your client. They are my first call for all my production needs and truly a joy to work with. You should not hesitate to call, you will be glad you did. Tell them Jordan says Hi!read more
I have had the Extreme Honor of knowing and working with... Mr. Bill Milling for 23 years. My first experience was to work under his Direction in the Film " Body Trouble " which I was cast in with Dick Van Patten, Frank Gorshen and Priscilla Barnes . I'm so very Honored that Mr. Bill Milling will be Directing my Upcoming Major Feature Film "the Mentor ". The combination of his Award Winning years of Professional Experience, his Amazingly Talented Staff , and State of the Arts Equipment .... I HIGHLY RECOMMEND American Movie Company and Live Streaming Video Production NYC. Much Continued Success !!! www.delorenzoenterprise.com - Pete DeLorenzo INTERNATIONALLY RECOGNIZED COMEDIAN, IMPRESSIONIST, ACTOR, RECORDING ARTIST, SCREENWRITER, PRODUCER, DIRECTOR and HUMANITARIAN www.delorenzoenterprise.com - Pete DeLorenzo AMBASSADOR IN CHIEF OF GOODWILL FOR THE WORLD AND FOR WORLD PEACE AND SUFFERING AND REPRESENTATIVE TO THE UNITED NATIONS FOR GLOBAL COOPERATION DAY AND WORLD PEACE http://www.globalcooperationliz.com/#!news/c1e3qEm GLOBAL COOPERATION DAY Oct. 4th A SPECIAL WORLDWIDE BROADCAST WE NOW GO FORWARD FOR 2019read more
Our press conference for Intel needed live streaming... services so we were recommended to Erika Larsen and her team. We went with the Tricaster 850, had a 3 camera set up for the event and everything went very smooth. I highly recommend Webcasting NYC for high profile live events.read more
I have received several emails from friends in Buenos Aires... praising American Movie Co.'s WebCasting. Last September they were able to witness the wedding of their dear friend in Fire Island as it happened! The staff was amazing and totally proficient at their job. The whole ritual was transmitted flawlessly. The happy couple is coming back in August for a second honeymoon. Who knows? Maybe they'll work together again! Well done!read more