Augmented Reality is often considered one of the most promising technologies today, one that, unfortunately, has been slow to be used for more uses. Now, a developer named Cyril Diagne demonstrates that it is possible to go further with Augmented Reality, ‘copying’ objects from the real world and ‘pasting’ them into digital formats.
This is only a research prototype right now, but it looks like a few companies are already working on similar software. You can probably expect to see tools like this on your mobile phone in the near future.
It would certainly make a nice addition to the only other AR application that seems to have much practical use: seeing what clothes, furniture, and makeup look like pasted onto your face and/or house. And it neatly reverses the usual AR paradigm. Instead of projecting digital images into the physical world, it brings the physical into the digital.
There are a few moving parts to his AR Cut & Paste demo. One component separates the foreground object from the background with machine learning, while another detects where your phone is pointing at your computer screen. It takes about 2.5 seconds to copy an object and four seconds to paste it, but that could be easily sped up.
Cyril Diagne put his code up on GitHub for anyone who feels like they want to improve it themselves.
4/10 – Cut & paste your surroundings to Photoshop
— Cyril Diagne (@cyrildiagne) May 3, 2020