A reality-bending app called ClipDrop lets users "drop" real-life objects into a desktop display, in a fun application of augmented reality (AR) taking social media by storm, according to a recent demo tweet from developer Cyril Diagne.
While an earlier prototype was reported before, we're here to show how far it's come.
New 'Cut-and-Paste' app places real objects into AR
The app concept is beyond cool — letting users take a picture of any real-world object and automatically remove the background and convert the desired object into a digital image. Users may then paste the new image on a desktop display and use it in applications.
And this works on more than simple objects or people — users may also clip text from a book or physical page in one's surrounding environment, The Next Web reports.
AR app available on iOS, macOS, Android, Windows
ClipDrop does a fairly impressive job of distinguishing objects in focus from the unwanted background — but sometimes it gives blurred edges or excluded parts of the object. Presumably, these bugs are faults of the beta stage, and will improve as time goes on.
The app also works directly with other apps, like Powerpoint, Photoshop, Canva, and Pages — which means users may paste objects directly into an in-progress project. Additionally, users may use the desktop app to pull text or images from websites or apps.
The app is available on every platform — including iOS, macOS, Android, and Windows — but the full suite of features requires a hefty $39.99 payment to unlock.
Aaand here it is..!!! 😱— Cyril Diagne (@cyrildiagne) October 22, 2020
After months of hard work with @jblanchefr, @ClipDropApp beta (AR Copy Paste) is now publicly available on #Android, #iOS, #macOS, and #Windows
🔥 https://t.co/52eLMEfXNR 🔥
Here's a thread of what you can already do with it ↓ 1/n#ML #AR #AI pic.twitter.com/0fQJQ8KRBv
Other AR apps, 'Ulitmate Display' concept
Mobile phone-based AR apps are nothing new. The first AR application (in the loose sense of the word) came from Harvard University in 1968 — when Ivan Sutherland developed an AR/VR head-mounted display system, called "Sword of Damocles." Instead of a camera, it was connected to a camera.
Sutherland even conceived the "Ultimate Display" concept — at which simulated reality could appear indiscernible from "real" reality. The conditions to be met involved VR viewed vai head-mounted display capable of appearing "realistic" through augmented 3D sound and tactile feedback (sometimes called haptic).
Additionally, computer hardware needs to create and maintain VR in real-time, and users should experience interactive capabilities with the virtual world in a "realistic" way.
While we can't say for sure whether ClipDrop meets Sutherland's conditional concept for the "Ultimate Display," we find it difficult to deny that AR is beginning to eat its way into our so-called physical reality, thanks to the integration of innovative apps.