Cut and paste your surroundings using AR

AR Cut & Paste

An AR+ML prototype that allows cutting elements from your surroundings and pasting them in an image editing software.

Although only Photoshop is being handled currently, it may handle different outputs in the future.

Demo & more infos: Thread

⚠️ This is a research prototype and not a consumer / photoshop user tool.

Modules

This prototype runs as 3 independent modules:

Usage

1 - Configure Photoshop

• Go to "Preferences > Plug-ins", enable "Remote Connection" and set a friendly password that you'll need later.

2 - Setup the external salience object detection service

• As mentioned above, for the time being, you must deploy the BASNet model (Qin & al, CVPR 2019) as an external HTTP service using this BASNet-HTTP wrapper (requires a CUDA GPU)

• You will need the deployed service URL to configure the local server

3 - Configure and run the local server

• Follow the instructions in /server to setup & run the local server.

4 - Configure and run the mobile app

• Follow the instructions in /app to setup & deploy the mobile app.

Thanks and Acknowledgements

from Hacker News https://github.com/cyrildiagne/ar-cutpaste