How many times have you had to request a photoshop expert to edit some photos for you? Like changing the background or removing an annoying item from the background? You might have had a few times you had to beg your friend to do this for you. But no more. An AI tool has been built that can easily do this for you. And the tool is improving its quality as we speak. The tool's name is called InstructPix2Pix.
You may know or even used artificial image generators like Dall-E or MidJourney. But this tool is different. It takes an existing image as an input and also takes prompts as inputs and creates a new image on top of the existing one. You can say things like "remove the background and replace with a scenery".
InstructPix2Pix is a website for AI tools called Hugging Face, which also hosted the viral bot Dall-E Mini. It requires an input image, prompts for instructions, and then produces a touched-up image with the modifications you requested.
The AI tool's developers used their knowledge of the language models GPT-3 and Stable Diffusion to create a large dataset of image editing examples for the training data. InstructPix2Pix was then trained with this dataset. Be that as it may, dissimilar to Stable Dispersion which is a picture age model (text-to-picture), InstructPix2Pix is a picture altering dissemination model.
The model was first presented back on November 17, 2022, in a paper by Tim Streams, Aleksander Holynski, and Alexei A. Efros - a few days before the release of ChatGPT.
Some of the samples that showcase the usefulness of the tool are below. You can try it out and leave a comment below and how you found it.