In this project I have built a little app that allows user to select a subject and then change its background, OR keep the background and change the subject.
The process involves a user uploading an image and selecting the main object by clicking on it. The Segment Anything Model (SAM) is activated to create a mask around the selected object, choosing the most accurate mask generated. The user is shown this result to either accept it or refine the mask further with additional points. Once the mask is finalized, the user gives a text description (and possibly a negative prompt) to specify a new background for the selected object. An infill model then creates this new background, and the final image is displayed. Optionally, the user can choose to invert the mask and substitute the subject while keeping the background.
- Segment Anything Model (SAM)
- Stable Diffusion XL for Inpainting
Clone the repository and then use the provided requirements.txt to install the dependencies:
pip install -r requirements.txt
