Awesome Segment Anything

Segment Anything has led to a new breakthrough in the field of Computer Vision (CV), and this repository will continue to track and summarize the research progress of Segment Anything in various fields, including Papers/Projects, etc.

If you find this repository helpful, please consider Stars ⭐ or Sharing ⬆️. Thanks.

News

- 2023.4.12: Add some presentation.
- 2023.4.12: An initial version of add recent papers or projects.

Contents

• Basemodel Papers
• Derivative Papers
• Derivative Projects
  • Image Segmentation task
  • Video Segmentation task
  • Medical image Segmentation task
  • Inpainting task
  • Image Generation task
  • Remote Sensing task
  • Moving Object Detection task

Papers/Projects

Basemodel

Title	Presentation	Paper page	Project page	Code base	Affiliation	Description
CLIP		arXiv	Colab	Code	OpenAI	Contrastive Language-Image Pre-Training.
OWL-ViT		ECCV2022	-	Code	Google	A open-vocabulary object detector.
Painter		CVPR2023	-	Code	BAAI	A Generalist Painter for In-Context Visual Learning.
Grounding DINO		arXiv	Colab &Huggingface	Code	IDEA	A stronger open-set object detector
Segment Anything		arXiv	Project page	Code	Meta	A stronger Large model which can be used to generate masks for all objects in an image.
SegGPT		arXiv	Project page	Code	BAAI	Segmenting Everything In Context based on Painter.

Derivative Papers

Title	Presentation	Paper page	Project page	Code base	Affiliation	Description
Segment Anything Model (SAM) for Digital Pathology		arXiv	-	-	-	SAM + Tumor segmentation/Tissue segmentation/Cell nuclei segmentation.
SAMCOD	-	arXiv	-	Code	-	SAM + Camouflaged object detection (COD) task.

Derivative Projects

Image Segmentation task

Title	Presentation	Project page	Code base	Affiliation	Description
Grounded Segment Anything		Colab & Huggingface	Code	-	Combining Grounding DINO and Segment Anything
GroundedSAM Anomaly Detection		-	Code	-	Grounding DINO + SAM to segment any anomaly.
Semantic Segment Anything		-	Code	Fudan	A dense category annotation engine.
Magic Copy		-	Code	-	Magic Copy is a Chrome extension that uses SAM.
Segment Anything with Clip		-	Code	-	SAM + CLIP
SAM-Clip		-	Code	-	SAM + CLIP.
Prompt Segment Anything		-	Code	-	SAM + Zero-shot Instance Segmentation.
RefSAM	-	-	Code	-	Evaluating the basic performance of SAM on the Referring Image Segmementation task.
SAM-RBox		-	Code	-	An implementation of SAM for generating rotated bounding boxes with MMRotate.
Open Vocabulary Segment Anything		-	Code	-	An interesting demo by combining OWL-ViT of Google and SAM.
SegDrawer		-	Code	-	Simple static web-based mask drawer, supporting semantic drawing with SAM.
Annotation Anything Pipeline		YoutubeDemo	Code	-	SAM + Labelme + LabelImg + Auto-labeling.
AnyLabel		-	Code	-	GPT + SAM.

Video Segmention task

Title	Presentation	Project page	Code base	Affiliation	Description
MetaSeg		HuggingFace	Code	-	SAM + Video.

Medical image Segmentation task

Title	Presentation	Project page	Code base	Affiliation	Description
SAM in Napari	Video	-	Code	-	Segment anything with Napari integration of SAM.
SAM Medical Imaging		-	Code	-	SAM for Medical Imaging.

Inpainting task

Title	Presentation	Project page	Code base	Affiliation	Description
SegAnythingPro		-	Code	-	SAM + Inpainting/Replacing.
Inpaint Anything		-	Code	-	SAM + Inpainting.

Image Generation task

Title	Presentation	Project page	Code base	Affiliation	Description
Edit Anything		-	Code	-	Edit and Generate Anything in an image.
Image Edit Anything		-	Code	-	Stable Diffusion + SAM.
SAM for Stable Diffusion Webui		-	Code	-	Stable Diffusion + SAM.

Remote Sensing task

Title	Presentation	Project page	Code base	Affiliation	Description
Earth Observation Tools		Colab	Code	-	SAM + Remote Sensing.

Moving Object Detection task

Title	Presentation	Project page	Code base	Affiliation	Description
Moving Object Detection		-	Code	-	SAM + Moving Object Detection.

License

This project is released under the MIT license. Please see the LICENSE file for more information.