This repository tracks published ips for various bots and crawlers.
Data is refreshed roughly every 30 minutes.
| ID | URL |
| ------------------------------------- | --------------------------------------------------------------------------------------------- |
| google-googlebot | https://developers.google.com/static/search/apis/ipranges/googlebot.json |
| google-special-crawlers | https://developers.google.com/static/search/apis/ipranges/special-crawlers.json |
| google-user-triggered-fetchers | https://developers.google.com/static/search/apis/ipranges/user-triggered-fetchers.json |
| google-user-triggered-fetchers-google | https://developers.google.com/static/search/apis/ipranges/user-triggered-fetchers-google.json |
| openai-searchbot | https://openai.com/searchbot.json |
| openai-chatgpt-user | https://openai.com/chatgpt-user.json |
| openai-gptbot | https://openai.com/gptbot.json |
| perplexity-bot | https://www.perplexity.com/perplexitybot.json |
| perplexity-user | https://www.perplexity.com/perplexity-user.json |
| microsoft-bingbot | https://www.bing.com/toolbox/bingbot.json |
| duckduckgo-duckduckbot | https://duckduckgo.com/duckduckbot.json |
| duckduckgo-duckassistbot | https://duckduckgo.com/duckassistbot.json |
| apple-applebot | https://search.developer.apple.com/applebot.json |
| mistralai-user-ips | https://mistral.ai/mistralai-user-ips.json |
| commoncrawl-ccbot | https://index.commoncrawl.org/ccbot.json |