Website Cloning AI Agent

This project is an AI-powered agent designed to clone websites by analyzing their structure and content. The agent follows a systematic approach to fetch, process, and recreate websites in a local environment.

Features

• Fetch fully rendered HTML content from websites
• Extract and save website assets (images, CSS, JS)
• Analyze and recreate website structure using DOM JSON
• Generate comprehensive CSS for modern websites
• Support for optimized images and relative paths

Tools Used

• OpenAI API for natural language processing
• Puppeteer for web scraping and rendering
• File system operations for saving and organizing cloned content

Getting Started

1. Clone the repository
2. Install dependencies
3. Set up environment variables
4. Run the AI agent with a target website URL

Usage

npm install
npm link
my-node-cli

Contributing

Contributions are welcome! Please open an issue or submit a pull request.

License

This project is licensed under the MIT License.