Skip to content
forked from mage-ai/mage-ai

๐Ÿง™ Mage is an open-source data management platform that helps you clean data and prepare it for training AI/ML models.

License

Notifications You must be signed in to change notification settings

DataDeus/mage-ai

ย 
ย 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 

Repository files navigation

PyPi mage-ai License Join Slack

Intro

Mage is an open-source code editor for transforming data and building ML pipelines.

Mage

Join us on Slack Slack

Table of contents

  1. Quick start
  2. Features
  3. Contributing
  4. Community

๐Ÿƒโ€โ™€๏ธ Quick start

Fire mage

Using Docker

1. Clone repository
$ git clone https://github.com/mage-ai/mage-ai.git && cd mage-ai
2. Create new project
$ ./scripts/init.sh --project [project_name]
3. Launch editor
$ ./scripts/start.sh --project [project_name]

Open http://localhost:6789 in your browser.

4. Run pipeline
$ ./scripts/run.sh --project [project_name]

Using pip

1. Install Mage
$ pip install mage-ai
2. Create new project
$ mage init [project_name]
3. Launch editor
$ mage start [project_name]

Open http://localhost:6789 in your browser.

4. Run pipeline
$ mage run [project_name] [pipeline]

๐Ÿ”ฎ Features

  1. Data centric editor
  2. Production ready code
  3. Extensible

1. Data centric editor

An interactive coding experience designed for preparing data to train ML models.

Visualize the impact of your code every time you load, clean, and transform data.

Data centric editor

2. Production ready code

No more writing throw away code or trying to turn notebooks into scripts.

Each block (aka cell) in this editor is a modular file that can be tested, reused, and chained together to create an executable data pipeline locally or in any environment.

Read more about blocks and how they work.

Production ready code

Run your data pipeline end-to-end using the command line function: $ mage run [project] [pipeline]

3. Extensible

Easily add new functionality directly in the source code or through plug-ins (coming soon).

Adding new API endpoints (Tornado), transformations (Python, PySpark, SQL), and charts (using React) is easy to do (tutorial coming soon).

Extensible charts

๐Ÿ™‹โ€โ™€๏ธ Contributing

We welcome all contributions to Mage; from small UI enhancements to brand new cleaning actions. We love seeing community members level up and give people power-ups!

Check out the ๐ŸŽ contributing guide to get started by setting up your development environment and exploring the code base.

Got questions? Live chat with us in Slack Slack

Anything you contribute, the Mage team and community will maintain. Weโ€™re in it together!

๐Ÿง™ Community

We love the community of Magers (/หˆmฤjษ™r/); a group of mages who help each other realize their full potential!

To live chat with the Mage team and community, please join the free Mage Slack Slack channel.

For real-time news and fun memes, check out the Mage Twitter Twitter.

To report bugs or add your awesome code for others to enjoy, visit GitHub.

๐Ÿชช License

See the LICENSE file for licensing information.


Wind mage casting spell

About

๐Ÿง™ Mage is an open-source data management platform that helps you clean data and prepare it for training AI/ML models.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • TypeScript 53.3%
  • Python 41.5%
  • HTML 3.5%
  • CSS 0.7%
  • Jupyter Notebook 0.5%
  • JavaScript 0.3%
  • Other 0.2%