A machine learning model implemented in Rust 🦀 + Burn 🔥 for the LEAP - Atmospheric Physics using AI (ClimSim) Kaggle challenge
-
Updated
Jun 12, 2024 - Rust
A machine learning model implemented in Rust 🦀 + Burn 🔥 for the LEAP - Atmospheric Physics using AI (ClimSim) Kaggle challenge
HASH uses Apache Arrow within hEngine for in-memory columnar data representation and zero-copy reads
A Delta Table pipeline in Rust, triggered by Azure Functions responding to blob storage events in a specific container subfolder. The pipeline processes CSV files, updating or creating Delta Tables as needed, using merges for row changes.
Read from the lake api and write to MS SQL Server
Apache Datafusion JVM User Defined Functions (UDF), integration nobody asked for 😀
Kusto client library optimized for data science workloads
🦖 Efficiently evolve your old fixed-length data files into more modern file formats, fully parallelized!
Add a description, image, and links to the arrow topic page so that developers can more easily learn about it.
To associate your repository with the arrow topic, visit your repo's landing page and select "manage topics."