postgres-connect-rust

A Rust library and CLI for efficiently uploading GeoJSON data into a PostgreSQL/PostGIS database, with robust table management, error handling, and streaming support.

---

🚀 Features

• Upload GeoJSON to PostgreSQL: Stream features from large GeoJSON files directly into a database table using the efficient COPY command.
• Automatic Table Creation: Creates tables if they do not exist, with support for PostGIS geometry columns.
• Flexible Table Naming: Use a custom table name or derive it from the file name.
• Robust Error Handling: Meaningful error messages and fallbacks for missing or invalid data.
• Diagnostics: Informative progress and diagnostic output for all major operations.
• Extensible: Modular design for easy integration and testing.

---

🛠️ Getting Started

Prerequisites

• Rust (edition 2021 or later)
• PostgreSQL with PostGIS extension enabled

Installation

Clone the repository:

git clone https://github.com/youpele52/postgres-connect-rust.git

# or

git clone https://jugit.fz-juelich.de/MichaelYoupele/postgres-connect-rust.git


cd postgres-connect-rust

Build the project:

cargo build --release

---

⚡ Usage

Example: Upload a GeoJSON file

use postgres_connect_rust::write::queries::{process_and_upload_file, parse_geojson_features, upload_features_copy};

#[tokio::main]
async fn main() {
    let file_path = "path/to/your.geojson";
    let table_name = None;
    
    // Process and upload the file
    process_and_upload_file(file_path, table_name).await.expect("Failed to process and upload file");
    
    // Alternatively, you can use the functions individually
    let features = parse_geojson_features(file_path).await.expect("Failed to parse GeoJSON features");
    upload_features_copy(features, table_name).await.expect("Failed to upload features");
}

• If you pass None as the table name, the table will be named after the file (without extension).

CLI (if implemented)

cargo run --release -- upload path/to/your.geojson [table_name]

---

📚 API Overview

• process_and_upload_file(geojson_path: &str, table_name: Option<&str>): Uploads a GeoJSON file to the database, creating the table if necessary.
• parse_geojson_features(geojson_path: &str): Parses the features from a GeoJSON file.
• upload_features_copy(features: Vec<Feature>, table_name: Option<&str>): Uploads the features to the database using the COPY command.
• Table and column listing, row counting, and PostGIS support checks available in the read module.

---

📝 Example Output

🔄 Attempting to process file: data/nuts3_2024_regions_eez_w_eez.geojson, table: nuts3_2024_regions_eez_w_eez
🔄 Processing features in data/nuts3_2024_regions_eez_w_eez.geojson
⏳ Closing copy operation...
✅ Copy operation completed successfully!!

---

🧪 Testing

To run tests:

cargo test

---

🗂️ Project Structure

• src/write/: Functions for uploading and managing GeoJSON data in PostgreSQL.
• src/read/: Functions for querying tables, columns, and row counts.
• src/main.rs: Example and CLI entry point.

---

🙏 Contributing

Pull requests are welcome! For major changes, please open an issue first to discuss your ideas.

---

📄 License

MIT

---

📞 Contact

For questions or support, please open an issue on GitHub.