v1.2.1

Summary

This patch release refines how the service handles filesystem paths. Paths supplied by the Metadata Editor are now consistently resolved to their canonical form and validated against STORAGE_PATH before use, aligning all file endpoints on a single validation approach introduced in 1.2.0.

Changes

• Added a unified resolve_safe_path() helper that normalizes paths and enforces the STORAGE_PATH boundary
• Updated CSV, geospatial, and core file endpoints to use the resolved canonical path for all filesystem access
• No API or configuration changes

v1.2.0

Version 1.2.0

Upgrade notes

• Set STORAGE_PATH in .env — required; copy from .env.example (absolute path recommended, or empty for local dev only)
• Default host is 127.0.0.1 — update .env if you previously bound to all interfaces
• Job store uses SQLite — use ./start.sh --clear-jobs (or start.bat --clear-jobs) to reset the queue after upgrade

New features

• Added timeseries/indicators support for storing indicator data, validating imports (CSV structure, values, and frequency), and querying datasets via a DuckDB-backed API
• Added optional AI metadata reviewer via ai4data (see README-reviewer.md)
• Added geospatial metadata endpoints with installation guide (see README-geospatial.md)
• Added SQLite job persistence with FIFO ordering and audit logging

Data processing improvements

• Added chunked DTA read and export for large microdata files
• Added pandas fallback for Stata files with legacy-encoded notes/labels that pyreadstat cannot decode
• Improved weight handling for integer and float fields
• Reduced CSV export memory use with threshold-gated optimized loading

Security & configuration

• Required explicit STORAGE_PATH in .env; application refuses to start if missing
• Default bind address 127.0.0.1 in start scripts, deploy scripts, and .env.example

Operations & deployment

• Improved logging with daily file rotation, timestamps, and crash handlers
• Added Linux systemd deployment guide (deploy/linux/README.md)
• Added Windows NSSM deployment guide (deploy/windows/README.md)
• Rewrote README with Conda, .venv, and install/run instructions for local and production use

V1.1.0

New Features

• Added geometadatatools library - (external module) for geospatial data analysis and metadata extraction
• Added parameter version to support exporting to various versions of Stata (8-15)
• Added extended special missing value support for Stata - .a to .z

V1.0.0

Version 1.0

New Features

• Added bash scripts for application start/stop management (start.sh, stop.sh)
• Added version tracking for application versioning
• Added logs folder with automatic log file management
• Added error logging system for better debugging and monitoring
• Added job queue cleanup support for background task management

Data Processing Improvements

• Improved Stata handling for special missing values (.a, .b, .c)
• Improved SPSS handling for string value/labels compatibility
• Added multiple encoding support for reading of SPSS, Stata, and CSV file reading (UTF-8, Latin-1, etc.)

Directory Structure Changes

• PID files now stored in logs/app.pid (was app.pid)
• Log files automatically created in logs/ directory
• Jobs directory automatically created for background tasks