Skip to content

PolyglotMiner v1.0.1

Latest
Latest

Choose a tag to compare

View all tags
@SariYanouche SariYanouche released this 08 Sep 23:50
v1.0.1
fe6e391

PyPI
License: MIT
Python Version

PolyglotMiner v1.0.1 is now officially published on PyPI! This release brings major performance optimizations, directed migration harvesting, false-positive elimination heuristics, an interactive Web Analytics Studio, and automated CLI tools.

📦 Quick Installation

You can now install PolyglotMiner directly from PyPI on any machine:

pip install polyglotminer

Verify your installation:

polyglotminer doctor
polyglotminer --version

🚀 What's New in v1.0.1

1. Official PyPI Distribution

  • Published to the Python Package Index (polyglotminer).
  • Both polyglotminer and its short alias pgminer are automatically added to your system PATH.

2. Directed Migration Pair Mining (-p, --pairs)

  • Harvest and analyze only repositories exhibiting specific cross-language transitions: 
    polyglotminer campaign -p "C->C++,JS->TS" --workers 4 --limit 50 --open
  • Integrated automated language normalization and targeted discovery filtering.

3. High-Throughput Multiprocess Campaign Engine

  • Worker Process Recycling (maxtasksperchild=25): Guarantees 100% OS-level memory reclamation after analyzing large repositories.
  • Watchdog Protection: 75-second timeout per repository prevents pathological repositories from stalling the batch queue.
  • Persistent Resume State: SQLite WAL tracking ensures failed or timed-out repositories are recorded and skipped automatically on subsequent runs.
  • Mining throughputs exceeding 70+ repositories per minute in blobless Empirical Module mode.

4. Rigorous Heuristics & False-Positive Elimination

  • Header Pairing Exclusion: Strictly eliminates false C/C++/Objective-C pairings (.h vs .c/.cpp/.m).
  • Rename/Move Filter: Discards identical file renames and pure directory relocations.
  • DevOps Script Exclusion: Excludes shell scripts (.sh, .bat), Dockerfiles, and CI workflow configurations from primary migration candidate detection.

5. Interactive Web Analytics Studio

  • Launch with polyglotminer ui --port 8080.
  • Graph Navigator & Spotlight Views: Longitudinal volume dynamics, 100% dominance curves, and state-space turnover trajectories.
  • Academic Export Suite: 1-click generation of LaTeX booktabs tables, high-resolution figures (300 DPI PNG), and raw CSV datasets.

6. Developer & CLI Ergonomics

  • Interactive Terminal Wizard (TUI): Launch polyglotminer without arguments to access an interactive guided workflow.
  • System Doctor (polyglotminer doctor): Built-in diagnostics for Python version, Git CLI, authentication tokens, rate-limits, and SQLite database connectivity.
  • Zero-Config Shell Completion (polyglotminer completion --install): Instant tab autocompletion support for PowerShell, Bash, Zsh, and Fish.

🧪 Verification & Test Suite

  • 100% automated test suite passing (74 unit tests covering CLI smoke tests, multi-worker campaign pipelines, heuristic edge-cases, SQLite persistence, and token fallbacks): 
    python -m unittest discover tests

📖 Documentation & Links

Assets 2
Loading