Handle shared installer venvs by Python/platform compatibility

[Copilot]

The Unix installer currently reuses any existing venv at the requested path, which breaks when $HOME is shared across architectures or Python minor versions. This updates reuse logic to validate venv compatibility first and fall back to a versioned sibling path when needed.

• Compatibility check

  • Compare the current interpreter and the existing venv by architecture|major.minor.
  • Reuse only when both match.

• Deterministic fallback naming

  • When the requested venv path exists but is incompatible, use a suffixed sibling path:
    • mlcflow_x86_64_py3.11
    • mlcflow_aarch64_py3.12
  • The suffix is derived from normalized architecture and Python major/minor version.

• Installer behavior

  • Keep the originally requested directory untouched when incompatible.
  • Create or reuse the compatible suffixed directory instead.
  • Add helper functions to centralize suffix generation and compatibility detection.

• Coverage and docs

  • Add focused tests for:
    • fresh venv creation
    • compatible venv reuse
    • incompatible existing directory fallback
    • stubbed end-to-end installer main flow
  • Update install docs to describe the suffixed venv behavior.

• Example

  # requested path already exists but was created on another platform/Python
  --venv-dir ~/mlcflow
  
  # installer resolves to a compatible sibling such as
  ~/mlcflow_x86_64_py3.12

✅ PR Checklist

• Target branch is dev

📌 Note: PRs must be raised against dev. Do not commit directly to main.

✅ Testing & CI

• Have tested the changes in my local environment, else have properly conveyed in the PR description
• The change includes a GitHub Action to test the script(if it is possible to be added).
• No existing GitHub Actions are failing because of this change.

📚 Documentation

• README or help docs are updated for new features or changes.
• CLI help messages are meaningful and complete.

📁 File Hygiene & Output Handling

• No unintended files (e.g., logs, cache, temp files, pycache, output folders) are committed.

🛡️ Safety & Security

• No secrets or credentials are committed.
• Paths, shell commands, and environment handling are safe and portable.

🙌 Contribution Hygiene

• PR title and description are concise and clearly state the purpose of the change.
• All reviewer feedback has been addressed.

[arjunsuresh]

We should call the test in a suitable github action test

[arjunsuresh]

@copilot resolve the merge conflicts in this pull request

[github-actions]

MLCommons CLA bot All contributors have signed the MLCommons CLA ✍️ ✅

[github-actions]

🤖 AI PR Review Summary\n\nRefactor the Unix installer script to improve virtual environment (venv) compatibility handling by introducing platform and Python version suffixes to venv directories. This avoids overwriting incompatible venvs by creating or reusing platform- and Python-specific sibling directories. The PR centralizes architecture normalization and Python version extraction, enhances venv compatibility checks, and updates the GitHub workflow and documentation accordingly. Risks include potential edge cases in architecture normalization and compatibility detection, but extensive test coverage mitigates these. The design improves robustness and user experience when managing multiple Python environments.

[github-actions]

🤖 AI PR Review Summary\n\nRefactor the Unix installer script to improve virtual environment (venv) compatibility handling by introducing platform and Python version suffixes for venv directories. This avoids conflicts when multiple Python versions or architectures are used. The changes include defining helper functions for architecture normalization, Python version extraction, and compatibility checks. The installer now resolves and uses a compatible venv directory, removing stale incompatible ones. The workflow and documentation are updated accordingly. Risks include potential edge cases in architecture normalization and compatibility checks, but tests are added to validate behavior.

[Copilot]

@copilot resolve the merge conflicts in this pull request

Resolved in 39afc32 by merging dev into this branch and fixing the installer conflict; follow-up validation fixes are in b158902.

[arjunsuresh]

@copilot please address the above review comment

[Copilot]

@copilot please address the above review comment

Addressed in 3a97c5c.

[github-actions]

🤖 AI PR Review Summary\n\nThis PR improves the mlcflow Unix installer and related CI workflows by enhancing Python virtual environment compatibility handling based on platform and Python minor version. It introduces functions to normalize architecture names, generate compatibility signatures, and resolve or fallback virtual environment directories accordingly. The installer script now uses a configurable Python command variable and better logs compatibility decisions. The repo_action.py adds validation for extra_git_args to prevent injection of newlines or carriage returns and ensures type correctness. Minor fixes in GitHub workflows improve code clarity and robustness. Risks include potential edge cases in architecture normalization and compatibility checks, and the complexity of venv resolution logic, but overall changes improve maintainability and user experience.

[github-actions]

🤖 AI PR Review Summary\n\nThis PR improves the mlcflow Unix installer and related CI workflows by enhancing Python virtual environment compatibility checks and management. It introduces architecture normalization, Python version detection helpers, and a more robust mechanism to select or create compatible virtual environments based on platform and Python minor version. The PR also refactors subprocess error handling and adds validation for extra git arguments in repo actions. Documentation is updated to explain the new venv directory suffix behavior. Risks include potential edge cases in architecture normalization and compatibility detection, and the need to ensure backward compatibility with existing venvs. Overall, the design improves maintainability and user experience by avoiding venv conflicts across Python versions and platforms.

[arjunsuresh]

@copilot the format of the AI PR review comments are broken. Please fix it

[Copilot]

@copilot the format of the AI PR review comments are broken. Please fix it

Addressed in bdf2d80.

[github-actions]

🤖 AI PR Review Summary\n\nThis PR improves the AI PR review GitHub workflow by adding robust validation and base64 encoding/decoding for inline comments to handle special characters safely. It also refactors the Unix installer script to better handle Python virtual environments by detecting platform and Python minor version compatibility, creating or reusing suffixed venv directories accordingly. The installer now uses a configurable Python command variable and normalizes architecture names. Documentation is updated to explain the new venv suffix behavior. Risks include potential shell compatibility issues with the new base64 decoding approach and subtle bugs in venv compatibility detection, but overall the changes improve reliability and maintainability.