Skip to content

AI-Eng Template adoption#2

Merged
aravind-3105 merged 239 commits into
mainfrom
template-adoption
Apr 24, 2026
Merged

AI-Eng Template adoption#2
aravind-3105 merged 239 commits into
mainfrom
template-adoption

Conversation

@aravind-3105
Copy link
Copy Markdown
Member

@aravind-3105 aravind-3105 commented Apr 23, 2026

This pull request sets up foundational project infrastructure for development, contribution, and automation. It introduces standard community files, pre-commit hooks, and multiple GitHub Actions workflows for CI/CD, testing, and publishing. The changes also add templates to guide contributors in submitting issues and pull requests.

Project automation and CI/CD:

  • Added GitHub Actions workflows for code checks, documentation build and deploy, unit tests, integration tests, and package publishing to PyPI and GitHub Releases. These workflows automate linting, testing, coverage reporting, docs deployment, and publishing processes. (.github/workflows/code_checks.yml, .github/workflows/docs.yml, .github/workflows/unit_tests.yml, .github/workflows/integration_tests.yml, .github/workflows/publish.yml) [1] [2] [3] [4] [5]

  • Added a Dependabot configuration to keep GitHub Actions and uv dependencies up to date automatically. (.github/dependabot.yml)

Development standards and contribution guidelines:

  • Introduced a pre-commit configuration with hooks for code formatting, linting, type checking, and testing, ensuring code quality and consistency. (.pre-commit-config.yaml)
  • Added Python version specification and recommended tools/configs for local development. (.python-version, .github/ISSUE_TEMPLATE/config.yml) [1] [2]
  • Added CONTRIBUTING.md with guidelines for code style, pre-commit usage, and PR submission.
  • Added CODE_OF_CONDUCT.md to establish standards for community behavior.

Templates for collaboration:

  • Added issue templates for bug reports and feature requests, and a pull request template to standardize and streamline contributions. (.github/ISSUE_TEMPLATE/bug_report.md, .github/ISSUE_TEMPLATE/feature_request.md, .github/pull_request_template.md) [1] [2] [3]

These changes lay the groundwork for a robust, collaborative, and high-quality open source project.

nerdai and others added 30 commits January 20, 2025 16:15
@nerdai
start template
aa05e02
@nerdai
Create LICENSE
9821973
@nerdai
add foobar and tests
7b4ba13
@nerdai
Workflows and Pre-Commits (#1)
e38f1d4 
* others

* add groups

* wip

* add some workflows

* wip

* wip

* wip

* lint

* comment out code cov for now
@nerdai
nit (#2)
0264526
@nerdai
publish workflow (#3)
307f05d
@nerdai
docs (#4)
d27deca 
* docs

* docs workflow
@nerdai
deploy docs (#5)
cee0fed
@nerdai
fix (#6)
b00d2ab
@nerdai
Create deploy_docs.yml
395fa39
@nerdai
fix (#7)
e07edbe
@nerdai
add static (#8)
08c4cc2
@nerdai
use submodules (#9)
0634593
@nerdai
Update README.md
5237d52
@nerdai
rename (#10)
4e927a2
@nerdai
Create static.yml
a689e3a
@nerdai
Uncomment cov step in test workflows (#11)
083792d 
* uncomment cov step

* fix cmd

* delete static.yml

* oops forgot one
@nerdai
Update README (#12)
49aa89d 
* add badges

* add badges and table

* nit
@nerdai
add a couple more cmds (#13)
0716d82 
* udpate table

* nit
@nerdai
add cache command, fix poetry init to poetry new (#14)
7bb02aa
@nerdai
rm (#15)
7eba4be
@amrit110
Add empty .nojekyll file before docs deploy (#16)
231f9e7
@nerdai
add missing static files (#17)
9efb005
@nerdai
update usage guide (#18)
0a7468b
@amrit110
Create dependabot.yml
ee14fd3
@dependabot
Bump pypa/gh-action-pypi-publish from 1.10.3 to 1.12.4 (#19)
80f2772 
Bumps [pypa/gh-action-pypi-publish](https://github.com/pypa/gh-action-pypi-publish) from 1.10.3 to 1.12.4.
- [Release notes](https://github.com/pypa/gh-action-pypi-publish/releases)
- [Commits](pypa/gh-action-pypi-publish@f760068...76f52bc)

---
updated-dependencies:
- dependency-name: pypa/gh-action-pypi-publish
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@dependabot
Bump actions/checkout from 4.2.0 to 4.2.2 (#21)
5cacbfa 
Bumps [actions/checkout](https://github.com/actions/checkout) from 4.2.0 to 4.2.2.
- [Release notes](https://github.com/actions/checkout/releases)
- [Changelog](https://github.com/actions/checkout/blob/main/CHANGELOG.md)
- [Commits](actions/checkout@v4.2.0...v4.2.2)

---
updated-dependencies:
- dependency-name: actions/checkout
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@dependabot
Bump JamesIves/github-pages-deploy-action from 4.6.8 to 4.7.2 (#20)
9c46257 
Bumps [JamesIves/github-pages-deploy-action](https://github.com/jamesives/github-pages-deploy-action) from 4.6.8 to 4.7.2.
- [Release notes](https://github.com/jamesives/github-pages-deploy-action/releases)
- [Commits](JamesIves/github-pages-deploy-action@v4.6.8...v4.7.2)

---
updated-dependencies:
- dependency-name: JamesIves/github-pages-deploy-action
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@nerdai
Add sphinx-autobuild and make-serve to build and serve docs locally (…
d2b54ae 
…#22)

* add sphinx-autobuild and make serve command

* add a note on make serve in user_guide.md
@amrit110
Remove poetry references (#23)
9cac672
dependabot Bot and others added 25 commits March 30, 2026 09:18
@dependabot
Bump ruff from 0.15.7 to 0.15.8 (#194)
c07e197 
* Bump ruff from 0.15.7 to 0.15.8

Bumps [ruff](https://github.com/astral-sh/ruff) from 0.15.7 to 0.15.8.
- [Release notes](https://github.com/astral-sh/ruff/releases)
- [Changelog](https://github.com/astral-sh/ruff/blob/main/CHANGELOG.md)
- [Commits](astral-sh/ruff@0.15.7...0.15.8)

---
updated-dependencies:
- dependency-name: ruff
  dependency-version: 0.15.8
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

* chore: bump requests to 2.33.0 to fix CVE-2026-25645

Co-authored-by: aieng-bot <aieng-bot@vectorinstitute.ai>

* chore: bump pygments to 2.20.0 to fix CVE-2026-4539

Also bumps pymdown-extensions to 10.21.2 for compatibility
with pygments>=2.20.0 (fixes filename=None regression).

Co-authored-by: aieng-bot <aieng-bot@vectorinstitute.ai>

* ci: trigger CI for pygments/pymdownx security fixes

Co-authored-by: aieng-bot <aieng-bot@vectorinstitute.ai>

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: aieng-bot[bot] <aieng-bot@vectorinstitute.ai>
@dependabot
chore: bump pygments to 2.20.0 to fix CVE-2026-4539 (#193)
6ab38c0 
Pins pygments>=2.20.0 in docs dependencies to address the ReDoS
vulnerability CVE-2026-4539 affecting pygments up to 2.19.2.

Co-authored-by: aieng-bot[bot] <aieng-bot@vectorinstitute.ai>
@pre-commit-ci
[pre-commit.ci] pre-commit autoupdate (#198)
f1177d5 
updates:
- [github.com/astral-sh/uv-pre-commit: 0.10.12 → 0.11.2](astral-sh/uv-pre-commit@0.10.12...0.11.2)
- [github.com/astral-sh/ruff-pre-commit: v0.15.7 → v0.15.8](astral-sh/ruff-pre-commit@v0.15.7...v0.15.8)

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
@dependabot
chore: bump requests from 2.33.0 to 2.33.1 (#197)
a6309a1 
Bumps [requests](https://github.com/psf/requests) from 2.33.0 to 2.33.1.
- [Release notes](https://github.com/psf/requests/releases)
- [Changelog](https://github.com/psf/requests/blob/main/HISTORY.md)
- [Commits](psf/requests@v2.33.0...v2.33.1)

---
updated-dependencies:
- dependency-name: requests
  dependency-version: 2.33.1
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@dependabot
chore: bump astral-sh/setup-uv from 7.6.0 to 8.0.0 (#196)
ac18c25 
Bumps [astral-sh/setup-uv](https://github.com/astral-sh/setup-uv) from 7.6.0 to 8.0.0.
- [Release notes](https://github.com/astral-sh/setup-uv/releases)
- [Commits](astral-sh/setup-uv@v7.6.0...v8.0.0)

---
updated-dependencies:
- dependency-name: astral-sh/setup-uv
  dependency-version: 8.0.0
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@dependabot
chore: bump mypy from 1.19.1 to 1.20.0 (#199)
8ab12f7 
Bumps [mypy](https://github.com/python/mypy) from 1.19.1 to 1.20.0.
- [Changelog](https://github.com/python/mypy/blob/master/CHANGELOG.md)
- [Commits](python/mypy@v1.19.1...v1.20.0)

---
updated-dependencies:
- dependency-name: mypy
  dependency-version: 1.20.0
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@dependabot
chore: bump ruff from 0.15.8 to 0.15.9 (#200)
166b7c8 
Bumps [ruff](https://github.com/astral-sh/ruff) from 0.15.8 to 0.15.9.
- [Release notes](https://github.com/astral-sh/ruff/releases)
- [Changelog](https://github.com/astral-sh/ruff/blob/main/CHANGELOG.md)
- [Commits](astral-sh/ruff@0.15.8...0.15.9)

---
updated-dependencies:
- dependency-name: ruff
  dependency-version: 0.15.9
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@pre-commit-ci
[pre-commit.ci] pre-commit autoupdate (#201)
43a2ebc 
updates:
- [github.com/astral-sh/uv-pre-commit: 0.11.2 → 0.11.3](astral-sh/uv-pre-commit@0.11.2...0.11.3)
- [github.com/astral-sh/ruff-pre-commit: v0.15.8 → v0.15.9](astral-sh/ruff-pre-commit@v0.15.8...v0.15.9)
- [github.com/pre-commit/mirrors-mypy: v1.19.1 → v1.20.0](pre-commit/mirrors-mypy@v1.19.1...v1.20.0)

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
@dependabot
chore: bump pypa/gh-action-pypi-publish from 1.13.0 to 1.14.0 (#202)
a42d82d 
Bumps [pypa/gh-action-pypi-publish](https://github.com/pypa/gh-action-pypi-publish) from 1.13.0 to 1.14.0.
- [Release notes](https://github.com/pypa/gh-action-pypi-publish/releases)
- [Commits](pypa/gh-action-pypi-publish@ed0c539...cef2210)

---
updated-dependencies:
- dependency-name: pypa/gh-action-pypi-publish
  dependency-version: 1.14.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@dependabot
chore: bump pytest from 9.0.2 to 9.0.3 (#203)
a52b61c 
Bumps [pytest](https://github.com/pytest-dev/pytest) from 9.0.2 to 9.0.3.
- [Release notes](https://github.com/pytest-dev/pytest/releases)
- [Changelog](https://github.com/pytest-dev/pytest/blob/main/CHANGELOG.rst)
- [Commits](pytest-dev/pytest@9.0.2...9.0.3)

---
updated-dependencies:
- dependency-name: pytest
  dependency-version: 9.0.3
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@dependabot
chore: bump ruff from 0.15.9 to 0.15.10 (#204)
9e23a15 
Bumps [ruff](https://github.com/astral-sh/ruff) from 0.15.9 to 0.15.10.
- [Release notes](https://github.com/astral-sh/ruff/releases)
- [Changelog](https://github.com/astral-sh/ruff/blob/main/CHANGELOG.md)
- [Commits](astral-sh/ruff@0.15.9...0.15.10)

---
updated-dependencies:
- dependency-name: ruff
  dependency-version: 0.15.10
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@AnanyaRaval
Fix publish.yml to give write permissions to github (#207)
0a856f2
@pre-commit-ci
[pre-commit.ci] pre-commit autoupdate (#206)
345e3c6 
updates:
- [github.com/astral-sh/uv-pre-commit: 0.11.3 → 0.11.6](astral-sh/uv-pre-commit@0.11.3...0.11.6)
- [github.com/astral-sh/ruff-pre-commit: v0.15.9 → v0.15.10](astral-sh/ruff-pre-commit@v0.15.9...v0.15.10)
- [github.com/pre-commit/mirrors-mypy: v1.20.0 → v1.20.1](pre-commit/mirrors-mypy@v1.20.0...v1.20.1)

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
@dependabot
chore: bump mypy from 1.20.0 to 1.20.1 (#205)
d38b438 
Bumps [mypy](https://github.com/python/mypy) from 1.20.0 to 1.20.1.
- [Changelog](https://github.com/python/mypy/blob/master/CHANGELOG.md)
- [Commits](python/mypy@v1.20.0...v1.20.1)

---
updated-dependencies:
- dependency-name: mypy
  dependency-version: 1.20.1
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@dependabot
chore: bump mkdocstrings from 1.0.3 to 1.0.4 (#209)
e41ed83 
Bumps [mkdocstrings](https://github.com/mkdocstrings/mkdocstrings) from 1.0.3 to 1.0.4.
- [Release notes](https://github.com/mkdocstrings/mkdocstrings/releases)
- [Changelog](https://github.com/mkdocstrings/mkdocstrings/blob/main/CHANGELOG.md)
- [Commits](mkdocstrings/mkdocstrings@1.0.3...1.0.4)

---
updated-dependencies:
- dependency-name: mkdocstrings
  dependency-version: 1.0.4
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@dependabot
chore: bump filelock from 3.25.2 to 3.28.0 (#208)
ef9fc55 
Bumps [filelock](https://github.com/tox-dev/py-filelock) from 3.25.2 to 3.28.0.
- [Release notes](https://github.com/tox-dev/py-filelock/releases)
- [Changelog](https://github.com/tox-dev/filelock/blob/main/docs/changelog.rst)
- [Commits](tox-dev/filelock@3.25.2...3.28.0)

---
updated-dependencies:
- dependency-name: filelock
  dependency-version: 3.28.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@amrit110
ci: switch to PyPI Trusted Publishers and bump to v0.1.1
38611be
@amrit110
chore: uv lock
69d47cb
@dependabot
chore: bump ruff from 0.15.10 to 0.15.11 (#211)
be0e71e 
Bumps [ruff](https://github.com/astral-sh/ruff) from 0.15.10 to 0.15.11.
- [Release notes](https://github.com/astral-sh/ruff/releases)
- [Changelog](https://github.com/astral-sh/ruff/blob/main/CHANGELOG.md)
- [Commits](astral-sh/ruff@0.15.10...0.15.11)

---
updated-dependencies:
- dependency-name: ruff
  dependency-version: 0.15.11
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@dependabot
chore: bump astral-sh/setup-uv from 8.0.0 to 8.1.0 (#210)
2d7c6c1 
Bumps [astral-sh/setup-uv](https://github.com/astral-sh/setup-uv) from 8.0.0 to 8.1.0.
- [Release notes](https://github.com/astral-sh/setup-uv/releases)
- [Commits](astral-sh/setup-uv@v8.0.0...v8.1.0)

---
updated-dependencies:
- dependency-name: astral-sh/setup-uv
  dependency-version: 8.1.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@dependabot
chore: bump filelock from 3.28.0 to 3.29.0 (#212)
9a7887c 
Bumps [filelock](https://github.com/tox-dev/py-filelock) from 3.28.0 to 3.29.0.
- [Release notes](https://github.com/tox-dev/py-filelock/releases)
- [Changelog](https://github.com/tox-dev/filelock/blob/main/docs/changelog.rst)
- [Commits](tox-dev/filelock@3.28.0...3.29.0)

---
updated-dependencies:
- dependency-name: filelock
  dependency-version: 3.29.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@pre-commit-ci
[pre-commit.ci] pre-commit autoupdate (#213)
4019ad6 
updates:
- [github.com/astral-sh/uv-pre-commit: 0.11.6 → 0.11.7](astral-sh/uv-pre-commit@0.11.6...0.11.7)
- [github.com/astral-sh/ruff-pre-commit: v0.15.10 → v0.15.11](astral-sh/ruff-pre-commit@v0.15.10...v0.15.11)

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
@dependabot
chore: bump pre-commit from 4.5.1 to 4.6.0 (#215)
e3297c3 
Bumps [pre-commit](https://github.com/pre-commit/pre-commit) from 4.5.1 to 4.6.0.
- [Release notes](https://github.com/pre-commit/pre-commit/releases)
- [Changelog](https://github.com/pre-commit/pre-commit/blob/main/CHANGELOG.md)
- [Commits](pre-commit/pre-commit@v4.5.1...v4.6.0)

---
updated-dependencies:
- dependency-name: pre-commit
  dependency-version: 4.6.0
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@dependabot
chore: bump mypy from 1.20.1 to 1.20.2 (#214)
12d2d58 
Bumps [mypy](https://github.com/python/mypy) from 1.20.1 to 1.20.2.
- [Changelog](https://github.com/python/mypy/blob/master/CHANGELOG.md)
- [Commits](python/mypy@v1.20.1...v1.20.2)

---
updated-dependencies:
- dependency-name: mypy
  dependency-version: 1.20.2
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@aravind-3105
Merge remote-tracking branch 'template-repo/main' into template-adoption
e54770d
@aravind-3105 aravind-3105 self-assigned this Apr 23, 2026
@aravind-3105
refactor: rename project from aieng-template-uv to humanibench
c1320a2 
- Updated project name and description in pyproject.toml and other configuration files.
- Adjusted repository links in mkdocs.yml, README.md, and GitHub workflows.
- Modified pre-commit configuration to exclude certain directories and updated hook settings.
- Removed deprecated files related to the previous project structure.
- Ensured all references to the old project name are replaced with the new name.

This commit reflects a comprehensive rebranding of the project to align with its new focus on human-centric benchmarks for large multimodal models.
@aravind-3105
chore: update pre-commit configuration and mypy settings
5ebfa3a 
- Modified mypy hook in .pre-commit-config.yaml to use a specific entry point and added arguments for configuration and source directory.
- Updated mypy version pin in pre-commit configuration to v1.45.1 for stability.
- Added mypy overrides in pyproject.toml to relax type checking for specific modules, allowing untyped calls and checking untyped definitions.
- Disabled certain mypy error codes to accommodate third-party stubs while maintaining overall type checking integrity.
@aravind-3105
fix: correct message formatting in OpenAI inference script
97f050b 
- Updated the message structure in the OpenAI small inference script to ensure proper variable interpolation for the question text.
- Adjusted the way conversation messages are passed to the chat completion client, enhancing the clarity and functionality of the code.
@aravind-3105 aravind-3105 merged commit 8f91208 into main Apr 24, 2026
5 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

@aravind-3105 aravind-3105

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

7 participants

@aravind-3105 @nerdai @amrit110 @fcogidi @AnanyaRaval @emersodb @lotif