Skip to content

Release/v0.2.12#50

Merged
thomashebrard merged 28 commits intomainfrom
release/v0.2.12
Jun 3, 2025
Merged

Release/v0.2.12#50
thomashebrard merged 28 commits intomainfrom
release/v0.2.12

Conversation

@thomashebrard
Copy link
Copy Markdown
Member

@thomashebrard thomashebrard commented Jun 3, 2025 •
edited
Loading

🔗 Related Issues

📝 Description

[v0.2.12] - 2025-06-03

  • pipelex cli: Split pipelex init into 2 separate functions: pipelex init-libraries and pipelex init-config
  • Fixed the inheritance config manager method
  • Rename Mission to Pipeline
  • Enable to start a pipeline and let in run in the background, getting it's run id, but not waiting for the output
  • Makefile: avoid defaulting pytest to verbose. Setup target make test-xdist = Run unit tests with xdist, make it the default for shorthand make t. The old make t is now make tp (test-with-prints)
  • Added mistral-small-3.1 and qwen3:8b
  • Fix template pre-processor: don't try and substitute a dollar numerical like $10 or @25
  • Refactor with less "OpenAI" naming for non-openai stuff that just uses the OpenAI SDK

🔄 Type of Change

  • 🐛 Bug fix
  • ✨ New feature
  • 💥 Breaking change
  • 📚 Documentation update
  • 🧹 Code refactor
  • ⚡ Performance improvement
  • ✅ Test update

🧪 Tests

📋 Checklist

  • Linting / type-checking / unit tests pass locally with my changes
  • I've added tests that prove my fix is effective or that my feature works
  • My code follows the style guidelines of this project
  • I've made corresponding changes to the documentation
  • My changes generate no new warnings

thomashebrard and others added 25 commits May 31, 2025 15:39
@thomashebrard
fix/guard-branch
1471576
@thomashebrard
fix/guard-branch (#26)
6ece457
@thomashebrard
bump-version to 0.2.10
4ee63e9
@thomashebrard
Merge branch 'release/v0.2.10' into dev
a2e4230
@thomashebrard
Merge pull request #27 from Pipelex/dev
816c052 
dev to release/v0.2.10
@thomashebrard
fix/python3>=11 (#24)
d9708b4 
* fix/python3>=11

* f

* fix makefile

* gha

* fix

* test

* e

* a

* ok

* t

* a

* lint
@thomashebrard
Fix/makefile python version (#30)
3a34c61 
* fix/tests-without-google cred

* fix/Makefile-python-version

* fix Makefile
@lchoquel
Add inference models & template optional insertion (#32)
e76c9b8 
### Features
- Template preprocessor new token prefix `@?` for **optional insertion**: if the variable doesn't exist in the context, nothing is inserted (instead of raising an exception).

### Models
- Added **Claude 4 Opus and Sonnet**, usable through the Anthropic SDK at Anthropic and Bedrock and usable with the Bedrock SDK. Includes a specific setting to reduce the max_tokens limit to avoid a timeout/streaming issue yet to be addressed later.
- Added support for the **Grok 3** family through the OpenAI SDK.
- Added support for **GPT4o image generation** through the OpenAI SDK, with the gpt-image-1 model. Available through PipeImgGen as an alternative to the Forest Lab (FAL) supported models. Currently saves local files, to be addressed.
- Added latest gemini-2.5-pro

### Base Library
- **Added Pipe:** extract_page_contents_and_views_from_pdf which not only grabs the text and linked images from PDF but also includes `page_view` images, i.e. pages rendered as images (very useful for using Vision down the line). This one used to be defined in the cookbook samples so, congrats on the promotion.

### Refactor
- Improved **error handling** in several places regarding inference
- Moved cogt tests into the tests/pipelex so they can share fixtures, currently used for imgg_handle (image generation handle)

### Fixes
- Fixed integration of **Perplexity**, broken by recent changes

### Dependencies
- Updated **instructor** to 1.8.3
- Dev: replaced pytest-pretty by **pytest-sugar** because pytest-pretty truncates test-case names just to make it fit into a pretty rich table. Function before fashion.

### 🔄 Type of Change
- [x] 🐛 Bug fix
- [X] ✨ New feature
- [ ] 💥 Breaking change
- [ ] 📚 Documentation update
- [X] 🧹 Code refactor
- [ ] ⚡ Performance improvement
- [X] ✅ Test update

### 🧪 Tests
- TestTemplatePreprocessor
- TestImggByOpenAIGpt
- TestImageGeneration
- TestPipeImgg
@thomashebrard
Merge branch 'release/v0.2.10' into dev
8a747b1
@thomashebrard @lchoquel
dev to release/v0.2.10 (#31)
e5964f6 
* fix/python3>=11 (#24)

* fix/python3>=11

* f

* fix makefile

* gha

* fix

* test

* e

* a

* ok

* t

* a

* lint

* Fix/makefile python version (#30)

* fix/tests-without-google cred

* fix/Makefile-python-version

* fix Makefile

* Add inference models & template optional insertion (#32)

### Features
- Template preprocessor new token prefix `@?` for **optional insertion**: if the variable doesn't exist in the context, nothing is inserted (instead of raising an exception).

### Models
- Added **Claude 4 Opus and Sonnet**, usable through the Anthropic SDK at Anthropic and Bedrock and usable with the Bedrock SDK. Includes a specific setting to reduce the max_tokens limit to avoid a timeout/streaming issue yet to be addressed later.
- Added support for the **Grok 3** family through the OpenAI SDK.
- Added support for **GPT4o image generation** through the OpenAI SDK, with the gpt-image-1 model. Available through PipeImgGen as an alternative to the Forest Lab (FAL) supported models. Currently saves local files, to be addressed.
- Added latest gemini-2.5-pro

### Base Library
- **Added Pipe:** extract_page_contents_and_views_from_pdf which not only grabs the text and linked images from PDF but also includes `page_view` images, i.e. pages rendered as images (very useful for using Vision down the line). This one used to be defined in the cookbook samples so, congrats on the promotion.

### Refactor
- Improved **error handling** in several places regarding inference
- Moved cogt tests into the tests/pipelex so they can share fixtures, currently used for imgg_handle (image generation handle)

### Fixes
- Fixed integration of **Perplexity**, broken by recent changes

### Dependencies
- Updated **instructor** to 1.8.3
- Dev: replaced pytest-pretty by **pytest-sugar** because pytest-pretty truncates test-case names just to make it fit into a pretty rich table. Function before fashion.

### 🔄 Type of Change
- [x] 🐛 Bug fix
- [X] ✨ New feature
- [ ] 💥 Breaking change
- [ ] 📚 Documentation update
- [X] 🧹 Code refactor
- [ ] ⚡ Performance improvement
- [X] ✅ Test update

### 🧪 Tests
- TestTemplatePreprocessor
- TestImggByOpenAIGpt
- TestImageGeneration
- TestPipeImgg

---------

Co-authored-by: Louis Choquel <lchoquel@users.noreply.github.com>
@lchoquel
Changelog
902e6ae
@thomashebrard
fix/config-project-name (#33)
f79fe89
@thomashebrard
Merge branch 'release/v0.2.10' into dev
3c19125
@lchoquel
Refactor/move plugin package up (#35)
697fc73 
- Moved “plugin” to the same level as “cogt” within **pipelex** for better visibility
- Major cleanup in the unit tests: hierarchy largely flattened
- Added **pytest-xdist** to run unit tests in parallel on multiple CPUs. Not yet integrated into the Makefile, so run it manually with `pytest -n auto` or `pytest -n auto -m "llm"`
- Added `make test-quiet` (shorthand `tq`) to Makefile to run tests without capturing outputs (i.e. without pytest `-s` option)
- Stopped using Fixtures for `pipe_router` and `content_generator`: we're now always getting the singleton from `pipelex.hub`
@lchoquel
Rename plugins package, move its config, move constants to config (#38)
3593a8d 
### 🔗 Related Issues

### 📝 Description

- Rename plugins package and move its confg
- Use constants and defaults via configs instead of code magic numbers

### 🔄 Type of Change
- [ ] 🐛 Bug fix
- [ ] ✨ New feature
- [ ] 💥 Breaking change
- [ ] 📚 Documentation update
- [X] 🧹 Code refactor
- [ ] ⚡ Performance improvement
- [ ] ✅ Test update
@thomashebrard
Feature/python>=3.10 (#37)
b4819ab 
* fix/python-3.10

* update strenum

* add "3.10",  iin gha

* fix with backports

* to pipelex.types

* update kajson
@lchoquel
Merge branch 'main' into dev
bfedc33 
# Conflicts:
#	CHANGELOG.md
@thomashebrard
fix/pipelex_init-config (#40)
9cfc060 
- Add a specific config path that gets loaded right the all the previous ones.
- Use it test `pipelex/pipelex_init.toml` via TestConfigManager
- Fix pipelex/pipelex_init.toml`
@lchoquel
Merge branch 'main' into dev
bff90f0
@lchoquel
Feature/more open source models (#42)
87ab9ba 
### 📝 Description

- Added mistral-small-3.1 and qwen3:8b
- Fix template pre-processor: don't try and substitute a dollar numerical like $10 or @25
- Refactor with less "OpenAI" naming for non-openai stuff that just uses the OpenAI SDK

### 🔄 Type of Change
- [X] 🐛 Bug fix
- [X] ✨ New feature
- [ ] 💥 Breaking change
- [X] 📚 Documentation update
- [X] 🧹 Code refactor
- [ ] ⚡ Performance improvement
- [X] ✅ Test update
@thomashebrard
fix/config-load-inheritance-config (#44)
c84da15
@thomashebrard
fix/pipelex-init (#46)
ac1366f 
* fix/pipelex-init

* fix Makefile
@lchoquel
Refactor/rename pipeline (#45)
fddda66 
### 📝 Description

- rename Mission to Pipeline
- enable to start a pipeline and let in run in the background, getting it's run id, but not waiting for the output
- Makefile: avoid defaulting pytest to verbose. Setup target `make test-xdist` = Run unit tests with xdist, make it the default for shorthand `make t`. The old make t is now make tp (test-with-prints)

### 🔄 Type of Change
- [ ] 🐛 Bug fix
- [X] ✨ New feature
- [ ] 💥 Breaking change
- [ ] 📚 Documentation update
- [X] 🧹 Code refactor
- [ ] ⚡ Performance improvement
- [ ] ✅ Test update
@thomashebrard
Added changelog for 0.2.12 (#49)
4f7b4cf
@thomashebrard
Merge pull request #48 from Pipelex/dev
6fca9bb 
dev to release/v0.2.12
lchoquel
lchoquel previously approved these changes Jun 3, 2025
View reviewed changes
Copy link
Copy Markdown
Member

@lchoquel lchoquel left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

OK

@thomashebrard
Fixed Pipelex init cli (#51)
64d2a11 
* fix/cli-init

* update makefile

* make cc

* make lock

* fix makefile
@thomashebrard
Merge branch 'release/v0.2.12' into dev
e44c060
@thomashebrard
Merge pull request #53 from Pipelex/dev
2f563e8 
dev to release/v0.2.12
lchoquel
lchoquel approved these changes Jun 3, 2025
View reviewed changes
Copy link
Copy Markdown
Member

@lchoquel lchoquel left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@thomashebrard thomashebrard merged commit ee06444 into main Jun 3, 2025
18 checks passed
@github-actions github-actions Bot locked and limited conversation to collaborators Jun 3, 2025
@lchoquel lchoquel deleted the release/v0.2.12 branch June 9, 2025 12:54
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Reviewers

@lchoquel lchoquel lchoquel approved these changes

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@thomashebrard @lchoquel