v0.1.16

Key Highlights

1. Support for Sharepoint loader with authorized identities and extended metadata
2. Updated pebblo-classifier to Version 9 with improved topic accuracy
3. Support for Postgress PGVector VectorDB for identity and semantic-topic enforcement
4. Documentation updates for PebbloRetrieval chain with samples for identity and semantic-topic enforcement

What's Changed

• Adding lint fixes by @dristysrivastava in #380
• Updated UT and minor linting fixes by @shreyas-damle in #381
• Updated documentation for Pebblo UI by @rutujaac in #387
• Documentation for PebbloRetrievalQA chain by @Raj725 in #388
• SafeRetriever docs and README updates by @srics in #389
• Updating field validator for prompt API by @dristysrivastava in #379
• Handle bubble chart height for last number of finding data by @rutujaac in #383
• Skip pkg cache to avoid hash mistmatch by @srics in #384
• Fix test pypi pkg naming to include yr.mo.dt.hh.mm by @srics in #385
• Add GoogleDriveLoader to the list of supported loaders by Pebblo by @rahul-trip in #390
• Cleaning up discovery API response by @dristysrivastava in #396
• added changes to integrate v9 version of topic classifier by @gr8nishan in #397
• Updating sensitive data for different classification by @dineshkrr in #394
• Update langchain library versions and imports in the sample apps by @Raj725 in #398
• Add docs for Semantic Enforcement RAG using PebbloRetrievalQA by @Raj725 in #392
• add sharepoint retriever app. by @rahul-trip in #399
• Update release version by @srics in #400

New Contributors

• @dineshkrr made their first contribution in #394

Full Changelog: v0.1.15...v0.1.16

v0.1.15

Key Highlights

• Dedicated Safe Retriever Local UI page for Visualization of AI apps using PebbloRetrievalChain
• Visualize top users using LLM inference, including their authorization groups
• Visualize top documents retrieved from Vector DB to facilitate data governance and compliance
• Kubernetes deployment of pebblo server docker image
• Updated samples with upstreamed langchain-google pkg for authorization enabled GoogleDriveLoader
• Extended metadata support for GoogleDriveLoader - document paths, names, and sizes
• Initial Pebblo support for LlamaIndex
• Topic and Entity name enhancements in pebblo-schema

What's Changed

• Log and print statement were not working in topic classfiier by @gr8nishan in #309
• Changes for showing pebblo server and client version on DAXA UI. by @dristysrivastava in #319
• Entity Classifier Fix by @shreyas-damle in #325
• Removed text capitalize on file name in local UI by @rutujaac in #327
• Updating entities and Topics names from human readable format to programming format by @dristysrivastava in #306
• Added keyword to string mapping in reports and ui by @rutujaac in #326
• Example for Llama PebbloSafeReader by @yograjopcito in #313
• Docker repo fix by @siddheshwar-more in #328
• Use GoogleDriveLoader from langchain_google_community by @Raj725 in #337
• Added make command to format all/changed files by @Raj725 in #340
• Update rag.md for pebblo environment variable by @rahul-trip in #348
• Update Identity and Semantic enforcement samples (PebbloRetrievalQA) by @Raj725 in #335
• Docs and version updates by @srics in #357
• Remove spell check in CI lint pipeline by @srics in #367
• Unit test trigger on tests by @siddheshwar-more in #366
• Pebblo k8s deployment by @siddheshwar-more in #362
• Topic classifier fixes - Normal text in findings, Lint errors by @Raj725 in #370
• Pebblo redirection and download report URL fix by @rutujaac in #354
• Pebblo Safe Retriever details in Local UI by @shreyas-damle in #353
• Adding python dateutil package by @dristysrivastava in #374
• Fix Local UI issues by @rutujaac in #375
• Update samples: Import PebbloRetrievalQA from langchain_community by @Raj725 in #364
• Capitalize app names for local UI by @rutujaac in #376
• source_aggr_size renamed to source_aggregate_size in loader/doc API. by @shreyas-damle in #378
• Add sort by date recent for active users and docs by @rutujaac in #377

New Contributors

• @gr8nishan made their first contribution in #309
• @yograjopcito made their first contribution in #313

Full Changelog: v0.1.14...v0.1.15

v0.1.14

Key highlights

• [Local UI / Reporting] Display authorized identities in ingested documents
• [Local UI / Reporting] Display RAG document snippet authorized identities
• Bubble chart of top semantic topics ingested into Vector DB
• Add support for Pebblo Cloud API - to display Gen-AI apps in Daxa UI
• Docker support for pebblo-server installation and deployment
• Add SafeRetriever sample with Identity and Semantic Topic enforcement

What's Changed

• Add Pebblo SafeLoader and SafeRetriever by @srics in #273
• MyPy Config Changes by @siddheshwar-more in #274
• Update SafeLoader and SafeRetriever by @srics in #276
• Fix spelling errors by @rutujaac in #284
• Pebblo Docs - Add different reports examples in Config tab by @rutujaac in #283
• Add timezone to local UI dates by @rutujaac in #287
• Updated Snippet tab in Pebblo UI by @rutujaac in #270
• Add UT for reports module by @rutujaac in #258
• Pebblo identity rag demo by @Raj725 in #290
• Added Pebblo Cloud Sample App by @shreyas-damle in #292
• Added Empty state for Reports by @rutujaac in #285
• Pebblo UI - Handle null states for objects by @rutujaac in #294
• Added readme and requirements file for pebblo cloud sample by @shreyas-damle in #295
• Update download url for pip install by @siddheshwar-more in #298
• Added changes for Docker image by @siddheshwar-more in #277
• Pebblo Docker README and Installation guide changes by @siddheshwar-more in #299
• Loader doc response changes for Pebblo Cloud initial work by @shreyas-damle in #297
• Docker config pebblo by @siddheshwar-more in #301
• Pebblo install using *.whl file download by @siddheshwar-more in #300
• Allow CORS by @dristysrivastava in #302
• Adding pebblo client as well as server version for local UI and reports by @dristysrivastava in #303
• Added pebblo version on reports and local UI by @rutujaac in #304
• Added bubble chart for findings by @rutujaac in #305
• Fixed breaking Local UI by @shreyas-damle in #310
• Fixed bubble chart render by @rutujaac in #311
• Add samples for retrieval with Identity & Semantic Enforcement by @Raj725 in #307
• Authorized Identity - backend changes to show authorized identities by @shreyas-damle in #308
• Identity UI added for local ui and reports by @rutujaac in #312
• Update bubble chart UI by @rutujaac in #317
• Updated Pebblo client version UI by @rutujaac in #316
• Upversion to 0.1.14 by @srics in #321
• Update Tooltip UI and truncate long file names in table in Local UI by @rutujaac in #320
• Docker: Update logging level to Info by @siddheshwar-more in #314
• Update bubble chart height to be dynamic by @rutujaac in #322
• Fix: single finding in bubble chart by @rutujaac in #324

Full Changelog: v0.1.13...v0.1.14

v0.1.13

Key highlights

• Anonymize snippets to redact all PII details in the generated report (both PDF and local UI)
• Improved Topic Classifier model with better F1 score (accuracy, recall) for MEDICAL_ADVICE, HARMFUL_ADVICE and reduced false positives for NORMAL_TEXT
• Added support for more Langchain Document Loaders: Google Drive, Slack, Notion and UnstructuredEmail
• Switched default PDF renderer from weasyprint to xhtml2pdf
• Removed out-of-the-box dependency for pango libraries for PDF generation. Users requiring high-fidelity PDF reports can continue to use weasyprint and pango. See configuration guide for more details
• Local-UI enhancements
• Configuration file parsing enhancements
• Documentation updates

What's Changed

• Updated Sidebar for Pebblo Docs by @rutujaac in #217
• Topic Classifier Linting/Formatting fixes by @Raj725 in #227
• Ruff and pylint fixes for pebblo/app module by @shreyas-damle in #236
• Integration tests by @siddheshwar-more in #192
• Fixed Pebblo Integration tests by @siddheshwar-more in #252
• Update Pebblo topic classifier to version V8 by @Raj725 in #250
• Reports module formatting and linting fixes by @rutujaac in #253
• [Update] Pebblo UI documentation added. by @KumarNitin19 in #243
• Updated default config value to xhtml2pdf by @KunalJadhav5 in #215
• [Fix] Redirection for local ui implemented by @KumarNitin19 in #242
• Added validation for config and updated renderer details in config documentation. by @KunalJadhav5 in #237
• Adding document anonymizer by @dristysrivastava in #249
• Integration tests added changes to build from main by @siddheshwar-more in #255
• [Fix] Local UI load history table fix by @KumarNitin19 in #245
• Added timezone to date strings in report pdf by @rutujaac in #259
• Ruff formatting fixes by @shreyas-damle in #256
• Added file path for icons by @rutujaac in #260
• Updated Warning message . by @KunalJadhav5 in #248
• Added empty and error states for local UI by @rutujaac in #261
• Updated code to handle limited value in config.yaml by @KunalJadhav5 in #257
• Added Page not found on Pebblo UI by @rutujaac in #263
• Fix for app getting disappeared from local UI while execution is in progress by @shreyas-damle in #265
• Added pebblo UI screenshot and server details note by @rutujaac in #266
• Release 0.1.13 version update pyproject.toml by @siddheshwar-more in #268
• Updating config value anonymizeAllEntities to anonymizeSnippets by @dristysrivastava in #269
• Remove pango dependency by @shreyas-damle in #271
• Update README - remove reference to pango by @srics in #272

Full Changelog: v0.1.12...v0.1.13

v0.1.12

Key highlights

• New Local-UI to browse the reports at http//localhost:8000/pebblo
• Enhanced Entity Classifier with context matching for improved accuracy
• PDF Report generation using xhtml2pdf (removes pango dependency)
• Documentation updates

What's Changed

• Update Pebblo diagrams by @srics in #182
• Resolve ruff lint errors by @shreyas-damle in #171
• Config Documentation for Pebblo by @KunalJadhav5 in #166
• Update load history template by @rutujaac in #174
• Changes for mypy ruff linting by @siddheshwar-more in #190
• Added details for Load History section in report. by @shreyas-damle in #181
• Adding documentation for Pebblo Topic and Entity Classifier by @rohiniNN in #186
• Update xhtml2pdf report template by @rutujaac in #188
• Rename files to documents in weasyprintTemplate.html by @rutujaac in #193
• Changing Pebblo Daemon to Pebblo server and fixing previous PR bug by @rohiniNN in #197
• fixing report link in document pages by @rohiniNN in #201
• Added config documentation in sidebar. by @KunalJadhav5 in #198
• Pebblo Docs - Remove unused md files by @rutujaac in #194
• Pebblo CI tests by @siddheshwar-more in #202
• [Entity Classifier] Enhance Entity Classifier using words context (Presidio) by @dristysrivastava in #204
• Updating scores for entity classifier for context matching by @dristysrivastava in #210
• Update field in xhtml2pdf template for findings by @rutujaac in #211
• Feature local UI by @shreyas-damle in #222
• Fixed swapped findings entities and findings topics counts. by @shreyas-damle in #238
• [Fix] data source label value fixed by @KumarNitin19 in #239
• [Fix] local ui app details page snippet count fixed by @KumarNitin19 in #240
• [Fix] search fixed for table local ui by @KumarNitin19 in #241
• Upversion to 0.1.12 by @srics in #246

New Contributors

• @rohiniNN made their first contribution in #186

Full Changelog: v0.1.11...v0.1.12

v0.1.11

New features

1. Pebblo Safe DataLoader is now upstreamed, built-in to the official Langchain release (versions >=0.1.7)
2. Load history
3. Configuration support
4. xhtml2pdf renderer (alternative to weasyprint/pango renderer)
5. Improved Topic classifier behavior for small chunk sizes
6. Improved terminal logging with progress bars
7. Documentation improvements

What's Changed

• Rutuja gh pages docs by @rutujaac in #121
• Rutuja update deploy gh pages by @rutujaac in #122
• Delete .github/workflows/jekyll-gh-pages.yml by @sid-cd-daxa in #123
• Update gh page workflow by @sid-cd-daxa in #131
• TestPy Version update with git commit sha by @siddheshwar-more in #134
• Update build.yml by @siddheshwar-more in #135
• Updated TestPyPi workflow by @siddheshwar-more in #136
• Update README and workflow to use new doc location by @srics in #126
• Fix docusaurus build by @rutujaac in #145
• Config.yaml Support for Pebblo by @KunalJadhav5 in #137
• Log improvements in pebblo-server. by @rahul-trip in #124
• xhtml2pdf report template by @rutujaac in #140
• Update 'Edit Page' URL by @rutujaac in #132
• Updated topic list & Fixed min input length condition by @Raj725 in #138
• Update samples to use upstream langchain by @srics in #152
• Use uvicorn logger and handle output dir location given in config.yaml file by @shreyas-damle in #150
• log further improvements. by @rahul-trip in #153
• Create troubleshooting.md by @rahul-trip in #154
• fix review comments in PR: 154 by @rahul-trip in #157
• Update README for langchain pebblo upstream release by @srics in #158
• Skipped printing config details at the startup by @shreyas-damle in #159
• Reading report details from config.yaml by @KunalJadhav5 in #148
• Updated git workflow for multiple python version by @siddheshwar-more in #155
• Spellcheck on docs by @rahul-trip in #161
• Python version fix for unit tests by @siddheshwar-more in #165
• suppress progress bar in --help option. by @rahul-trip in #164
• Pebblo Issue template by @siddheshwar-more in #133
• Removed unused param by @shreyas-damle in #167
• Update issue templates by @siddheshwar-more in #168
• updated the linting workflow by @siddheshwar-more in #170
• Feature app history by @shreyas-damle in #151
• Update version 0.1.10 -> 0.1.11 by @Raj725 in #172

New Contributors

• @sid-cd-daxa made their first contribution in #123

Full Changelog: v0.1.10...v0.1.11

v0.1.10

What's Changed

• Add more Python versions to support the list by @Raj725 in #104
• Slowness partial fix by @shreyas-damle in #110
• Updated the workflow for checking test.pypi package install by @siddheshwar-more in #113
• Topic classifier: chop off lower end 16 chars or less by @Raj725 in #103
• Pebblo config.yaml support by @KunalJadhav5 in #108
• Release v0.1.10 by @Raj725 in #112
• Revert "Pebblo config.yaml support" by @Raj725 in #117
• Update Pebblo Docs to Docusaurus v3 by @rutujaac in #118
• Fixing entity classifier initialization issue. by @shreyas-damle in #116

New Contributors

• @KunalJadhav5 made their first contribution in #108

Full Changelog: v0.1.9...v0.1.10

v0.1.9

What's Changed

• Support for additional python versions by @Raj725 in #96
• [Docs] Update discord to never expire link by @sridhar-daxa in #101
• Unit tests and API response changes by @Raj725 in #100
• Release v0.1.9 by @Raj725 in #102

Full Changelog: v0.1.8...v0.1.9

v0.1.8

What's Changed

• add linting and formatting. by @rahul-trip in #93
• Logging Changes by @shreyas-damle in #85
• Move tests outside pebblo package by @Raj725 in #95
• Linting workflow by @siddheshwar-more in #97
• release-0-1-8 by @siddheshwar-more in #99

Full Changelog: v0.1.7...v0.1.8

v0.1.7

What's Changed

• Update README and add RAG sample by @srics in #81
• Adjust pebblo logo by @srics in #82
• Add Dateutil dependency by @rutujaac in #84
• Remove UTC time conversion by @rutujaac in #86
• pypi published failed on version mismatch by @siddheshwar-more in #83
• Added tests and dependencies by @Raj725 in #88
• Move test dependencies to project.optional-dependencies by @Raj725 in #90
• Added workflow for Unit tests by @siddheshwar-more in #91
• Release 0-1-7 by @siddheshwar-more in #92

Full Changelog: v0.1.6...v0.1.7