Skip to content

Conversation

@claramoreirag
Copy link
Contributor

@claramoreirag claramoreirag commented Nov 27, 2024

LLMstudio Version 1.0.3

What was done in this PR:

  • Add Tracker connection to BigQuery

How it was tested:

  • By running examples/04_bigquery_integration.ipynb

Additional notes:

  • Any breaking changes? No
  • Any new dependencies added? Yes
  • Any performance improvements? No

actions-user and others added 30 commits October 10, 2024 11:14
* Update __init__.py

1. Change start_server() from outside to inside the class.

* Update __init__.py

1. Place start_server inside llm init

---------

Co-authored-by: Cláudio Lemos <claudio.lemos@tensorops.ai>
* Update __init__.py

1. Change start_server() from outside to inside the class.

* Update __init__.py

1. Place start_server inside llm init

* Update cli.py

Change how the server runs.

* Update __init__.py

* Update __init__.py

---------

Co-authored-by: Cláudio Lemos <claudio.lemos@tensorops.ai>
* Add llmstudio docs

* Start creating gcp guide

* Update gcp-deployment draft

* Finish deploy-llmstudio-on-gcp guide.

* Update deploy-on-google-cloud-platform.mdx

* Fix some lettering

* Update deploy-on-google-cloud-platform.mdx

* Update deploy-on-google-cloud-platform.mdx

* Update GCP docs

---------

Co-authored-by: Cláudio Lemos <claudio.lemos@tensorops.ai>
messeges -> messages

Signed-off-by: Ikko Eltociear Ashimine <eltociear@gmail.com>
diogoncalves and others added 24 commits November 20, 2024 16:48
Signed-off-by: Diogo Goncalves <diogoncalves@users.noreply.github.com>
## LLMstudio Tracker Version 1.0.3

### What was done in this PR:
- Added Tracker integration with BigQuery, using the sqlalchemy-bigquery
to extend sqlalchemy support to BigQuery
- Bigquery does not support some SQL features, so the Table model needed
to be adapted for compatibility:
- autoincrement on IDs is not supported, so log id is given a value
based on current_timestamp
- JSON columns are not supported, so a custom type JSONEncodedDict was
created on db_utils.py to encode JSON objects in strings before writing
and decoding on read.
- timestamp defaults were changed from `server_default = func.now()` to
being set directly in python
  

### How it was tested:
- Following the example in examples/04_bigquery_integration.ipynb

### Additional notes:

Two dependencies were added to the pyproject.toml:
- sqlalchemy-bigquery 
- google-cloud-bigquery-storage
@claramoreirag claramoreirag marked this pull request as ready for review November 27, 2024 15:16
Signed-off-by: Clara Moreira Gadelho <56916880+claramoreirag@users.noreply.github.com>
@claudiolemos claudiolemos merged commit 455b2c4 into main Nov 28, 2024
3 checks passed
@claudiolemos claudiolemos deleted the develop branch November 28, 2024 12:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

9 participants