Database Proxy #2000

tyt2y3 · 2023-12-08T14:00:38Z

I am not sure why you need to enable sqlx for proxy? I think they should compile without it anyway?

Regarding CI, sorry but our CI is already very slow right now, a cycle can take up to 30 minutes on a bad day lol. Can you set up the CI on your fork instead?

to avoid stack overflow

But it would failed on wasm32-wasi target because of the socket deps. It can be compiled on wasm32-unknown-unknown target.

…roxy-conn

To transfer the fully information of the execute result.

Refs: 9bac6e9

Refs: e0330dd

feat: Add proxy connection type

* refactor: Bump gluesql to 0.15 Relate to gluesql/gluesql#1438 * Use SQLParser to parse and replace placeholders. * Use SQLParser for surrealdb demo. * Transform the query by SQLParser.

tyt2y3 · 2023-12-08T14:01:52Z

Just a random note, this is #2000 horray \😌/

tyt2y3 · 2023-12-08T15:02:03Z

I don't understand the failure, but I think my theory was correct?

langyo · 2023-12-08T16:13:22Z

I am sure that if you only enable the proxy feature, you don’t actually need to use sqlx. It's an optional dependency.

Then the CI build failed because WASI needs an additional compilation target wasm32-wasi. I'll try to fix it..

Regarding the CI here. I will use my CI quota instead when I continue to add new features to the fork branch.

* ci: Add additional targets. * Remove proxy wasmtime example.

tyt2y3 · 2023-12-10T17:10:54Z

Let's try again

langyo · 2023-12-11T02:53:01Z

CI built success 😉

github-actions · 2023-12-14T23:57:10Z

🎉 Released In 0.12.10 🎉

Thank you everyone for the contribution!
This feature is now available in the latest release. Now is a good time to upgrade!
Your participation is what makes us unique; your adoption is what drives us forward.
You can support SeaQL 🌊 by starring our repos, sharing our libraries and becoming a sponsor ⭐.

tyt2y3 · 2023-12-19T11:26:43Z

@langyo did it work for you?

langyo · 2023-12-19T12:13:49Z

@langyo did it work for you?

It works. I'm already writing peripheral libraries to further expand functionality. 😉

In fact, I'm using it on the site that I'm responsible for. The site is confidential, so it may not be convenient to place it on the display page.

tyt2y3 · 2023-12-19T12:15:35Z

Wow nice, if you got the chance to make a CMS, I hope I can take a look at it!

langyo · 2023-12-19T13:21:48Z

Wow nice, if you got the chance to make a CMS, I hope I can take a look at it!

Sure. I'll write some other apps next year.

[![Mend Renovate](https://app.renovatebot.com/images/banner.svg)](https://renovatebot.com) This PR contains the following updates: | Package | Type | Update | Change | |---|---|---|---| | [sea-orm](https://www.sea-ql.org/SeaORM) ([source](https://togithub.com/SeaQL/sea-orm)) | dev-dependencies | patch | `0.12.3` -> `0.12.15` | | [sea-orm](https://www.sea-ql.org/SeaORM) ([source](https://togithub.com/SeaQL/sea-orm)) | dependencies | patch | `0.12.3` -> `0.12.15` | --- ### Release Notes <details> <summary>SeaQL/sea-orm (sea-orm)</summary> ### [`v0.12.15`](https://togithub.com/SeaQL/sea-orm/releases/tag/0.12.15) [Compare Source](https://togithub.com/SeaQL/sea-orm/compare/0.12.14...0.12.15) ##### Enhancements - `DerivePartialModel` macro attribute `entity` now supports `syn::Type` [https://github.com/SeaQL/sea-orm/pull/2137](https://togithub.com/SeaQL/sea-orm/pull/2137) ```rust #[derive(DerivePartialModel)] #[sea_orm(entity = "<entity::Model as ModelTrait>::Entity")] struct EntityNameNotAIdent { #[sea_orm(from_col = "foo2")] _foo: i32, #[sea_orm(from_col = "bar2")] _bar: String, } ``` - Added `RelationDef::from_alias()` [https://github.com/SeaQL/sea-orm/pull/2146](https://togithub.com/SeaQL/sea-orm/pull/2146) ```rust assert_eq!( cake::Entity::find() .join_as( JoinType::LeftJoin, cake_filling::Relation::Cake.def().rev(), cf.clone() ) .join( JoinType::LeftJoin, cake_filling::Relation::Filling.def().from_alias(cf) ) .build(DbBackend::MySql) .to_string(), [ "SELECT `cake`.`id`, `cake`.`name` FROM `cake`", "LEFT JOIN `cake_filling` AS `cf` ON `cake`.`id` = `cf`.`cake_id`", "LEFT JOIN `filling` ON `cf`.`filling_id` = `filling`.`id`", ] .join(" ") ); ``` ### [`v0.12.14`](https://togithub.com/SeaQL/sea-orm/blob/HEAD/CHANGELOG.md#01214---2024-02-05) [Compare Source](https://togithub.com/SeaQL/sea-orm/compare/0.12.12...0.12.14) - Added feature flag `sqlite-use-returning-for-3_35` to use SQLite's returning [https://github.com/SeaQL/sea-orm/pull/2070](https://togithub.com/SeaQL/sea-orm/pull/2070) - Added Loco example [https://github.com/SeaQL/sea-orm/pull/2092](https://togithub.com/SeaQL/sea-orm/pull/2092) ### [`v0.12.12`](https://togithub.com/SeaQL/sea-orm/blob/HEAD/CHANGELOG.md#01212---2024-01-22) [Compare Source](https://togithub.com/SeaQL/sea-orm/compare/0.12.11...0.12.12) ##### Bug Fixes - \[sea-orm-cli] Fix entity generation for non-alphanumeric enum variants[https://github.com/SeaQL/sea-orm/pull/1821](https://togithub.com/SeaQL/sea-orm/pull/1821)1 - \[sea-orm-cli] Fix entity generation for relations with composite keys[https://github.com/SeaQL/sea-orm/pull/2071](https://togithub.com/SeaQL/sea-orm/pull/2071)1 ##### Enhancements - Added `ConnectOptions::test_before_acquire` ### [`v0.12.11`](https://togithub.com/SeaQL/sea-orm/blob/HEAD/CHANGELOG.md#01211---2024-01-14) [Compare Source](https://togithub.com/SeaQL/sea-orm/compare/0.12.10...0.12.11) ##### New Features - Added `desc` to `Cursor` paginator [https://github.com/SeaQL/sea-orm/pull/2037](https://togithub.com/SeaQL/sea-orm/pull/2037) ##### Enhancements - Improve query performance of `Paginator`'s `COUNT` query [https://github.com/SeaQL/sea-orm/pull/2030](https://togithub.com/SeaQL/sea-orm/pull/2030) - Added SQLx slow statements logging to `ConnectOptions` [https://github.com/SeaQL/sea-orm/pull/2055](https://togithub.com/SeaQL/sea-orm/pull/2055) - Added `QuerySelect::lock_with_behavior` [https://github.com/SeaQL/sea-orm/pull/1867](https://togithub.com/SeaQL/sea-orm/pull/1867) ##### Bug Fixes - \[sea-orm-macro] Qualify types in `DeriveValueType` macro [https://github.com/SeaQL/sea-orm/pull/2054](https://togithub.com/SeaQL/sea-orm/pull/2054) ##### House keeping - Fix clippy warnings on 1.75 [https://github.com/SeaQL/sea-orm/pull/2057](https://togithub.com/SeaQL/sea-orm/pull/2057) ### [`v0.12.10`](https://togithub.com/SeaQL/sea-orm/blob/HEAD/CHANGELOG.md#01210---2023-12-14) [Compare Source](https://togithub.com/SeaQL/sea-orm/compare/0.12.9...0.12.10) ##### New Features - \[sea-orm-macro] Comment attribute for Entity (`#[sea_orm(comment = "action")]`); `create_table_from_entity` supports comment [https://github.com/SeaQL/sea-orm/pull/2009](https://togithub.com/SeaQL/sea-orm/pull/2009) - Added "proxy" (feature flag `proxy`) to database backend [https://github.com/SeaQL/sea-orm/pull/1881](https://togithub.com/SeaQL/sea-orm/pull/1881), [https://github.com/SeaQL/sea-orm/pull/2000](https://togithub.com/SeaQL/sea-orm/pull/2000) ##### Enhancements - Cast enums in `is_in` and `is_not_in` [https://github.com/SeaQL/sea-orm/pull/2002](https://togithub.com/SeaQL/sea-orm/pull/2002) ##### Upgrades - Updated `sea-query` to `0.30.5` https://github.com/SeaQL/sea-query/releases/tag/0.30.5 ### [`v0.12.9`](https://togithub.com/SeaQL/sea-orm/blob/HEAD/CHANGELOG.md#0129---2023-12-08) [Compare Source](https://togithub.com/SeaQL/sea-orm/compare/0.12.8...0.12.9) ##### Enhancements - Add source annotations to errors [https://github.com/SeaQL/sea-orm/pull/1999](https://togithub.com/SeaQL/sea-orm/pull/1999) ##### Upgrades - Updated `sea-query` to `0.30.4` https://github.com/SeaQL/sea-query/releases/tag/0.30.4 ### [`v0.12.8`](https://togithub.com/SeaQL/sea-orm/blob/HEAD/CHANGELOG.md#0128---2023-12-04) [Compare Source](https://togithub.com/SeaQL/sea-orm/compare/0.12.7...0.12.8) ##### Enhancements - Implement `StatementBuilder` for `sea_query::WithQuery` [https://github.com/SeaQL/sea-orm/issues/1960](https://togithub.com/SeaQL/sea-orm/issues/1960) ##### Upgrades - Upgrade `axum` example to `0.7` [https://github.com/SeaQL/sea-orm/pull/1984](https://togithub.com/SeaQL/sea-orm/pull/1984) ### [`v0.12.7`](https://togithub.com/SeaQL/sea-orm/blob/HEAD/CHANGELOG.md#0127---2023-11-22) [Compare Source](https://togithub.com/SeaQL/sea-orm/compare/0.12.6...0.12.7) ##### Enhancements - Added method `expr_as_` that accepts `self` [https://github.com/SeaQL/sea-orm/pull/1979](https://togithub.com/SeaQL/sea-orm/pull/1979) ##### Upgrades - Updated `sea-query` to `0.30.3` https://github.com/SeaQL/sea-query/releases/tag/0.30.3 ### [`v0.12.6`](https://togithub.com/SeaQL/sea-orm/blob/HEAD/CHANGELOG.md#0126---2023-11-13) [Compare Source](https://togithub.com/SeaQL/sea-orm/compare/0.12.5...0.12.6) ##### New Features - Added `#[sea_orm(skip)]` for `FromQueryResult` derive macro [https://github.com/SeaQL/sea-orm/pull/1954](https://togithub.com/SeaQL/sea-orm/pull/1954) ### [`v0.12.5`](https://togithub.com/SeaQL/sea-orm/blob/HEAD/CHANGELOG.md#0125---2023-11-12) [Compare Source](https://togithub.com/SeaQL/sea-orm/compare/0.12.4...0.12.5) ##### Bug Fixes - \[sea-orm-cli] Fix duplicated active enum use statements on generated entities[https://github.com/SeaQL/sea-orm/pull/1953](https://togithub.com/SeaQL/sea-orm/pull/1953)3 - \[sea-orm-cli] Added `--enum-extra-derives` [https://github.com/SeaQL/sea-orm/pull/1934](https://togithub.com/SeaQL/sea-orm/pull/1934) - \[sea-orm-cli] Added `--enum-extra-attributes` [https://github.com/SeaQL/sea-orm/pull/1952](https://togithub.com/SeaQL/sea-orm/pull/1952) ### [`v0.12.4`](https://togithub.com/SeaQL/sea-orm/blob/HEAD/CHANGELOG.md#0124---2023-10-19) [Compare Source](https://togithub.com/SeaQL/sea-orm/compare/0.12.3...0.12.4) ##### New Features - Add support for root JSON arrays [https://github.com/SeaQL/sea-orm/pull/1898](https://togithub.com/SeaQL/sea-orm/pull/1898) Now the following works (requires the `json-array` / `postgres-array` feature)! ```rust #[derive(Clone, Debug, PartialEq, Eq, DeriveEntityModel)] #[sea_orm(table_name = "json_struct_vec")] pub struct Model { #[sea_orm(primary_key)] pub id: i32, #[sea_orm(column_type = "Json")] pub struct_vec: Vec<JsonColumn>, } #[derive(Clone, Debug, PartialEq, Eq, Serialize, Deserialize, FromJsonQueryResult)] pub struct JsonColumn { pub value: String, } ``` ##### Enhancements - Loader: use `ValueTuple` as hash key [https://github.com/SeaQL/sea-orm/pull/1868](https://togithub.com/SeaQL/sea-orm/pull/1868) ##### Upgrades - Updated `sea-query` to `0.30.2` https://github.com/SeaQL/sea-query/releases/tag/0.30.2 </details> --- ### Configuration 📅 **Schedule**: Branch creation - "after 3pm on Wednesday" in timezone America/New_York, Automerge - At any time (no schedule defined). 🚦 **Automerge**: Disabled by config. Please merge this manually once you are satisfied. ♻ **Rebasing**: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox. 🔕 **Ignore**: Close this PR and you won't be reminded about these updates again. --- - [ ] If you want to rebase/retry this PR, check this box --- Release Notes: - N/A  Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>

langyo added 30 commits September 27, 2023 13:57

feat: Add proxy connection type

dc14d28

feat: Add proxy database's proxy functions trait.

eda0bff

fix: Remove some unused impl to fix the unit test

88f4177

test: Create the proxy by empty declaration.

0ff1952

test: Try to genereate query and exec commands.

5e2e3fa

perf: Add more query debug trait for debugging.

ef357ff

chore: Add the example for wasi + proxy.

0d67fe2

chore: Try to read string from wasmtime vm.

32c3813

chore: Sucks, but how to do without tokio::spawn?

f35725a

chore: Complete the basic memory read logic.

bbcd987

chore: Abandon the WASI demo, native demo first...

460c978

refactor: Use single proxy connection generator

c354c83

to avoid stack overflow

refactor: Rename the inner structs' name

ac8816f

fix: Fix CI clippy and unit test

1ab8a55

Merge commit 'bd9a0e9b7e8f55d4ed91511f4b088849b94d3087' into proxy-conn

ffff54f

fix: Rename the example.

c54ed1e

chore: Try to embed surrealdb for proxy test.

bf91484

fix: Transfer the query result correctly.

d593d7b

refactor: Rename the example.

a3d6a0d

chore: Ready to add example for wasmtime proxy.

9638926

feat: Try to compile sea-orm into wasm binary.

4e51c86

But it would failed on wasm32-wasi target because of the socket deps. It can be compiled on wasm32-unknown-unknown target.

fix: WASM targets can't use sqlx.

f818e66

fix: Try to fix CI by remove toml.

82b0075

fix: Try to fix CI by remove toml.

05416c7

Merge branch 'proxy-conn' of https://github.com/langyo/sea-orm into p…

9803092

…roxy-conn

fix: Move vm to the example's root dir.

9a1c594

fix: Add a pre-build script.

b87ce92

chore: Add README.

933f952

Merge commit 'e9acabd847d34f5fe257dba1b0b95647853c8af0' into proxy-conn

5ee2174

fix: Try to fix CI.

6bae09f

langyo and others added 11 commits October 24, 2023 09:56

ci: It may needs wasi target twice...

3282413

feat: Add more keys for proxy execute result.

0cb42c2

To transfer the fully information of the execute result.

fix: Use custom id type instead of json value.

956dfa8

fix: Wrong reference type.

25662ea

fix: Rewrite the transformer.

a1693cf

perf: Add ToString trait for proxy exec result.

9bac6e9

revert: Again.

151eb1d

Refs: 9bac6e9

revert: Back to the basic proxy exec result.

ba09d84

Refs: e0330dd

Merge branch 'master' into proxy-conn

de66032

Merge pull request #1881 from langyo/proxy-conn

2844d03

feat: Add proxy connection type

refactor: Update GlueSQL and SurrealDB examples. (#1980)

2bfd7d6

* refactor: Bump gluesql to 0.15 Relate to gluesql/gluesql#1438 * Use SQLParser to parse and replace placeholders. * Use SQLParser for surrealdb demo. * Transform the query by SQLParser.

tyt2y3 force-pushed the proxy branch from 1a5072b to 2bfd7d6 Compare December 8, 2023 14:22

Tweaks

510d05a

langyo mentioned this pull request Dec 8, 2023

Remove wasmtime example. #2001

Merged

Remove wasmtime example. (#2001)

cc5d91e

* ci: Add additional targets. * Remove proxy wasmtime example.

Format

82d14e4

tyt2y3 merged commit 955bbcb into master Dec 14, 2023
33 checks passed

tyt2y3 deleted the proxy branch December 14, 2023 11:40

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Database Proxy #2000

Database Proxy #2000

tyt2y3 commented Dec 8, 2023

tyt2y3 commented Dec 8, 2023

tyt2y3 commented Dec 8, 2023

langyo commented Dec 8, 2023 •

edited

Loading

tyt2y3 commented Dec 10, 2023

langyo commented Dec 11, 2023

github-actions bot commented Dec 14, 2023

tyt2y3 commented Dec 19, 2023

langyo commented Dec 19, 2023

tyt2y3 commented Dec 19, 2023 •

edited

Loading

langyo commented Dec 19, 2023

Database Proxy #2000

Database Proxy #2000

Conversation

tyt2y3 commented Dec 8, 2023

tyt2y3 commented Dec 8, 2023

tyt2y3 commented Dec 8, 2023

langyo commented Dec 8, 2023 • edited Loading

tyt2y3 commented Dec 10, 2023

langyo commented Dec 11, 2023

github-actions bot commented Dec 14, 2023

🎉 Released In 0.12.10 🎉

tyt2y3 commented Dec 19, 2023

langyo commented Dec 19, 2023

tyt2y3 commented Dec 19, 2023 • edited Loading

langyo commented Dec 19, 2023

langyo commented Dec 8, 2023 •

edited

Loading

tyt2y3 commented Dec 19, 2023 •

edited

Loading