Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
feat(protos): add buf support to generate gRPC clients and servers us…
…ing connect
- Loading branch information
Showing
27 changed files
with
2,690 additions
and
27 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1,8 +1,12 @@ | ||
| default: build | ||
|
|
||
| build: build-backend | ||
| build: build-protos build-backend | ||
| .PHONY: build | ||
|
|
||
| build-backend: | ||
| sh -c "cd ./backend && make all" | ||
| .PHONY: build-backend | ||
| .PHONY: build-backend | ||
|
|
||
| build-protos: | ||
| sh -c "cd ./protos && make all" | ||
| .PHONY: build-protos |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,19 @@ | ||
| ## Introduction | ||
| [Missing studio](https://www.missing.studio) is a robust open source platform to build a developer-first way to create | ||
| AI application using LLM, Image, Audio and Video Studios. | ||
|
|
||
|
|
||
| ## Features | ||
| - 🌐 *Universal API* - Call every LLM API like it's OpenAI | ||
| - *AI Gateway* for rate limit, atomatic retries, caching, failover etc | ||
| - Workflow builder to compose complex AI apps | ||
| - AI Agents | ||
| - LLM Studio to bring LLM applications to production | ||
| - Image studio | ||
| - Audio studio | ||
| - Video studio | ||
| - Storage to connect with providers like s3, gcs, vector DBs etc. | ||
| - Inference and serving to serve AI/ML models in production | ||
| - Finetune models | ||
| - Model Deployment at Scale on Kubernetes 🦄️ | ||
| - Dev tools – all missing studio dev tools (CLI, SDK, API Client) |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
|
|
@@ -4,4 +4,5 @@ use ( | |
| ./backend | ||
| ./cli | ||
| ./worker | ||
| ./protos | ||
| ) | ||
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,5 @@ | ||
| node_modules/ | ||
| /target | ||
| .vscode/ | ||
| /obj | ||
| /bin |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,7 @@ | ||
| default: all | ||
|
|
||
| all: build | ||
|
|
||
| build: | ||
| buf generate proto | ||
| .PHONY: build |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,12 @@ | ||
| ## Protos | ||
| For protobuf based API development. Buf will take care of protobuf generation for each language. | ||
| - Buf modules | ||
| - Buf plugins | ||
|
|
||
| ### Basic | ||
| 1. buf mod init | ||
| 2. buf mod update | ||
| 3. buf build | ||
| 4. buf generate proto | ||
| 5. buf lint proto | ||
| 6. buf curl --schema proto http://localhost:8080/missingstudio.v1.PingService/Ping |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,32 @@ | ||
| version: v1 | ||
| managed: | ||
| enabled: true | ||
| go_package_prefix: | ||
| default: github.com/missingstudio/studio/protos/pkg | ||
| except: | ||
| - buf.build/googleapis/googleapis | ||
| - buf.build/bufbuild/protovalidate | ||
| - buf.build/grpc-ecosystem/grpc-gateway | ||
|
|
||
| plugins: | ||
| # Go Plugins | ||
| - plugin: buf.build/connectrpc/go:v1.14.0 | ||
| out: pkg | ||
| opt: paths=source_relative | ||
|
|
||
| - plugin: buf.build/protocolbuffers/go:v1.32.0 | ||
| out: pkg | ||
| opt: paths=source_relative | ||
|
|
||
| # Typescript plugins | ||
| - plugin: buf.build/bufbuild/es:v1.6.0 | ||
| opt: | ||
| - target=ts | ||
| - import_extension= | ||
| out: src | ||
|
|
||
| - plugin: buf.build/connectrpc/es:v1.2.0 | ||
| opt: | ||
| - target=ts | ||
| - import_extension= | ||
| out: src |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,3 @@ | ||
| version: v1 | ||
| directories: | ||
| - proto |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,17 @@ | ||
| module github.com/missingstudio/studio/protos | ||
|
|
||
| go 1.21.5 | ||
|
|
||
| require ( | ||
| buf.build/gen/go/bufbuild/protovalidate/protocolbuffers/go v1.31.0-20230824200731-b9b8148056b9.1 | ||
| connectrpc.com/connect v1.14.0 | ||
| github.com/grpc-ecosystem/grpc-gateway/v2 v2.19.0 | ||
| google.golang.org/genproto/googleapis/api v0.0.0-20240102182953-50ed04b92917 | ||
| google.golang.org/genproto/googleapis/rpc v0.0.0-20240102182953-50ed04b92917 | ||
| google.golang.org/protobuf v1.32.0 | ||
| ) | ||
|
|
||
| require ( | ||
| golang.org/x/net v0.20.0 // indirect | ||
| google.golang.org/genproto v0.0.0-20231212172506-995d672761c0 // indirect | ||
| ) |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,25 @@ | ||
| buf.build/gen/go/bufbuild/protovalidate/protocolbuffers/go v1.31.0-20230824200731-b9b8148056b9.1 h1:9Ea7lsYYvoyqmq79GbCy6POXHrZbC+pHs+6lGNx9IBQ= | ||
| buf.build/gen/go/bufbuild/protovalidate/protocolbuffers/go v1.31.0-20230824200731-b9b8148056b9.1/go.mod h1:xafc+XIsTxTy76GJQ1TKgvJWsSugFBqMaN27WhUblew= | ||
| connectrpc.com/connect v1.14.0 h1:PDS+J7uoz5Oui2VEOMcfz6Qft7opQM9hPiKvtGC01pA= | ||
| connectrpc.com/connect v1.14.0/go.mod h1:uoAq5bmhhn43TwhaKdGKN/bZcGtzPW1v+ngDTn5u+8s= | ||
| github.com/golang/protobuf v1.5.0/go.mod h1:FsONVRAS9T7sI+LIUmWTfcYkHO4aIWwzhcaSAoJOfIk= | ||
| github.com/google/go-cmp v0.5.5/go.mod h1:v8dTdLbMG2kIc/vJvl+f65V22dbkXbowE6jgT/gNBxE= | ||
| github.com/google/go-cmp v0.6.0 h1:ofyhxvXcZhMsU5ulbFiLKl/XBFqE1GSq7atu8tAmTRI= | ||
| github.com/google/go-cmp v0.6.0/go.mod h1:17dUlkBOakJ0+DkrSSNjCkIjxS6bF9zb3elmeNGIjoY= | ||
| github.com/grpc-ecosystem/grpc-gateway/v2 v2.19.0 h1:Wqo399gCIufwto+VfwCSvsnfGpF/w5E9CNxSwbpD6No= | ||
| github.com/grpc-ecosystem/grpc-gateway/v2 v2.19.0/go.mod h1:qmOFXW2epJhM0qSnUUYpldc7gVz2KMQwJ/QYCDIa7XU= | ||
| golang.org/x/net v0.20.0 h1:aCL9BSgETF1k+blQaYUBx9hJ9LOGP3gAVemcZlf1Kpo= | ||
| golang.org/x/net v0.20.0/go.mod h1:z8BVo6PvndSri0LbOE3hAn0apkU+1YvI6E70E9jsnvY= | ||
| golang.org/x/text v0.14.0 h1:ScX5w1eTa3QqT8oi6+ziP7dTV1S2+ALU0bI+0zXKWiQ= | ||
| golang.org/x/text v0.14.0/go.mod h1:18ZOQIKpY8NJVqYksKHtTdi31H5itFRjB5/qKTNYzSU= | ||
| golang.org/x/xerrors v0.0.0-20191204190536-9bdfabe68543/go.mod h1:I/5z698sn9Ka8TeJc9MKroUUfqBBauWjQqLJ2OPfmY0= | ||
| google.golang.org/genproto v0.0.0-20231212172506-995d672761c0 h1:YJ5pD9rF8o9Qtta0Cmy9rdBwkSjrTCT6XTiUQVOtIos= | ||
| google.golang.org/genproto v0.0.0-20231212172506-995d672761c0/go.mod h1:l/k7rMz0vFTBPy+tFSGvXEd3z+BcoG1k7EHbqm+YBsY= | ||
| google.golang.org/genproto/googleapis/api v0.0.0-20240102182953-50ed04b92917 h1:rcS6EyEaoCO52hQDupoSfrxI3R6C2Tq741is7X8OvnM= | ||
| google.golang.org/genproto/googleapis/api v0.0.0-20240102182953-50ed04b92917/go.mod h1:CmlNWB9lSezaYELKS5Ym1r44VrrbPUa7JTvw+6MbpJ0= | ||
| google.golang.org/genproto/googleapis/rpc v0.0.0-20240102182953-50ed04b92917 h1:6G8oQ016D88m1xAKljMlBOOGWDZkes4kMhgGFlf8WcQ= | ||
| google.golang.org/genproto/googleapis/rpc v0.0.0-20240102182953-50ed04b92917/go.mod h1:xtjpI3tXFPP051KaWnhvxkiubL/6dJ18vLVf7q2pTOU= | ||
| google.golang.org/protobuf v1.26.0-rc.1/go.mod h1:jlhhOSvTdKEhbULTjvd4ARK9grFBp09yW+WbY/TyQbw= | ||
| google.golang.org/protobuf v1.31.0/go.mod h1:HV8QOd/L58Z+nl8r43ehVNZIU/HEI6OcFqwMG9pJV4I= | ||
| google.golang.org/protobuf v1.32.0 h1:pPC6BG5ex8PDFnkbrGU3EixyhKcQ2aDuBS36lqK/C7I= | ||
| google.golang.org/protobuf v1.32.0/go.mod h1:c6P6GXX6sHbq/GpV6MGZEdwhWPcYBgnhAHhKbcUYpos= |
Oops, something went wrong.