Skip to content

Conversation

g-linville
Copy link
Member

@g-linville g-linville commented Nov 4, 2024

This is a rewrite of the datasets tools, now as a daemon tool for better performance. Here are the notable changes:

  • workspaceID is a required argument for all tools
  • dataset IDs are now in the format gds://xxxxx where each x is a hex digit
  • The Add Element and Create Dataset tools have been removed. Add Elements now takes the dataset ID as an optional parameter, and creates a new dataset if it is not set
  • All elements are stored in a single JSON file with the dataset, rather than in individual files
  • Elements have a Contents (string) and BinaryContents ([]byte) field

I'll have follow-up PRs for the SDKServer, SDKs, and tools.

Signed-off-by: Grant Linville <grant@acorn.io>
Signed-off-by: Grant Linville <grant@acorn.io>
Signed-off-by: Grant Linville <grant@acorn.io>
Signed-off-by: Grant Linville <grant@acorn.io>
Signed-off-by: Grant Linville <grant@acorn.io>
Signed-off-by: Grant Linville <grant@acorn.io>
Signed-off-by: Grant Linville <grant@acorn.io>
Signed-off-by: Grant Linville <grant@acorn.io>
Signed-off-by: Grant Linville <grant@acorn.io>
Signed-off-by: Grant Linville <grant@acorn.io>
Signed-off-by: Grant Linville <grant@acorn.io>
Copy link

@iwilltry42 iwilltry42 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

One test needs fixing, but that's not blocking 👍

m.workspaceID = workspaceID

t.Cleanup(func() {
_ = m.gptscriptClient.DeleteWorkspace(ctx)
})

dataset, err := m.NewDataset(ctx, "test dataset", "our lovely test dataset")
dataset, err := m.NewDataset(ctx)

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think name and description are still required

@g-linville g-linville merged commit d358e9e into gptscript-ai:main Nov 6, 2024
@g-linville g-linville deleted the rewrite-as-daemon branch November 6, 2024 15:30
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants