Json Inference

[BarryThePenguin]

Hi, I'm looking for ways to infer a schema from some sample Json documents.

Something like https://app.quicktype.io is able to infer a Json Schema from multiple documents, while also detecting enums and objects with similar keys. But they don't expose any underlying AST, so you're limited to the output formats they provide.

I've played around with @traversable/json and @traversable/json-schema with Json.fold<() => JsonSchema>.
I've also used the resulting JsonSchema and @traversable/valibot with JsonSchema.fold<vx.AnyValibotSchema>.
I'm having a few issues handling JsonSchema.Ref correctly, but it's probably just an issue on my part 😅

Ideally I'd like to go from @traversable/json -> @traversable/schema -> @traversable/valibot rather than using JsonSchema as an in-between step.

Do you have any advice as to how I might do this?

[ahrjarrett]

Hey! Not sure if this is what you're looking for, the @traversable/zod package has a function called fromJson that sounds similar.

Here's a small POC of how you could do something similar for Valibot.

If you're looking for something else, could you give me an example JSON input, and the schema you're hoping to get out the other end?

[ahrjarrett]

I took a closer look at quicktype, and now I think I better understand. It sounds like the intermediate representation is specifically what you're looking for.

If so, I'd definitely be interested in helping figure out how to support your use case.

The part that makes me think I don't fully understand your use case is how refs come into play, if your source is JSON. That seems to imply that you might be working with multiple JSON documents, and making a separate pass to perform inference.

I'd need to understand a bit more about how that step works to be able to help!