Implementations of Smithy's HTTP Protocol Compliance Tests?

[ajdavis]

Hello! I'm a researcher, writing a paper about techniques for testing that code in several languages all conforms to the same spec. I stumbled on Smithy's HTTP Protocol Compliance Tests and they seem like a great example of the techniques I'm researching. A few questions, to make sure I'm understanding correctly:

1. To use these tests, you need a test runner implemented in the same language as your client or server, is that right?
2. If so, how many of the Smithy implementations include a test runner for the Smithy HTTP Protocol Compliance Tests?

Thanks!

[JordonPhillips]

To use these tests, you need a test runner implemented in the same language as your client or server, is that right?

That's right. We've also bounced around the idea of having a shared test runner that would only require a minimal integration in the target language.

how many of the Smithy implementations include a test runner for the Smithy HTTP Protocol Compliance Tests?

All of the implementations in smithy-lang have one (typescript, java, go, rust, ruby, kotlin, swift, dafny, python) and I believe smithy4s (scala) also has one. We additionally convert them to a format consumable by the AWS SDKs that have not yet migrated to Smithy-based code generators.

If you have any other questions, we'd be happy to meet with you to discuss!