Skip to content

Conversation

@kmahar
Copy link
Contributor

@kmahar kmahar commented Sep 1, 2021

[this is currently based on the Evergreen testing PR, I think GitHub will automatically update the base once that goes in]

This adds code to actually start running the new tests, as well as making some various unified runner / testing infrastructure changes to support it.

patch

@kmahar kmahar marked this pull request as draft September 1, 2021 15:13
asType: UnifiedTestFile.self
).filter { $0.0 == "cursors.json" }.map { $0.1 }

let skipTests = [
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

unfortunately a lot of caveats here, but we still do get to run a decent number of the tests, so it seems better than nothing. let me know if all the reasoning below makes sense.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

All the skip reasons seem clear and detailed, LGTM.

case .command:
self.events = try container.decode([ExpectedEvent].self, forKey: .events)
case .cmap:
// TODO: SWIFT-1321 actually parse these out.
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

for now, there is just always an empty array, and in the runner below if ExpectedEventsForClient.type is cmap we skip doing assertions as we don't capture any events.

}
}

struct UnifiedListIndexes: UnifiedOperationProtocol {
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

we don't actually end up using this operation since we skip the listIndexes cursor test, but I figured we would need it eventually and adding it seemed like a reasonable way to allow us to decode cursors.json

}
}

struct UnifiedListCollections: UnifiedOperationProtocol {
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

similarly, this operation ends up going unused but I added it for completeness.

@kmahar kmahar marked this pull request as ready for review September 1, 2021 16:25
@kmahar kmahar requested a review from patrickfreed September 1, 2021 16:25
Copy link
Contributor

@patrickfreed patrickfreed left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

one typo fix but otherwise LGTM

asType: UnifiedTestFile.self
).filter { $0.0 == "cursors.json" }.map { $0.1 }

let skipTests = [
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

All the skip reasons seem clear and detailed, LGTM.

Base automatically changed from SWIFT-1328/test-lb-evergreen to main September 1, 2021 17:39
@kmahar kmahar force-pushed the SWIFT-1326/run-lb-spec-tests branch from 9102ddc to a4b16a0 Compare September 1, 2021 18:16
@kmahar kmahar merged commit 29df829 into main Sep 1, 2021
@kmahar kmahar deleted the SWIFT-1326/run-lb-spec-tests branch September 1, 2021 18:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants