TestEnv support for mock networking

[AhmedSoliman]

TestEnv support for mock networking

---

Stack created with Sapling. Best reviewed with ReviewStack.

• Add jitter to retries #1274
• Ingress dispatcher is concurrent and integrated with bifrost #1269
• Networking metrics #1268
• -> TestEnv support for mock networking #1264

[github-actions]

Test Results

 92 files   - 25   92 suites   - 25   4m 4s ⏱️ - 4m 5s
 73 tests  - 29   48 ✅  -  49  25 💤 +20  0 ❌ ±0 
196 runs   - 65  131 ✅  - 115  65 💤 +50  0 ❌ ±0 

Results for commit 61c23e0. ± Comparison against base commit d1d9f87.

This pull request removes 73 and adds 44 tests. Note that renamed tests count towards both.

dev.restate.e2e.JavaAwakeableTest ‑ generate(RandomNumberListGeneratorBlockingStub)
dev.restate.e2e.JavaCoordinatorWithNodeReceiverServiceToServiceCallTest ‑ synchronousCall(CoordinatorBlockingStub)
dev.restate.e2e.JavaKafkaIngressTest ‑ handleEventInCounterService(URL, int, CounterBlockingStub)
dev.restate.e2e.JavaKafkaIngressTest ‑ handleEventInEventHandler(URL, int, CounterBlockingStub)
dev.restate.e2e.JavaNonDeterminismTest ‑ BackgroundInvokeWithDifferentTargets
dev.restate.e2e.JavaNonDeterminismTest ‑ CallDifferentMethod
dev.restate.e2e.JavaNonDeterminismTest ‑ LeftSleepRightCall
dev.restate.e2e.JavaNonDeterminismTest ‑ SetDifferentKey
dev.restate.e2e.JavaOldAwaitTimeoutTest ‑ Test Awaitable#await(Duration)
dev.restate.e2e.JavaOldSampleWorkflowTest ‑ Sample workflow with sleep, side effect, call and one way call
…

dev.restate.e2e.JavaAwakeableTest ‑ generate(IngressClient)
dev.restate.e2e.JavaCoordinatorWithNodeReceiverServiceToServiceCallTest ‑ synchronousCall(IngressClient)
dev.restate.e2e.JavaKafkaIngressTest ‑ handleEventInCounterService(URL, int, IngressClient)
dev.restate.e2e.JavaKafkaIngressTest ‑ handleEventInEventHandler(URL, int, IngressClient)
dev.restate.e2e.JavaNonDeterminismTest ‑ backgroundInvokeWithDifferentTargets
dev.restate.e2e.JavaNonDeterminismTest ‑ callDifferentMethod
dev.restate.e2e.JavaNonDeterminismTest ‑ leftSleepRightCall
dev.restate.e2e.JavaNonDeterminismTest ‑ setDifferentKey
dev.restate.e2e.JavaServiceToServiceCallTest ‑ synchronousCall(IngressClient)
dev.restate.e2e.JavaSimpleSleepTest ‑ manySleeps(IngressClient)
…

This pull request removes 5 skipped tests and adds 15 skipped tests. Note that renamed tests count towards both.

dev.restate.e2e.node.VerificationTest ‑ killingTheRuntime(CommandVerifierBlockingStub, ContainerHandle)
dev.restate.e2e.node.VerificationTest ‑ stoppingTheRuntime(CommandVerifierBlockingStub, ContainerHandle)
dev.restate.e2e.runtime.PersistenceTest ‑ startAndKillRuntimeRetainsTheState(CounterBlockingStub, ContainerHandle)
dev.restate.e2e.runtime.PersistenceTest ‑ startAndStopRuntimeRetainsTheState(CounterBlockingStub, ContainerHandle)
dev.restate.e2e.runtime.UpgradeServiceTest ‑ inFlightInvocationStoppingTheRuntime(IngressBlockingStub, UpgradeTestServiceBlockingStub, AwakeableHolderServiceBlockingStub, ListServiceBlockingStub, URL, ContainerHandle)

dev.restate.e2e.JavaCoordinatorWithNodeReceiverServiceToServiceCallTest ‑ synchronousCall(IngressClient)
dev.restate.e2e.NodeAwaitTimeoutTest ‑ Test Awaitable#await(Duration)
dev.restate.e2e.NodeAwakeableTest ‑ generate(IngressClient)
dev.restate.e2e.NodeCancelInvocationTest ‑ cancelInvocation(BlockingOperation, IngressClient, URL)
dev.restate.e2e.NodeCoordinatorWithJavaReceiverServiceToServiceCallTest ‑ synchronousCall(IngressClient)
dev.restate.e2e.NodeNonDeterminismTest ‑ method(String, IngressClient)
dev.restate.e2e.NodeServiceToServiceCallTest ‑ synchronousCall(IngressClient)
dev.restate.e2e.NodeSimpleSleepTest ‑ manySleeps(IngressClient)
dev.restate.e2e.NodeSimpleSleepTest ‑ sleep(IngressClient)
dev.restate.e2e.NodeSleepWithFailuresTest ‑ sleepAndKillServiceEndpoint(IngressClient, ContainerHandle)
…

This pull request skips 10 tests.

dev.restate.e2e.NodeErrorsTest ‑ Test calling method that fails terminally
dev.restate.e2e.NodeErrorsTest ‑ Test calling method that fails terminally multiple times
dev.restate.e2e.NodeErrorsTest ‑ Test invocations are retried until they succeed
dev.restate.e2e.NodeErrorsTest ‑ Test propagate failure from another service
dev.restate.e2e.NodeErrorsTest ‑ Test set then fail should persist the set
dev.restate.e2e.NodeErrorsTest ‑ Test side effects are retried until they succeed
dev.restate.e2e.NodeErrorsTest ‑ Test terminal error of side effects is propagated
dev.restate.e2e.NodeSideEffectTest ‑ Side effect should wait on acknowledgements
dev.restate.e2e.NodeWorkflowAPITest ‑ Set and resolve durable promise leads to completion
dev.restate.e2e.NodeWorkflowAPITest ‑ Workflow cannot be submitted more than once

♻️ This comment has been updated with latest results.

[tillrohrmann]

Thanks for creating this PR @AhmedSoliman. The changes look good to me. I had one question concerning hooking the MetadataManager up with the network layer. +1 for merging.

[AhmedSoliman]

In fact, let me park this a little bit. TestEnv needs a slight redesign to follow the builder pattern instead.

[AhmedSoliman]

Reworked the design. Ready again for review.

[tillrohrmann]

LGTM. +1 for merging.