Cannot use terraform provider for airbyte hosted in kubernetes

[Anton-Shutik]

Helm Chart Version

0.50.7

What step the error happened?

Other

Revelant information

kubectl port-forward svc/airbyte-airbyte-api-server-svc -n airbyte 8006:80

provider "airbyte" {
  password   = "airbyte"
  server_url = "http://localhost:8006/v1/"
  username   = "airbyte"
}

The issue goes away If I manually update the INTERNAL_API_HOST with http://airbyte-airbyte-server-svc:8001 in the airbyte-airbyte-env . Just add the http:// prefix and delete the api-server pod, so it restarts and reads updated env var. Not sure how can I update that parameter with chart values, since the pod references configMap and looks like we cannot override it.

Relevant log output

│ **Request**:
│ GET /v1/sources/884c854c-0a72-4701-ab82-5e3d59b1ac99 HTTP/1.1
│ Host: localhost:8006
│ Accept: application/json
│ Authorization: Basic YWlyYnl0ZTphaXJieXRl
│ User-Agent: speakeasy-sdk/go 0.3.5 2.210.3 1.0.0 airbyte
│ 
│ 
│ **Response**:
│ HTTP/1.1 500 Internal Server Error
│ Content-Length: 35
│ Connection: keep-alive
│ Content-Type: application/problem+json
│ Date: Thu, 7 Dec 2023 13:46:09 GMT
│ 
│ {"type":"about:blank","status":500}




│ 2023-12-07 13:46:09 ERROR i.m.h.s.RouteExecutor(logException):444 - Unexpected error occurred: No available services for ID: airbyte-airbyte-server-svc:8001                                                                                                                                                             │
│ io.micronaut.discovery.exceptions.NoAvailableServiceException: No available services for ID: airbyte-airbyte-server-svc:8001                                                                                                                                                                                             │
│     at io.micronaut.http.client.loadbalance.AbstractRoundRobinLoadBalancer.getNextAvailable(AbstractRoundRobinLoadBalancer.java:50) ~[micronaut-http-client-core-3.10.1.jar:3.10.1]                                                                                                                                      │
│     at io.micronaut.core.async.publisher.Publishers$1.doOnNext(Publishers.java:246) ~[micronaut-core-reactive-3.10.1.jar:3.10.1]                                                                                                                                                                                         │
│     at io.micronaut.core.async.subscriber.CompletionAwareSubscriber.onNext(CompletionAwareSubscriber.java:56) ~[micronaut-core-reactive-3.10.1.jar:3.10.1]                                                                                                                                                               │
│     at reactor.core.publisher.StrictSubscriber.onNext(StrictSubscriber.java:89) ~[reactor-core-3.5.5.jar:3.5.5]                                                                                                                                                                                                          │
│     at io.micronaut.reactive.reactor.instrument.ReactorSubscriber.onNext(ReactorSubscriber.java:57) ~[micronaut-runtime-3.10.1.jar:3.10.1]                                                                                                                                                                               │
│     at reactor.core.publisher.Operators$ScalarSubscription.request(Operators.java:2545) ~[reactor-core-3.5.5.jar:3.5.5]                                                                                                                                                                                                  │
│     at reactor.core.publisher.StrictSubscriber.onSubscribe(StrictSubscriber.java:77) ~[reactor-core-3.5.5.jar:3.5.5]                                                                                                                                                                                                     │
│     at io.micronaut.reactive.reactor.instrument.ReactorSubscriber.onSubscribe(ReactorSubscriber.java:50) ~[micronaut-runtime-3.10.1.jar:3.10.1]                                                                                                                                                                          │
│     at reactor.core.publisher.FluxJust.subscribe(FluxJust.java:68) ~[reactor-core-3.5.5.jar:3.5.5]                                                                                                                                                                                                                       │
│     at reactor.core.publisher.Flux.subscribe(Flux.java:8671) ~[reactor-core-3.5.5.jar:3.5.5]                                                                                                                                                                                                                             │
│     at io.micronaut.core.async.publisher.Publishers.lambda$map$3(Publishers.java:237) ~[micronaut-core-reactive-3.10.1.jar:3.10.1]                                                                                                                                                                                       │
│     at reactor.core.publisher.FluxSource.subscribe(FluxSource.java:74) ~[reactor-core-3.5.5.jar:3.5.5]                                                                                                                                                                                                                   │
│     at reactor.core.publisher.Flux.subscribe(Flux.java:8671) ~[reactor-core-3.5.5.jar:3.5.5]                                                                                                                                                                                                                             │
│     at reactor.core.publisher.Flux.blockFirst(Flux.java:2701) ~[reactor-core-3.5.5.jar:3.5.5]                                                                                                                                                                                                                            │
│     at io.micronaut.http.client.netty.DefaultHttpClient$1.exchange(DefaultHttpClient.java:499) ~[micronaut-http-client-3.10.1.jar:3.10.1]                                                                                                                                                                                │
│     at io.micronaut.http.client.interceptor.HttpClientIntroductionAdvice.lambda$intercept$3(HttpClientIntroductionAdvice.java:402) ~[micronaut-http-client-core-3.10.1.jar:3.10.1]                                                                                                                                       │
│     at io.micronaut.http.client.interceptor.HttpClientIntroductionAdvice.handleBlockingCall(HttpClientIntroductionAdvice.java:510) ~[micronaut-http-client-core-3.10.1.jar:3.10.1]                                                                                                                                       │
│     at io.micronaut.http.client.interceptor.HttpClientIntroductionAdvice.intercept(HttpClientIntroductionAdvice.java:401) ~[micronaut-http-client-core-3.10.1.jar:3.10.1]                                                                                                                                                │
│     at io.micronaut.aop.chain.MethodInterceptorChain.proceed(MethodInterceptorChain.java:137) ~[micronaut-aop-3.10.1.jar:3.10.1]                                                                                                                                                                                         │
│     at io.micronaut.retry.intercept.RecoveryInterceptor.intercept(RecoveryInterceptor.java:98) ~[micronaut-runtime-3.10.1.jar:3.10.1]                                                                                                                                                                                    │
│     at io.micronaut.aop.chain.MethodInterceptorChain.proceed(MethodInterceptorChain.java:137) ~[micronaut-aop-3.10.1.jar:3.10.1]                                                                                                                                                                                         │
│     at io.airbyte.api.server.forwardingClient.ConfigApiClient$Intercepted.getSource(Unknown Source) ~[io.airbyte-airbyte-api-server-0.50.35.jar:?]                                                                                                                                                                       │
│     at io.airbyte.api.server.services.SourceServiceImpl.getSource(SourceService.kt:215) ~[io.airbyte-airbyte-api-server-0.50.35.jar:?]                                                                                                                                                                                   │
│     at io.airbyte.api.server.controllers.SourcesController.getSource$lambda$3(SourcesController.kt:131) ~[io.airbyte-airbyte-api-server-0.50.35.jar:?]                                                                                                                                                                   │
│     at io.airbyte.api.server.apiTracking.TrackingHelper.callWithTracker(TrackingHelper.kt:105) ~[io.airbyte-airbyte-api-server-0.50.35.jar:?]                                                                                                                                                                            │
│     at io.airbyte.api.server.controllers.SourcesController.getSource(SourcesController.kt:129) ~[io.airbyte-airbyte-api-server-0.50.35.jar:?]                                                                                                                                                                            │
│     at io.airbyte.api.server.controllers.$SourcesController$Definition$Exec.dispatch(Unknown Source) ~[io.airbyte-airbyte-api-server-0.50.35.jar:?]                                                                                                                                                                      │
│     at io.micronaut.context.AbstractExecutableMethodsDefinition$DispatchedExecutableMethod.invoke(AbstractExecutableMethodsDefinition.java:371) ~[micronaut-inject-3.10.1.jar:3.10.1]                                                                                                                                    │
│     at io.micronaut.context.DefaultBeanContext$4.invoke(DefaultBeanContext.java:594) ~[micronaut-inject-3.10.1.jar:3.10.1]                                                                                                                                                                                               │
│     at io.micronaut.web.router.AbstractRouteMatch.execute(AbstractRouteMatch.java:303) ~[micronaut-router-3.10.1.jar:3.10.1]                                                                                                                                                                                             │
│     at io.micronaut.web.router.RouteMatch.execute(RouteMatch.java:111) ~[micronaut-router-3.10.1.jar:3.10.1]                                                                                                                                                                                                             │
│     at io.micronaut.http.context.ServerRequestContext.with(ServerRequestContext.java:103) ~[micronaut-http-3.10.1.jar:3.10.1]                                                                                                                                                                                            │
│     at io.micronaut.http.server.RouteExecutor.lambda$executeRoute$14(RouteExecutor.java:659) ~[micronaut-http-server-3.10.1.jar:3.10.1]                                                                                                                                                                                  │
│     at reactor.core.publisher.FluxDeferContextual.subscribe(FluxDeferContextual.java:49) ~[reactor-core-3.5.5.jar:3.5.5]                                                                                                                                                                                                 │
│     at reactor.core.publisher.InternalFluxOperator.subscribe(InternalFluxOperator.java:62) ~[reactor-core-3.5.5.jar:3.5.5]                                                                                                                                                                                               │
│     at reactor.core.publisher.FluxSubscribeOn$SubscribeOnSubscriber.run(FluxSubscribeOn.java:194) ~[reactor-core-3.5.5.jar:3.5.5]                                                                                                                                                                                        │
│     at io.micronaut.reactive.reactor.instrument.ReactorInstrumentation.lambda$init$0(ReactorInstrumentation.java:62) ~[micronaut-runtime-3.10.1.jar:3.10.1]                                                                                                                                                              │
│     at reactor.core.scheduler.WorkerTask.call(WorkerTask.java:84) ~[reactor-core-3.5.5.jar:3.5.5]                                                                                                                                                                                                                        │
│     at reactor.core.scheduler.WorkerTask.call(WorkerTask.java:37) ~[reactor-core-3.5.5.jar:3.5.5]                                                                                                                                                                                                                        │
│     at io.micronaut.scheduling.instrument.InvocationInstrumenterWrappedCallable.call(InvocationInstrumenterWrappedCallable.java:53) ~[micronaut-context-3.10.1.jar:3.10.1]                                                                                                                                               │
│     at java.util.concurrent.FutureTask.run(FutureTask.java:317) ~[?:?]                                                                                                                                                                                                                                                   │
│     at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) ~[?:?]                                                                                                                                                                                                                            │
│     at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) ~[?:?]                                                                                                                                                                                                                            │
│     at java.lang.Thread.run(Thread.java:1589) ~[?:?]                                                                                                                                                                                                                                                                     │
│     Suppressed: java.lang.Exception: #block terminated with an error                                                                                                                                                                                                                                                     │
│         at reactor.core.publisher.BlockingSingleSubscriber.blockingGet(BlockingSingleSubscriber.java:99) ~[reactor-core-3.5.5.jar:3.5.5]                                                                                                                                                                                 │
│         at reactor.core.publisher.Flux.blockFirst(Flux.java:2702) ~[reactor-core-3.5.5.jar:3.5.5]                                                                                                                                                                                                                        │
│         at io.micronaut.http.client.netty.DefaultHttpClient$1.exchange(DefaultHttpClient.java:499) ~[micronaut-http-client-3.10.1.jar:3.10.1]                                                                                                                                                                            │
│         at io.micronaut.http.client.interceptor.HttpClientIntroductionAdvice.lambda$intercept$3(HttpClientIntroductionAdvice.java:402) ~[micronaut-http-client-core-3.10.1.jar:3.10.1]                                                                                                                                   │
│         at io.micronaut.http.client.interceptor.HttpClientIntroductionAdvice.handleBlockingCall(HttpClientIntroductionAdvice.java:510) ~[micronaut-http-client-core-3.10.1.jar:3.10.1]                                                                                                                                   │
│         at io.micronaut.http.client.interceptor.HttpClientIntroductionAdvice.intercept(HttpClientIntroductionAdvice.java:401) ~[micronaut-http-client-core-3.10.1.jar:3.10.1]                                                                                                                                            │
│         at io.micronaut.aop.chain.MethodInterceptorChain.proceed(MethodInterceptorChain.java:137) ~[micronaut-aop-3.10.1.jar:3.10.1]                                                                                                                                                                                     │
│         at io.micronaut.retry.intercept.RecoveryInterceptor.intercept(RecoveryInterceptor.java:98) ~[micronaut-runtime-3.10.1.jar:3.10.1]                                                                                                                                                                                │
│         at io.micronaut.aop.chain.MethodInterceptorChain.proceed(MethodInterceptorChain.java:137) ~[micronaut-aop-3.10.1.jar:3.10.1]                                                                                                                                                                                     │
│         at io.airbyte.api.server.forwardingClient.ConfigApiClient$Intercepted.getSource(Unknown Source) ~[io.airbyte-airbyte-api-server-0.50.35.jar:?]                                                                                                                                                                   │
│         at io.airbyte.api.server.services.SourceServiceImpl.getSource(SourceService.kt:215) ~[io.airbyte-airbyte-api-server-0.50.35.jar:?]                                                                                                                                                                               │
│         at io.airbyte.api.server.controllers.SourcesController.getSource$lambda$3(SourcesController.kt:131) ~[io.airbyte-airbyte-api-server-0.50.35.jar:?]                                                                                                                                                               │
│         at io.airbyte.api.server.apiTracking.TrackingHelper.callWithTracker(TrackingHelper.kt:105) ~[io.airbyte-airbyte-api-server-0.50.35.jar:?]                                                                                                                                                                        │
│         at io.airbyte.api.server.controllers.SourcesController.getSource(SourcesController.kt:129) ~[io.airbyte-airbyte-api-server-0.50.35.jar:?]                                                                                                                                                                        │
│         at io.airbyte.api.server.controllers.$SourcesController$Definition$Exec.dispatch(Unknown Source) ~[io.airbyte-airbyte-api-server-0.50.35.jar:?]                                                                                                                                                                  │
│         at io.micronaut.context.AbstractExecutableMethodsDefinition$DispatchedExecutableMethod.invoke(AbstractExecutableMethodsDefinition.java:371) ~[micronaut-inject-3.10.1.jar:3.10.1]                                                                                                                                │
│         at io.micronaut.context.DefaultBeanContext$4.invoke(DefaultBeanContext.java:594) ~[micronaut-inject-3.10.1.jar:3.10.1]                                                                                                                                                                                           │
│         at io.micronaut.web.router.AbstractRouteMatch.execute(AbstractRouteMatch.java:303) ~[micronaut-router-3.10.1.jar:3.10.1]                                                                                                                                                                                         │
│         at io.micronaut.web.router.RouteMatch.execute(RouteMatch.java:111) ~[micronaut-router-3.10.1.jar:3.10.1]                                                                                                                                                                                                         │
│         at io.micronaut.http.context.ServerRequestContext.with(ServerRequestContext.java:103) ~[micronaut-http-3.10.1.jar:3.10.1]                                                                                                                                                                                        │
│         at io.micronaut.http.server.RouteExecutor.lambda$executeRoute$14(RouteExecutor.java:659) ~[micronaut-http-server-3.10.1.jar:3.10.1]                                                                                                                                                                              │
│         at reactor.core.publisher.FluxDeferContextual.subscribe(FluxDeferContextual.java:49) ~[reactor-core-3.5.5.jar:3.5.5]                                                                                                                                                                                             │
│         at reactor.core.publisher.InternalFluxOperator.subscribe(InternalFluxOperator.java:62) ~[reactor-core-3.5.5.jar:3.5.5]                                                                                                                                                                                           │
│         at reactor.core.publisher.FluxSubscribeOn$SubscribeOnSubscriber.run(FluxSubscribeOn.java:194) ~[reactor-core-3.5.5.jar:3.5.5]                                                                                                                                                                                    │
│         at io.micronaut.reactive.reactor.instrument.ReactorInstrumentation.lambda$init$0(ReactorInstrumentation.java:62) ~[micronaut-runtime-3.10.1.jar:3.10.1]                                                                                                                                                          │
│         at reactor.core.scheduler.WorkerTask.call(WorkerTask.java:84) ~[reactor-core-3.5.5.jar:3.5.5]                                                                                                                                                                                                                    │
│         at reactor.core.scheduler.WorkerTask.call(WorkerTask.java:37) ~[reactor-core-3.5.5.jar:3.5.5]                                                                                                                                                                                                                    │
│         at io.micronaut.scheduling.instrument.InvocationInstrumenterWrappedCallable.call(InvocationInstrumenterWrappedCallable.java:53) ~[micronaut-context-3.10.1.jar:3.10.1]                                                                                                                                           │
│         at java.util.concurrent.FutureTask.run(FutureTask.java:317) ~[?:?]                                                                                                                                                                                                                                               │
│         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) ~[?:?]                                                                                                                                                                                                                        │
│         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) ~[?:?]                                                                                                                                                                                                                        │
│         at java.lang.Thread.run(Thread.java:1589) ~[?:?]

[nurikk-sa]

Fix just landed airbytehq/airbyte-platform@b28dc9c

[Anton-Shutik]

Thanks!