Deserialization error while trying to use pulumi-awsgateway #594

slnowak · 2022-05-16T16:49:24Z

What happened?

When trying to run a minimalistic example with aws-apigateway, pulumi throws the following error:

➜  java git:(master) ✗ pulumi up -y
Please choose a stack, or create a new one: dev
Previewing update (dev)

View Live: https://app.pulumi.com/slnowak/iac-workshop-lambda-api-gateway/dev/previews/c164ea18-8eca-49fd-a031-75c4ad640d60

     Type                             Name                                 Plan       Info
 +   pulumi:pulumi:Stack              iac-workshop-lambda-api-gateway-dev  create     2 errors; 16 messages
 +   ├─ aws:iam:Role                  lambdaRole                           create     
 +   ├─ aws:iam:RolePolicyAttachment  basicExecutionRole                   create     
 +   ├─ aws:lambda:Function           helloWorldFunction                   create     
 +   └─ apigateway:index:RestAPI      helloWorldApi                        create     
 +      ├─ aws:apigateway:RestApi     helloWorldApi                        create     
 +      ├─ aws:apigateway:Deployment  helloWorldApi                        create     
 +      ├─ aws:lambda:Permission      helloWorldApi-fa520765               create     
 +      └─ aws:apigateway:Stage       helloWorldApi                        create     
 
Diagnostics:
  pulumi:pulumi:Stack (iac-workshop-lambda-api-gateway-dev):
    error: Running program [PID: 13747](/usr/local/opt/openjdk/libexec/openjdk.jdk/Contents/Home/bin/java -classpath /usr/local/Cellar/maven/3.8.5/libexec/boot/plexus-classworlds-2.6.0.jar -Dclassworlds.conf=/usr/local/Cellar/maven/3.8.5/libexec/bin/m2.conf -Dmaven.home=/usr/local/Cellar/maven/3.8.5/libexec -Dlibrary.jansi.path=/usr/local/Cellar/maven/3.8.5/libexec/lib/jansi-native -Dmaven.multiModuleProjectDirectory=/Users/snowak/work/internal/pulumi/python_course/lambda/module2/java org.codehaus.plexus.classworlds.launcher.Launcher --quiet --no-transfer-progress compile exec:java) failed with an unhandled exception:
    java.lang.UnsupportedOperationException: com.pulumi.awsapigateway.RestAPI.api; Expected 'com.pulumi.aws.apigateway.RestApi' but got 'com.pulumi.resources.DependencyResource' while deserializing.
        at com.pulumi.serialization.internal.Converter.tryEnsureType(Converter.java:458)
        at com.pulumi.serialization.internal.Converter.tryConvertObjectInner(Converter.java:247)
        at com.pulumi.serialization.internal.Converter.convertObjectUntyped(Converter.java:105)
        at com.pulumi.serialization.internal.Converter.convertValue(Converter.java:80)
        at com.pulumi.core.internal.OutputCompletionSource.setValue(OutputCompletionSource.java:95)
        at com.pulumi.deployment.internal.DeploymentImpl$ReadOrRegisterResource.lambda$completeResourceAsync$0(DeploymentImpl.java:1162)
        at java.base/java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:646)
        at java.base/java.util.concurrent.CompletableFuture$Completion.exec(CompletableFuture.java:483)
        at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373)
        at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182)
        at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655)
        at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622)
        at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165)
    error: an unhandled error occurred: '/usr/local/bin/mvn /usr/local/bin/mvn --quiet --no-transfer-progress compile exec:java' exited with non-zero exit code: 32
 
    May 16, 2022 6:29:22 PM com.pulumi.deployment.internal.DeploymentImpl$DefaultEngineLogger errorAsync
    SEVERE: Running program [PID: 13747](/usr/local/opt/openjdk/libexec/openjdk.jdk/Contents/Home/bin/java -classpath /usr/local/Cellar/maven/3.8.5/libexec/boot/plexus-classworlds-2.6.0.jar -Dclassworlds.conf=/usr/local/Cellar/maven/3.8.5/libexec/bin/m2.conf -Dmaven.home=/usr/local/Cellar/maven/3.8.5/libexec -Dlibrary.jansi.path=/usr/local/Cellar/maven/3.8.5/libexec/lib/jansi-native -Dmaven.multiModuleProjectDirectory=/Users/snowak/work/internal/pulumi/python_course/lambda/module2/java org.codehaus.plexus.classworlds.launcher.Launcher --quiet --no-transfer-progress compile exec:java) failed with an unhandled exception:
    java.lang.UnsupportedOperationException: com.pulumi.awsapigateway.RestAPI.api; Expected 'com.pulumi.aws.apigateway.RestApi' but got 'com.pulumi.resources.DependencyResource' while deserializing.
        at com.pulumi.serialization.internal.Converter.tryEnsureType(Converter.java:458)
        at com.pulumi.serialization.internal.Converter.tryConvertObjectInner(Converter.java:247)
        at com.pulumi.serialization.internal.Converter.convertObjectUntyped(Converter.java:105)
        at com.pulumi.serialization.internal.Converter.convertValue(Converter.java:80)
        at com.pulumi.core.internal.OutputCompletionSource.setValue(OutputCompletionSource.java:95)
        at com.pulumi.deployment.internal.DeploymentImpl$ReadOrRegisterResource.lambda$completeResourceAsync$0(DeploymentImpl.java:1162)
        at java.base/java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:646)
        at java.base/java.util.concurrent.CompletableFuture$Completion.exec(CompletableFuture.java:483)
        at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373)
        at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182)
        at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655)
        at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622)
        at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165)

Steps to reproduce

Use the following code snippet:

package myproject;

import com.pulumi.Pulumi;
import com.pulumi.asset.AssetArchive;
import com.pulumi.asset.StringAsset;
import com.pulumi.aws.iam.Role;
import com.pulumi.aws.iam.RoleArgs;
import com.pulumi.aws.iam.RolePolicyAttachment;
import com.pulumi.aws.iam.RolePolicyAttachmentArgs;
import com.pulumi.aws.iam.enums.ManagedPolicy;
import com.pulumi.aws.lambda.Function;
import com.pulumi.aws.lambda.FunctionArgs;
import com.pulumi.aws.lambda.enums.Runtime;
import com.pulumi.awsapigateway.RestAPI;
import com.pulumi.awsapigateway.RestAPIArgs;
import com.pulumi.awsapigateway.enums.Method;
import com.pulumi.awsapigateway.inputs.RouteArgs;

import java.util.Map;

public class App1 {

    public static void main(String[] args) {
        Pulumi.run(ctx -> {
            var role = new Role("lambdaRole", RoleArgs.builder()
                    .assumeRolePolicy("""
                            {
                              "Version": "2012-10-17",
                              "Statement": [
                                {
                                  "Effect": "Allow",
                                  "Principal": {
                                    "Service": "lambda.amazonaws.com"
                                  },
                                  "Action": "sts:AssumeRole"
                                }
                              ]
                            }""")
                    .build()
            );

            var lambdaBasicExecutionRole = new RolePolicyAttachment("basicExecutionRole", RolePolicyAttachmentArgs.builder()
                    .role(role.name())
                    .policyArn(ManagedPolicy.AWSLambdaBasicExecutionRole.getValue())
                    .build());

            var api = new RestAPI("helloWorldApi", RestAPIArgs.builder()
                    .routes(
                            RouteArgs.builder()
                                    .path("/")
                                    .method(Method.GET)
                                    .eventHandler(
                                            new Function("helloWorldFunction", FunctionArgs.builder()
                                                    .role(role.arn())
                                                    .handler("index.handler")
                                                    .runtime(Runtime.NodeJS12dX)
                                                    .code(new AssetArchive(Map.of("index.js", new StringAsset("""
                                                            exports.handler = async (event) => {
                                                                return {
                                                                    statusCode: 200,
                                                                    body: "Hello, world!",
                                                                };
                                                            }"""))))
                                                    .build()))
                                    .build()
                    )
                    .build());

        });
    }
}

maven dependencies:

    <dependencies>
        <dependency>
            <groupId>com.pulumi</groupId>
            <artifactId>pulumi</artifactId>
            <version>0.1.0</version>
        </dependency>
        <dependency>
            <groupId>com.pulumi</groupId>
            <artifactId>aws</artifactId>
            <version>5.3.0</version>
        </dependency>
        <dependency>
            <groupId>com.pulumi</groupId>
            <artifactId>aws</artifactId>
            <version>5.3.0</version>
        </dependency>
        <dependency>
            <groupId>com.pulumi</groupId>
            <artifactId>aws-apigateway</artifactId>
            <version>0.0.7</version>
        </dependency>
        <dependency>
            <groupId>com.pulumi</groupId>
            <artifactId>awsx</artifactId>
            <version>1.0.0-beta.1</version>
        </dependency>
    </dependencies>

Both awsx and aws-apigateway artifacts were built locally from the following git commit:

commit 40c68a28d140422dc77759fb48ae3d5a3540749e (HEAD -> main, tag: aws-apigateway/v0.0.7, origin/main, origin/HEAD)
Author: Paweł Prażak <pawelprazak@users.noreply.github.com>
Date:   Thu May 12 08:47:11 2022 +0200

    Fix version typo (#587)
    
    * Fix #586 - version typo
    
    * Revert redundant provider deletion

Expected Behavior

Successfull execution

Actual Behavior

Execution error

Versions used

No response

Additional context

No response

Contributing

Vote on this issue by adding a 👍 reaction.
To contribute a fix for this issue, leave a comment (and link to your pull request, if you've opened one already).

The text was updated successfully, but these errors were encountered:

pawelprazak · 2022-05-17T09:44:54Z

I wasn't able to reproduce this yet, but my working assumption is that:

com.pulumi.serialization.internal.ResourcePackages#tryConstruct returns Optional.empty()
as a consequence com.pulumi.serialization.internal.Deserializer#tryDeserializeResource returns DependencyResource

pawelprazak · 2022-05-17T09:46:11Z

An ongoing effort at reproducing and fixing is being done here:
#597

pawelprazak · 2022-05-17T14:34:23Z

We've managed get a new error and more debugging info:

...
debug: Registering resource monitor end: t=aws-apigateway:index:RestAPI, name=helloWorldApi, custom=false, remote=true
    debug: Read response for resource: t=aws-apigateway:index:RestAPI, name=helloWorldApi, urn=urn:pulumi:dev::iac-workshop-lambda-api-gateway::apigateway:index:RestAPI::helloWorldApi, id=, remote=true
    debug: Deserialize/ResourcePackages: searching for type=aws:apigateway/restApi:RestApi version= urn=urn:pulumi:dev::iac-workshop-lambda-api-gateway::apigateway:index:RestAPI$aws:apigateway/restApi:RestApi::helloWorldApi
    debug: Deserialize/ResourcePackages: constructing type=aws:apigateway/restApi:RestApi version= urn=urn:pulumi:dev::iac-workshop-lambda-api-gateway::apigateway:index:RestAPI$aws:apigateway/restApi:RestApi::helloWorldApi
    debug: Reading existing resource: t=aws:apigateway/restApi:RestApi, name=helloWorldApi, urn=urn:pulumi:dev::iac-workshop-lambda-api-gateway::apigateway:index:RestAPI$aws:apigateway/restApi:RestApi::helloWorldApi, remote=false
    debug: Invoking function: token='pulumi:pulumi:getResource' asynchronously
    debug: Serialize property[invoke:pulumi:pulumi:getResource.urn]: Recursion into InputOutput
    debug: Serialize property[invoke:pulumi:pulumi:getResource.urn.id]: primitive=urn:pulumi:dev::iac-workshop-lambda-api-gateway::apigateway:index:RestAPI$aws:apigateway/restApi:RestApi::helloWorldApi
    debug: Invoke RPC prepared: token='pulumi:pulumi:getResource', obj='com.pulumi.serialization.internal.PropertiesSerializer$SerializationResult@4caa0879'
    debug: Deserialize/ResourcePackages: searching for type=apigateway:index:RestAPI version= urn=urn:pulumi:dev::iac-workshop-lambda-api-gateway::apigateway:index:RestAPI::helloWorldApi
    debug: Deserialize/ResourcePackages: can't find a resource: 'apigateway:index:RestAPI' version: 'Deserialize/ResourcePackages: can't find a resource: 'apigateway:index:RestAPI' version: '; Available resources type names:
    ...
    aws-apigateway:index:RestAPI
    ...
    aws:apigateway/restApi:RestApi
    ...

So this one worked:

debug: Deserialize/ResourcePackages: searching for type=aws:apigateway/restApi:RestApi version= urn=urn:pulumi:dev::iac-workshop-lambda-api-gateway::apigateway:index:RestAPI$aws:apigateway/restApi:RestApi::helloWorldApi
debug: Deserialize/ResourcePackages: constructing type=aws:apigateway/restApi:RestApi version= urn=urn:pulumi:dev::iac-workshop-lambda-api-gateway::apigateway:index:RestAPI$aws:apigateway/restApi:RestApi::helloWorldApi

And this one failed:

debug: Deserialize/ResourcePackages: searching for type=apigateway:index:RestAPI version= urn=urn:pulumi:dev::iac-workshop-lambda-api-gateway::apigateway:index:RestAPI::helloWorldApi
debug: Deserialize/ResourcePackages: can't find a resource: 'apigateway:index:RestAPI' version: 'Deserialize/ResourcePackages: can't find a resource: 'apigateway:index:RestAPI' version: '

pawelprazak · 2022-05-17T14:38:12Z

The resources themselves are:

@ResourceType(type="aws-apigateway:index:RestAPI")
public class RestAPI extends com.pulumi.resources.ComponentResource

@ResourceType(type="aws:apigateway/restApi:RestApi")
public class RestApi extends com.pulumi.resources.CustomResource

So the ResourcePackages picked the resource correctly, but maybe somewhere the aws- got removed.

pawelprazak · 2022-05-17T15:09:51Z

This is interesting:

    debug: Got parent urn: t=aws-apigateway:index:RestAPI, name=helloWorldApi, custom=false, remote=true
    debug: Prepared resource: t=aws-apigateway:index:RestAPI, name=helloWorldApi, custom=false, remote=true
    debug: Registering resource monitor start: t=aws-apigateway:index:RestAPI, name=helloWorldApi, custom=false, remote=true
    ...
    debug: Registering resource: t=apigateway:index:RestAPI, name=helloWorldApi, custom=false, remote=false
    debug: RegisterResource RPC prepared: t=apigateway:index:RestAPI, name=helloWorldApi

Looks like we send aws-apigateway:index:RestAPI to gRPC endpoint, and the engine gets apigateway:index:RestAPI.

Is that possible?

Edit:
~~I see the code that prints debug: Registering resource: t is in nodejs, is it possible that the project has some dirty state? from porting nodejs to java and reusing state somehow?~~

pawelprazak · 2022-05-17T15:38:25Z

Also, later in the logs, now the stack trace is slightly different:

    debug: Read response for resource: t=aws:apigateway/restApi:RestApi, name=helloWorldApi, urn=urn:pulumi:dev::iac-workshop-lambda-api-gateway::apigateway:index:RestAPI$aws:apigateway/restApi:RestApi::helloWorldApi, id=, remote=false
    error: Running program [PID: 25091](/usr/local/opt/openjdk/libexec/openjdk.jdk/Contents/Home/bin/java -classpath /usr/local/Cellar/maven/3.8.5/libexec/boot/plexus-classworlds-2.6.0.jar -Dclassworlds.conf=/usr/local/Cellar/maven/3.8.5/libexec/bin/m2.conf -Dmaven.home=/usr/local/Cellar/maven/3.8.5/libexec -Dlibrary.jansi.path=/usr/local/Cellar/maven/3.8.5/libexec/lib/jansi-native -Dmaven.multiModuleProjectDirectory=/Users/snowak/work/internal/pulumi/python_course/lambda/module2/java org.codehaus.plexus.classworlds.launcher.Launcher --quiet --no-transfer-progress compile exec:java) failed with an unhandled exception:
    java.lang.UnsupportedOperationException: com.pulumi.awsapigateway.RestAPI.deployment; Expected 'com.pulumi.aws.apigateway.Deployment' but got 'com.pulumi.resources.DependencyResource' while deserializing.
    	at com.pulumi.serialization.internal.Converter.tryEnsureType(Converter.java:458)
    	at com.pulumi.serialization.internal.Converter.tryConvertObjectInner(Converter.java:247)
    	at com.pulumi.serialization.internal.Converter.convertObjectUntyped(Converter.java:105)
    	at com.pulumi.serialization.internal.Converter.convertValue(Converter.java:80)
    	at com.pulumi.core.internal.OutputCompletionSource.setValue(OutputCompletionSource.java:95)
    	at com.pulumi.deployment.internal.DeploymentImpl$ReadOrRegisterResource.lambda$completeResourceAsync$0(DeploymentImpl.java:1162)
    	at java.base/java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:646)
    	at java.base/java.util.concurrent.CompletableFuture$Completion.exec(CompletableFuture.java:483)
    	at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373)
    	at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182)
    	at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655)
    	at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622)
    	at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165)

The type is com.pulumi.aws.apigateway.Deployment instead of com.pulumi.aws.apigateway.RestApi as before.

The com.pulumi.awsapigateway.RestAPI fields:

@Export(name="api", type=RestApi.class, parameters={})
private Output<RestApi> api;

and

@Export(name="deployment", type=Deployment.class, parameters={})
private Output<Deployment> deployment;

Might be just accidentally different ordering of setting the RestAPI fields.

pawelprazak · 2022-05-18T13:42:03Z

Looks like an upstream issue: pulumi/pulumi-aws-apigateway#21

pawelprazak · 2022-05-19T15:00:24Z

Patch was merged upstream, we're waiting for the provider release v0.0.8.

pawelprazak · 2022-05-20T08:40:19Z

We have a new error:

May 19, 2022 6:16:36 PM com.pulumi.deployment.internal.DeploymentImpl$DefaultEngineLogger errorAsync
    SEVERE: Running program [PID: 48794](/usr/local/opt/openjdk/libexec/openjdk.jdk/Contents/Home/bin/java -classpath /usr/local/Cellar/maven/3.8.5/libexec/boot/plexus-classworlds-2.6.0.jar -Dclassworlds.conf=/usr/local/Cellar/maven/3.8.5/libexec/bin/m2.conf -Dmaven.home=/usr/local/Cellar/maven/3.8.5/libexec -Dlibrary.jansi.path=/usr/local/Cellar/maven/3.8.5/libexec/lib/jansi-native -Dmaven.multiModuleProjectDirectory=/Users/snowak/work/internal/pulumi/python_course/lambda/module2/java org.codehaus.plexus.classworlds.launcher.Launcher --quiet --no-transfer-progress compile exec:java) failed with an unhandled exception:
    java.lang.UnsupportedOperationException: com.pulumi.awsapigateway.RestAPI.deployment; Expected 'com.pulumi.aws.apigateway.Deployment' but got 'com.pulumi.awsapigateway.RestAPI' while deserializing.
    	at com.pulumi.serialization.internal.Converter.tryEnsureType(Converter.java:463)
    	at com.pulumi.serialization.internal.Converter.tryConvertObjectInner(Converter.java:252)
    	at com.pulumi.serialization.internal.Converter.convertObjectUntyped(Converter.java:110)
    	at com.pulumi.serialization.internal.Converter.convertValue(Converter.java:81)
    	at com.pulumi.core.internal.OutputCompletionSource.setValue(OutputCompletionSource.java:95)
    	at com.pulumi.deployment.internal.DeploymentImpl$ReadOrRegisterResource.lambda$completeResourceAsync$0(DeploymentImpl.java:1162)
    	at java.base/java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:646)
    	at java.base/java.util.concurrent.CompletableFuture$Completion.exec(CompletableFuture.java:483)
    	at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373)
    	at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182)
    	at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655)
    	at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622)
    	at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165)

pawelprazak · 2022-05-23T13:39:35Z

Auto-closed by the fix addressing the previous issue, re-opening.

pawelprazak · 2022-05-23T13:40:39Z

I can see no other reason for this than the provider returning the wrong object then a bug:

debug: Read response for resource: t=aws-apigateway:index:RestAPI, name=helloWorldApi, urn=urn:pulumi:dev::iac-workshop-lambda-api-gateway::aws-apigateway:index:RestAPI::helloWorldApi, id=, remote=true, data=fields {
      key: "api"
      value {
        struct_value {
          fields {
            key: "4dabf18193072939515e22adb298388d"
            value {
              string_value: "5cf8f73096256a8f31e491e813e4eb8e"
            }
          }
          fields {
            key: "id"
            value {
              string_value: ""
            }
          }
          fields {
            key: "urn"
            value {
              string_value: "urn:pulumi:dev::iac-workshop-lambda-api-gateway::aws-apigateway:index:RestAPI$aws:apigateway/restApi:RestApi::helloWorldApi"
            }
          }
        }
      }
    }
    fields {
      key: "deployment"
      value {
        struct_value {
          fields {
            key: "4dabf18193072939515e22adb298388d"
            value {
              string_value: "5cf8f73096256a8f31e491e813e4eb8e"
            }
          }
          fields {
            key: "urn"
            value {
              string_value: "urn:pulumi:dev::iac-workshop-lambda-api-gateway::aws-apigateway:index:RestAPI::helloWorldApi"
            }
          }
        }
      }
    }
    fields {
      key: "stage"
      value {
        struct_value {
          fields {
            key: "4dabf18193072939515e22adb298388d"
            value {
              string_value: "5cf8f73096256a8f31e491e813e4eb8e"
            }
          }
          fields {
            key: "id"
            value {
              string_value: ""
            }
          }
          fields {
            key: "urn"
            value {
              string_value: "urn:pulumi:dev::iac-workshop-lambda-api-gateway::aws-apigateway:index:RestAPI$aws:apigateway/stage:Stage::helloWorldApi"
            }
          }
        }
      }
    }

pawelprazak · 2022-05-23T13:46:59Z

I've reported upstream: pulumi/pulumi-aws-apigateway#41

t0yv0 · 2022-05-23T19:23:12Z

I'm trying to follow the discussion but only the issue description from @slnowak is making sense to me.

I can reproduce with:

    <dependencies>
        <dependency>
            <groupId>com.pulumi</groupId>
            <artifactId>aws-apigateway</artifactId>
            <version>0.0.8</version>
        </dependency>
        <dependency>
            <groupId>com.pulumi</groupId>
            <artifactId>pulumi</artifactId>
            <version>0.2.1</version>
        </dependency>
        <dependency>
            <groupId>com.pulumi</groupId>
            <artifactId>aws</artifactId>
            <version>5.4.0</version>
        </dependency>
    </dependencies>

Which gives me the original exception:

    java.lang.UnsupportedOperationException: com.pulumi.awsapigateway.RestAPI.api; Expected 'com.pulumi.aws.apigateway.RestApi' but got 'com.pulumi.resources.DependencyResource' while deserializing.
        at com.pulumi.serialization.internal.Converter.tryEnsureType(Converter.java:458)
        at com.pulumi.serialization.internal.Converter.tryConvertObjectInner(Converter.java:247)
        at com.pulumi.serialization.internal.Converter.convertObjectUntyped(Converter.java:105)
        at com.pulumi.serialization.internal.Converter.convertValue(Converter.java:80)
        at com.pulumi.core.internal.OutputCompletionSource.setValue(OutputCompletionSource.java:95)
        at com.pulumi.deployment.internal.DeploymentImpl$ReadOrRegisterResource.lambda$completeResourceAsync$0(DeploymentImpl.java:1162)
        at java.base/java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:646)
        at java.base/java.util.concurrent.CompletableFuture$Completion.exec(CompletableFuture.java:483)
        at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:373)
        at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1182)
        at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1655)
        at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1622)
        at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:165)

t0yv0 · 2022-05-23T19:29:06Z

I can confirm I get this when upgrading SDK to the tip of main

    java.lang.UnsupportedOperationException: com.pulumi.awsapigateway.RestAPI.deployment; Expected 'com.pulumi.aws.apigateway.Deployment' but got 'com.pulumi.awsapigateway.RestAPI' while deserializing.

pawelprazak · 2022-05-24T09:03:36Z

I can see no other reason for this than the provider returning the wrong object then a bug:

debug: Read response for resource: t=aws-apigateway:index:RestAPI, name=helloWorldApi, urn=urn:pulumi:dev::iac-workshop-lambda-api-gateway::aws-apigateway:index:RestAPI::helloWorldApi, id=, remote=true, data=fields {
      key: "api"
      value {
        struct_value {
          fields {
            key: "4dabf18193072939515e22adb298388d"
            value {
              string_value: "5cf8f73096256a8f31e491e813e4eb8e"
            }
          }
          fields {
            key: "id"
            value {
              string_value: ""
            }
          }
          fields {
            key: "urn"
            value {
              string_value: "urn:pulumi:dev::iac-workshop-lambda-api-gateway::aws-apigateway:index:RestAPI$aws:apigateway/restApi:RestApi::helloWorldApi"
            }
          }
        }
      }
    }
    fields {
      key: "deployment"
      value {
        struct_value {
          fields {
            key: "4dabf18193072939515e22adb298388d"
            value {
              string_value: "5cf8f73096256a8f31e491e813e4eb8e"
            }
          }
          fields {
            key: "urn"
            value {
              string_value: "urn:pulumi:dev::iac-workshop-lambda-api-gateway::aws-apigateway:index:RestAPI::helloWorldApi"
            }
          }
        }
      }
    }
    fields {
      key: "stage"
      value {
        struct_value {
          fields {
            key: "4dabf18193072939515e22adb298388d"
            value {
              string_value: "5cf8f73096256a8f31e491e813e4eb8e"
            }
          }
          fields {
            key: "id"
            value {
              string_value: ""
            }
          }
          fields {
            key: "urn"
            value {
              string_value: "urn:pulumi:dev::iac-workshop-lambda-api-gateway::aws-apigateway:index:RestAPI$aws:apigateway/stage:Stage::helloWorldApi"
            }
          }
        }
      }
    }

yes, this is what we've got from the provider, the URN is wrong for deployment

pawelprazak · 2022-06-06T13:03:11Z

Reproducing with latest versions from main:
https://gist.github.com/pawelprazak/59f5b8aaafef459b0b0029acb02f0e3a

pawelprazak · 2022-06-06T13:38:21Z

Adding more debugging messages reveal this raw RegisterResourceResponse:

debug: Registering resource monitor end: t=aws-apigateway:index:RestAPI, name=helloWorldApi, custom=false, remote=true, result=urn: "urn:pulumi:pulumi-594-private::pulumi-594::aws-apigateway:index:RestAPI::helloWorldApi"
    object {
      fields {
        key: "api"
        value {
          struct_value {
            fields {
              key: "4dabf18193072939515e22adb298388d"
              value {
                string_value: "5cf8f73096256a8f31e491e813e4eb8e"
              }
            }
            fields {
              key: "id"
              value {
                string_value: ""
              }
            }
            fields {
              key: "urn"
              value {
                string_value: "urn:pulumi:pulumi-594-private::pulumi-594::aws-apigateway:index:RestAPI$aws:apigateway/restApi:RestApi::helloWorldApi"
              }
            }
          }
        }
      }
      fields {
        key: "deployment"
        value {
          struct_value {
            fields {
              key: "4dabf18193072939515e22adb298388d"
              value {
                string_value: "5cf8f73096256a8f31e491e813e4eb8e"
              }
            }
            fields {
              key: "urn"
              value {
                string_value: "urn:pulumi:pulumi-594-private::pulumi-594::aws-apigateway:index:RestAPI::helloWorldApi"
              }
            }
          }
        }
      }
      fields {
        key: "stage"
        value {
          struct_value {
            fields {
              key: "4dabf18193072939515e22adb298388d"
              value {
                string_value: "5cf8f73096256a8f31e491e813e4eb8e"
              }
            }
            fields {
              key: "id"
              value {
                string_value: ""
              }
            }
            fields {
              key: "urn"
              value {
                string_value: "urn:pulumi:pulumi-594-private::pulumi-594::aws-apigateway:index:RestAPI$aws:apigateway/stage:Stage::helloWorldApi"
              }
            }
          }
        }
      }
    }
    propertyDependencies {
      key: "api"
      value {
        urns: "urn:pulumi:pulumi-594-private::pulumi-594::aws:lambda/function:Function::helloWorldFunction"
        urns: "urn:pulumi:pulumi-594-private::pulumi-594::aws-apigateway:index:RestAPI$aws:apigateway/restApi:RestApi::helloWorldApi"
      }
    }
    propertyDependencies {
      key: "deployment"
      value {
        urns: "urn:pulumi:pulumi-594-private::pulumi-594::aws-apigateway:index:RestAPI::helloWorldApi"
      }
    }
    propertyDependencies {
      key: "stage"
      value {
        urns: "urn:pulumi:pulumi-594-private::pulumi-594::aws:lambda/function:Function::helloWorldFunction"
        urns: "urn:pulumi:pulumi-594-private::pulumi-594::aws-apigateway:index:RestAPI$aws:apigateway/stage:Stage::helloWorldApi"
      }
    }
    propertyDependencies {
      key: "url"
      value {
        urns: "urn:pulumi:pulumi-594-private::pulumi-594::aws:lambda/function:Function::helloWorldFunction"
        urns: "urn:pulumi:pulumi-594-private::pulumi-594::aws-apigateway:index:RestAPI$aws:apigateway/deployment:Deployment::helloWorldApi"
      }
    }

What I found interesting is that propertyDependencies for deployment has only two entries, while others have 2 entries.

pawelprazak · 2022-06-06T13:57:27Z

We have this if:

pulumi-java/sdk/java/pulumi/src/main/java/com/pulumi/deployment/internal/DeploymentImpl.java

Line 856 in cb3c1b1

if (remote && options instanceof ComponentResourceOptions) {

And according to the logs aws-apigateway:index:RestAPI fits the criteria: remote and component resource.
This might be the differentiator that makes this resource unique. If true this might help narrow down the code.

t0yv0 · 2022-07-20T18:43:13Z

Debugging this further I believe this is a bug in the provider. Legit looks like a typo. I cannot reproduce after this fix:
pulumi/pulumi-aws-apigateway#56

Stay tuned for an updated version of the provider after my fix is reviewed and released.

slnowak added the kind/bug Some behavior is incorrect or out of spec label May 16, 2022

pawelprazak self-assigned this May 16, 2022

pawelprazak mentioned this issue May 17, 2022

Add deserializer debug #597

Merged

3 tasks

mikhailshilkov added the language/java label May 17, 2022

pawelprazak mentioned this issue May 18, 2022

Resource type in provider not consistent with the schema pulumi/pulumi-aws-apigateway#21

Closed

pawelprazak added the blocked The issue cannot be resolved without 3rd party action. label May 18, 2022

pawelprazak mentioned this issue May 19, 2022

Bump aws-apigateway to v0.0.8 #602

Merged

3 tasks

pawelprazak added a commit that referenced this issue May 19, 2022

Fix #594 classloader issue

de94ff4

pawelprazak closed this as completed in #602 May 20, 2022

pulumi-bot added the resolution/fixed This issue was fixed label May 20, 2022

mikhailshilkov added this to the 0.73 milestone May 23, 2022

pawelprazak reopened this May 23, 2022

pawelprazak removed the resolution/fixed This issue was fixed label May 23, 2022

t0yv0 mentioned this issue May 23, 2022

Provider returns wrong field pulumi/pulumi-aws-apigateway#41

Closed

mikhailshilkov mentioned this issue May 24, 2022

[Epic] Java SDK: GA #598

Open

40 tasks

mikhailshilkov modified the milestones: 0.73, 0.74 Jun 7, 2022

pawelprazak mentioned this issue Jun 7, 2022

Cleanup Resource dependencies code #678

Merged

3 tasks

mikhailshilkov modified the milestones: 0.74, 0.75 Jul 1, 2022

t0yv0 added this to the 0.75 milestone Jul 12, 2022

mikhailshilkov added the area/sdks label Jul 13, 2022

t0yv0 assigned t0yv0 and unassigned pawelprazak Jul 13, 2022

t0yv0 mentioned this issue Jul 20, 2022

Fixes #41 the resource reference returned from constructRestAPI pulumi/pulumi-aws-apigateway#56

Merged

t0yv0 closed this as completed Jul 20, 2022

pulumi-bot added the resolution/fixed This issue was fixed label Jul 20, 2022

t0yv0 removed the blocked The issue cannot be resolved without 3rd party action. label Jul 20, 2022

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Deserialization error while trying to use pulumi-awsgateway #594

Deserialization error while trying to use pulumi-awsgateway #594

slnowak commented May 16, 2022

pawelprazak commented May 17, 2022

pawelprazak commented May 17, 2022

pawelprazak commented May 17, 2022

pawelprazak commented May 17, 2022

pawelprazak commented May 17, 2022 •

edited

Loading

pawelprazak commented May 17, 2022 •

edited

Loading

pawelprazak commented May 18, 2022

pawelprazak commented May 19, 2022

pawelprazak commented May 20, 2022 •

edited

Loading

pawelprazak commented May 23, 2022

pawelprazak commented May 23, 2022 •

edited

Loading

pawelprazak commented May 23, 2022

t0yv0 commented May 23, 2022

t0yv0 commented May 23, 2022

pawelprazak commented May 24, 2022

pawelprazak commented Jun 6, 2022

pawelprazak commented Jun 6, 2022

pawelprazak commented Jun 6, 2022

t0yv0 commented Jul 20, 2022 •

edited

Loading

Deserialization error while trying to use pulumi-awsgateway #594

Deserialization error while trying to use pulumi-awsgateway #594

Comments

slnowak commented May 16, 2022

What happened?

Steps to reproduce

Expected Behavior

Actual Behavior

Versions used

Additional context

Contributing

pawelprazak commented May 17, 2022

pawelprazak commented May 17, 2022

pawelprazak commented May 17, 2022

pawelprazak commented May 17, 2022

pawelprazak commented May 17, 2022 • edited Loading

pawelprazak commented May 17, 2022 • edited Loading

pawelprazak commented May 18, 2022

pawelprazak commented May 19, 2022

pawelprazak commented May 20, 2022 • edited Loading

pawelprazak commented May 23, 2022

pawelprazak commented May 23, 2022 • edited Loading

pawelprazak commented May 23, 2022

t0yv0 commented May 23, 2022

t0yv0 commented May 23, 2022

pawelprazak commented May 24, 2022

pawelprazak commented Jun 6, 2022

pawelprazak commented Jun 6, 2022

pawelprazak commented Jun 6, 2022

t0yv0 commented Jul 20, 2022 • edited Loading

pawelprazak commented May 17, 2022 •

edited

Loading

pawelprazak commented May 17, 2022 •

edited

Loading

pawelprazak commented May 20, 2022 •

edited

Loading

pawelprazak commented May 23, 2022 •

edited

Loading

t0yv0 commented Jul 20, 2022 •

edited

Loading