Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

405 HTTP method not allowed error on Connector Creation #31

Open
vinay-nadig-0042 opened this issue Oct 21, 2020 · 1 comment
Open

405 HTTP method not allowed error on Connector Creation #31

vinay-nadig-0042 opened this issue Oct 21, 2020 · 1 comment

Comments

@vinay-nadig-0042
Copy link

Hello,

I am trying to create a snowflake connector with the following configuration:

terraform {
  backend "s3" {}
  required_providers {
    kafka-connect = {
      source = "Mongey/kafka-connect"
      version = "0.2.3"
    }
  }
  required_version = "~> 0.12.4"
}

provider "kafka-connect" {
  url = var.connector_endpoint_url
  basic_auth_username = var.connector_username
  basic_auth_password = var.connector_password
}

resource "kafka-connect_connector" "snowflake_confluent_json_stg" {
  name = "snowflake_confluent_json_stg"

  config = {
    "connector.class" = "com.snowflake.kafka.connector.SnowflakeSinkConnector"
    "snowflake.topic2table.map" = "dev.AccMd.v1:DEV_ACCMD_V1"
    "tasks.max" = "3"
    "topics" = "dev.AccMd.v1"
    "buffer.flush.time" = "180"
    "snowflake.url.name" = "<REDACTED>"
    "snowflake.database.name" = "TEST_DB"
    "snowflake.schema.name" = "kafka"
    "buffer.count.records" = "100000"
    "snowflake.user.name" = "KAFKA_STG"
    "name" = "snowflake_confluent_json_stg"
    "errors.tolerance" = "all"
    "value.converter" = "com.snowflake.kafka.connector.records.SnowflakeJsonConverter"
    "key.converter" = "org.apache.kafka.connect.storage.StringConverter"
    "buffer.size.bytes" = "10485760"
  }

  config_sensitive = {
    "snowflake.private.key" = var.snowflake_private_key
    "value.converter.basic.auth.credentials.source" = "USER_INFO"
    "value.converter.basic.auth.user.info"  = var.schema_registry_basic_auth
  }
}

This is the first time that the connector is being created. When I run a terraform apply, I get the following error message(console output):

$ terraform apply -auto-approve
kafka-connect_connector.snowflake_confluent_avro_stg: Creating...
kafka-connect_connector.snowflake_confluent_json_stg: Creating...
Error: Create connector : {"error_code":405,"message":"HTTP 405 Method Not Allowed"}
  on main.tf line 18, in resource "kafka-connect_connector" "snowflake_confluent_json_stg":
  18: resource "kafka-connect_connector" "snowflake_confluent_json_stg" {
Error: Create connector : {"error_code":405,"message":"HTTP 405 Method Not Allowed"}
  on main.tf line 46, in resource "kafka-connect_connector" "snowflake_confluent_avro_stg":
  46: resource "kafka-connect_connector" "snowflake_confluent_avro_stg" {

It looks like this is because the HTTP request that is sent is a PUT request rather than a POST request for creating the resource.

I can see the following logs on the server side

[2020-10-21 10:36:52,473] ERROR Uncaught exception in REST call to /connectors/connectors (org.apache.kafka.connect.runtime.rest.errors.ConnectExceptionMapper)

javax.ws.rs.NotAllowedException: HTTP 405 Method Not Allowed

Any idea why this is happening and how it can be fixed?

Terraform version - 0.12.4
kafka-connect version - 0.2.3

@ken-tan3
Copy link

"connectors" are overwrapping? Is it correct?
/connectors/connectors

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants