Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Failed creating database DWD_LY in catalog Dameng #6537

Closed
2 of 3 tasks
pengwf1804 opened this issue Mar 19, 2024 · 6 comments
Closed
2 of 3 tasks

Failed creating database DWD_LY in catalog Dameng #6537

pengwf1804 opened this issue Mar 19, 2024 · 6 comments

Comments

@pengwf1804
Copy link

Search before asking

  • I had searched in the issues and found no similar issues.

What happened

Caused by: org.apache.seatunnel.api.table.catalog.exception.CatalogException: ErrorCode:[API-03], ErrorDescription:[Catalog initialize failed] - Failed creating database DWD_LY in catalog Dameng

SeaTunnel Version

2.3.4

SeaTunnel Config

env {
  parallelism = 10
  job.mode = "BATCH"
}
source {
    Jdbc {
        url = "jdbc:mysql://0.0.0.0:6033/dwd_ly?serverTimezone=GMT%2b8"
        driver = "com.mysql.cj.jdbc.Driver"
        connection_check_timeout_sec = 100
        user = "dwd_ly"
        password = "*******"
	table_path = "db.tb"
        query = "select * from db.tb"
        partition_column = "splitpk"
        split.size = 100000
        partition_lower_bound = 0
        partition_upper_bound = 10000001
    }
}

sink {
    jdbc {
        url = "jdbc:dm://0.0.0.0:5236/"
        driver = "dm.jdbc.driver.DmDriver"
        user = "DWD_LY"
        password = "*******"
        database = "DWD_LY"
        table = "ceshi"
        #schema_save_mode  = "ERROR_WHEN_SCHEMA_NOT_EXIST"
        support_upsert_by_query_primary_key_exist = true
        generate_sink_sql = true
        primary_keys = ["PSN", "PSN_ID"]
    }
}

Running Command

local模式执行

Error Exception

Exception in thread "main" org.apache.seatunnel.core.starter.exception.CommandExecuteException: SeaTunnel job executed failed
		at org.apache.seatunnel.core.starter.seatunnel.command.ClientExecuteCommand.execute(ClientExecuteCommand.java:199)
		at org.apache.seatunnel.core.starter.SeaTunnel.run(SeaTunnel.java:40)
		at org.apache.seatunnel.core.starter.seatunnel.SeaTunnelClient.main(SeaTunnelClient.java:34)
	Caused by: org.apache.seatunnel.common.exception.SeaTunnelRuntimeException: ErrorCode:[API-09], ErrorDescription:[Handle save mode failed]
		at org.apache.seatunnel.engine.core.parse.MultipleTableJobConfigParser.handleSaveMode(MultipleTableJobConfigParser.java:669)
		at org.apache.seatunnel.engine.core.parse.MultipleTableJobConfigParser.createSinkAction(MultipleTableJobConfigParser.java:655)
		at org.apache.seatunnel.engine.core.parse.MultipleTableJobConfigParser.parseSink(MultipleTableJobConfigParser.java:567)
		at org.apache.seatunnel.engine.core.parse.MultipleTableJobConfigParser.parse(MultipleTableJobConfigParser.java:193)
		at org.apache.seatunnel.engine.client.job.ClientJobExecutionEnvironment.getLogicalDag(ClientJobExecutionEnvironment.java:88)
		at org.apache.seatunnel.engine.client.job.ClientJobExecutionEnvironment.execute(ClientJobExecutionEnvironment.java:161)
		at org.apache.seatunnel.core.starter.seatunnel.command.ClientExecuteCommand.execute(ClientExecuteCommand.java:146)
		... 2 more
	Caused by: org.apache.seatunnel.api.table.catalog.exception.CatalogException: ErrorCode:[API-03], ErrorDescription:[Catalog initialize failed] - Failed creating database DWD_LY in catalog Dameng
		at org.apache.seatunnel.connectors.seatunnel.jdbc.catalog.AbstractJdbcCatalog.createDatabaseInternal(AbstractJdbcCatalog.java:422)
		at org.apache.seatunnel.connectors.seatunnel.jdbc.catalog.AbstractJdbcCatalog.createDatabase(AbstractJdbcCatalog.java:410)
		at org.apache.seatunnel.api.sink.DefaultSaveModeHandler.createTable(DefaultSaveModeHandler.java:140)
		at org.apache.seatunnel.api.sink.DefaultSaveModeHandler.createSchemaWhenNotExist(DefaultSaveModeHandler.java:101)
		at org.apache.seatunnel.api.sink.DefaultSaveModeHandler.handleSchemaSaveMode(DefaultSaveModeHandler.java:62)
		at org.apache.seatunnel.api.sink.SaveModeHandler.handleSaveMode(SaveModeHandler.java:27)
		at org.apache.seatunnel.engine.core.parse.MultipleTableJobConfigParser.handleSaveMode(MultipleTableJobConfigParser.java:667)
		... 8 more
	Caused by: java.lang.UnsupportedOperationException
		at org.apache.seatunnel.connectors.seatunnel.jdbc.catalog.AbstractJdbcCatalog.getCreateDatabaseSql(AbstractJdbcCatalog.java:414)
		at org.apache.seatunnel.connectors.seatunnel.jdbc.catalog.AbstractJdbcCatalog.createDatabaseInternal(AbstractJdbcCatalog.java:419)
		... 14 more

Zeta or Flink or Spark Version

zeta

Java or Scala Version

java8

Screenshots

No response

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

@pengwf1804 pengwf1804 added the bug label Mar 19, 2024
@liunaijie
Copy link
Member

Hi @pengwf1804 looks you create some duplicated issues.
For this error, it because your sink table's db is not exist, and the create operation (create db, create table) is not support yet in dament connector.
please create the db, table first or use schema_save_mode = "ERROR_WHEN_SCHEMA_NOT_EXIST" config

@pengwf1804
Copy link
Author

你好,db是已经存在的

Copy link

This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

@github-actions github-actions bot added the stale label Apr 19, 2024
Copy link

This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future.

@kdafang
Copy link

kdafang commented Aug 22, 2024

这个问题解决了吗 我也遇到这个问题了 2.3.6 使用jdbc sink 时 达梦upset时一直报错 Failed creating database xxx in catalog Dameng

@kdafang
Copy link

kdafang commented Aug 22, 2024

db是存在的

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants