Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Failure in MetaImpl.MetaSchema::source in BigQueryDatabase #15473

Closed
lukaseder opened this issue Aug 17, 2023 · 3 comments
Closed

Failure in MetaImpl.MetaSchema::source in BigQueryDatabase #15473

lukaseder opened this issue Aug 17, 2023 · 3 comments
Labels
C: Code Generation C: DB: BigQuery E: Enterprise Edition P: High R: Fixed T: Defect
Projects
3.19 Other improvements
Milestone
Version 3.19.0

Comments

@lukaseder
Copy link
Member

lukaseder commented Aug 17, 2023 •
edited

Insufficient error handling of a failure in MetaImpl.MetaSchema::source causes a dependent failure when querying for primary keys, preventing UpdatableRecord generation, etc. in BigQueryDatabase:

[ERROR] Error while generating table TEST.T_639_NUMBERS_TABLE
java.lang.RuntimeException: java.lang.RuntimeException: org.jooq.exception.DataAccessException: SQL [SELECT CAST(NULL AS STRING) AS TABLE_CATALOG, TABLE_SCHEMA, TABLE_NAME, CASE WHEN LOWER(VIEW_DEFINITION) LIKE 'create%' THEN VIEW_DEFINITION ELSE 'create view `' || TABLE_NAME || '` AS ' || VIEW_DEFINITION END AS VIEW_DEFINITION FROM INFORMATION_SCHEMA.VIEWS ORDER BY TABLE_SCHEMA, TABLE_NAME ]; [Simba][BigQueryJDBCDriver](100032) Error executing query job. Message: 404 Not Found
POST https://bigquery.googleapis.com/bigquery/v2/projects/xxx/jobs
{
  "code": 404,
  "errors": [
    {
      "domain": "global",
      "message": "Not found: Dataset xxx:TEST was not found in location US",
      "reason": "notFound"
    }
  ],
  "message": "Not found: Dataset xxx:TEST was not found in location US",
  "status": "NOT_FOUND"
}
    at org.jooq.meta.AbstractDatabase.onError (AbstractDatabase.java:4113)
    at org.jooq.meta.AbstractDatabase.getRelations (AbstractDatabase.java:3063)
    at org.jooq.meta.DefaultColumnDefinition.getPrimaryKey (DefaultColumnDefinition.java:161)
    at org.jooq.meta.AbstractTableDefinition.getPrimaryKey (AbstractTableDefinition.java:110)
    at org.jooq.codegen.JavaGenerator.generateTable (JavaGenerator.java:6102)
    at org.jooq.codegen.JavaGenerator.generateTables (JavaGenerator.java:6081)
    at org.jooq.codegen.JavaGenerator.generate (JavaGenerator.java:690)
    at org.jooq.codegen.JavaGenerator.generate (JavaGenerator.java:644)
    at org.jooq.codegen.JavaGenerator.generate0 (JavaGenerator.java:552)
    at org.jooq.codegen.AbstractGenerator.generate (AbstractGenerator.java:207)
    at org.jooq.codegen.JavaGenerator.generate (JavaGenerator.java:237)
    at org.jooq.codegen.GenerationTool.run0 (GenerationTool.java:980)
    at org.jooq.codegen.GenerationTool.run (GenerationTool.java:245)
    at org.jooq.codegen.GenerationTool.generate (GenerationTool.java:240)
    at org.jooq.codegen.maven.Plugin.execute (Plugin.java:216)
    at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo (DefaultBuildPluginManager.java:126)
    at org.apache.maven.lifecycle.internal.MojoExecutor.doExecute2 (MojoExecutor.java:342)
    at org.apache.maven.lifecycle.internal.MojoExecutor.doExecute (MojoExecutor.java:330)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:213)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:175)
    at org.apache.maven.lifecycle.internal.MojoExecutor.access$000 (MojoExecutor.java:76)
    at org.apache.maven.lifecycle.internal.MojoExecutor$1.run (MojoExecutor.java:163)
    at org.apache.maven.plugin.DefaultMojosExecutionStrategy.execute (DefaultMojosExecutionStrategy.java:39)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:160)
    at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:105)
    at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:73)
    at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build (SingleThreadedBuilder.java:53)
    at org.apache.maven.lifecycle.internal.LifecycleStarter.execute (LifecycleStarter.java:118)
    at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:261)
    at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:173)
    at org.apache.maven.DefaultMaven.execute (DefaultMaven.java:101)
    at org.apache.maven.cli.MavenCli.execute (MavenCli.java:827)
    at org.apache.maven.cli.MavenCli.doMain (MavenCli.java:272)
    at org.apache.maven.cli.MavenCli.main (MavenCli.java:195)
    at jdk.internal.reflect.DirectMethodHandleAccessor.invoke (DirectMethodHandleAccessor.java:104)
    at java.lang.reflect.Method.invoke (Method.java:578)
    at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced (Launcher.java:282)
    at org.codehaus.plexus.classworlds.launcher.Launcher.launch (Launcher.java:225)
    at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode (Launcher.java:406)
    at org.codehaus.plexus.classworlds.launcher.Launcher.main (Launcher.java:347)
Caused by: java.lang.RuntimeException: org.jooq.exception.DataAccessException: SQL [SELECT CAST(NULL AS STRING) AS TABLE_CATALOG, TABLE_SCHEMA, TABLE_NAME, CASE WHEN LOWER(VIEW_DEFINITION) LIKE 'create%' THEN VIEW_DEFINITION ELSE 'create view `' || TABLE_NAME || '` AS ' || VIEW_DEFINITION END AS VIEW_DEFINITION FROM INFORMATION_SCHEMA.VIEWS ORDER BY TABLE_SCHEMA, TABLE_NAME ]; [Simba][BigQueryJDBCDriver](100032) Error executing query job. Message: 404 Not Found
POST https://bigquery.googleapis.com/bigquery/v2/projects/xxx/jobs
{
  "code": 404,
  "errors": [
    {
      "domain": "global",
      "message": "Not found: Dataset xxx:TEST was not found in location US",
      "reason": "notFound"
    }
  ],
  "message": "Not found: Dataset xxx:TEST was not found in location US",
  "status": "NOT_FOUND"
}
    at org.jooq.meta.AbstractDatabase.onError (AbstractDatabase.java:4113)
    at org.jooq.meta.AbstractDatabase.getRelations0 (AbstractDatabase.java:3388)
    at org.jooq.meta.AbstractDatabase.lambda$32 (AbstractDatabase.java:3063)
    at org.jooq.meta.AbstractDatabase.onError (AbstractDatabase.java:4087)
    at org.jooq.meta.AbstractDatabase.getRelations (AbstractDatabase.java:3063)
    at org.jooq.meta.DefaultColumnDefinition.getPrimaryKey (DefaultColumnDefinition.java:161)
    at org.jooq.meta.AbstractTableDefinition.getPrimaryKey (AbstractTableDefinition.java:110)
    at org.jooq.codegen.JavaGenerator.generateTable (JavaGenerator.java:6102)
    at org.jooq.codegen.JavaGenerator.generateTables (JavaGenerator.java:6081)
    at org.jooq.codegen.JavaGenerator.generate (JavaGenerator.java:690)
    at org.jooq.codegen.JavaGenerator.generate (JavaGenerator.java:644)
    at org.jooq.codegen.JavaGenerator.generate0 (JavaGenerator.java:552)
    at org.jooq.codegen.AbstractGenerator.generate (AbstractGenerator.java:207)
    at org.jooq.codegen.JavaGenerator.generate (JavaGenerator.java:237)
    at org.jooq.codegen.GenerationTool.run0 (GenerationTool.java:980)
    at org.jooq.codegen.GenerationTool.run (GenerationTool.java:245)
    at org.jooq.codegen.GenerationTool.generate (GenerationTool.java:240)
    at org.jooq.codegen.maven.Plugin.execute (Plugin.java:216)
    at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo (DefaultBuildPluginManager.java:126)
    at org.apache.maven.lifecycle.internal.MojoExecutor.doExecute2 (MojoExecutor.java:342)
    at org.apache.maven.lifecycle.internal.MojoExecutor.doExecute (MojoExecutor.java:330)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:213)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:175)
    at org.apache.maven.lifecycle.internal.MojoExecutor.access$000 (MojoExecutor.java:76)
    at org.apache.maven.lifecycle.internal.MojoExecutor$1.run (MojoExecutor.java:163)
    at org.apache.maven.plugin.DefaultMojosExecutionStrategy.execute (DefaultMojosExecutionStrategy.java:39)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:160)
    at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:105)
    at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:73)
    at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build (SingleThreadedBuilder.java:53)
    at org.apache.maven.lifecycle.internal.LifecycleStarter.execute (LifecycleStarter.java:118)
    at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:261)
    at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:173)
    at org.apache.maven.DefaultMaven.execute (DefaultMaven.java:101)
    at org.apache.maven.cli.MavenCli.execute (MavenCli.java:827)
    at org.apache.maven.cli.MavenCli.doMain (MavenCli.java:272)
    at org.apache.maven.cli.MavenCli.main (MavenCli.java:195)
    at jdk.internal.reflect.DirectMethodHandleAccessor.invoke (DirectMethodHandleAccessor.java:104)
    at java.lang.reflect.Method.invoke (Method.java:578)
    at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced (Launcher.java:282)
    at org.codehaus.plexus.classworlds.launcher.Launcher.launch (Launcher.java:225)
    at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode (Launcher.java:406)
    at org.codehaus.plexus.classworlds.launcher.Launcher.main (Launcher.java:347)
Caused by: org.jooq.exception.DataAccessException: SQL [SELECT CAST(NULL AS STRING) AS TABLE_CATALOG, TABLE_SCHEMA, TABLE_NAME, CASE WHEN LOWER(VIEW_DEFINITION) LIKE 'create%' THEN VIEW_DEFINITION ELSE 'create view `' || TABLE_NAME || '` AS ' || VIEW_DEFINITION END AS VIEW_DEFINITION FROM INFORMATION_SCHEMA.VIEWS ORDER BY TABLE_SCHEMA, TABLE_NAME ]; [Simba][BigQueryJDBCDriver](100032) Error executing query job. Message: 404 Not Found
POST https://bigquery.googleapis.com/bigquery/v2/projects/xxx/jobs
{
  "code": 404,
  "errors": [
    {
      "domain": "global",
      "message": "Not found: Dataset xxx:TEST was not found in location US",
      "reason": "notFound"
    }
  ],
  "message": "Not found: Dataset xxx:TEST was not found in location US",
  "status": "NOT_FOUND"
}
    at org.jooq_3.19.0-SNAPSHOT.BIGQUERY.debug (Unknown Source)
    at org.jooq.impl.Tools.translate (Tools.java:3523)
    at org.jooq.impl.Tools.translate (Tools.java:3511)
    at org.jooq.impl.DefaultExecuteContext.sqlException (DefaultExecuteContext.java:811)
    at org.jooq.impl.AbstractQuery.execute (AbstractQuery.java:362)
    at org.jooq.impl.AbstractResultQuery.fetch (AbstractResultQuery.java:290)
    at org.jooq.impl.MetaImpl$MetaSchema.lambda$source$13 (MetaImpl.java:695)
    at org.jooq.impl.MetaImpl.withCatalog (MetaImpl.java:222)
    at org.jooq.impl.MetaImpl$MetaSchema.lambda$source$14 (MetaImpl.java:694)
    at org.jooq.impl.MetaImpl.lambda$meta$0 (MetaImpl.java:193)
    at org.jooq.impl.DefaultDSLContext.connectionResult (DefaultDSLContext.java:655)
    at org.jooq.impl.MetaImpl.meta (MetaImpl.java:193)
    at org.jooq.impl.MetaImpl$MetaSchema.source (MetaImpl.java:693)
    at org.jooq.impl.MetaImpl.tableOption (MetaImpl.java:776)
    at org.jooq.impl.MetaImpl$MetaTable.<init> (MetaImpl.java:786)
    at org.jooq.impl.MetaImpl$MetaSchema.lambda$getTables$2 (MetaImpl.java:488)
    at org.jooq.impl.Tools.map (Tools.java:2504)
    at org.jooq.impl.MetaImpl$MetaSchema.getTables (MetaImpl.java:459)
    at org.jooq.meta.AbstractMetaDatabase.loadUniqueKeys (AbstractMetaDatabase.java:85)
    at org.jooq.meta.AbstractDatabase.lambda$40 (AbstractDatabase.java:3388)
    at org.jooq.meta.AbstractDatabase.onError (AbstractDatabase.java:4087)
    at org.jooq.meta.AbstractDatabase.getRelations0 (AbstractDatabase.java:3388)
    at org.jooq.meta.AbstractDatabase.lambda$32 (AbstractDatabase.java:3063)
    at org.jooq.meta.AbstractDatabase.onError (AbstractDatabase.java:4087)
    at org.jooq.meta.AbstractDatabase.getRelations (AbstractDatabase.java:3063)
    at org.jooq.meta.DefaultColumnDefinition.getPrimaryKey (DefaultColumnDefinition.java:161)
    at org.jooq.meta.AbstractTableDefinition.getPrimaryKey (AbstractTableDefinition.java:110)
    at org.jooq.codegen.JavaGenerator.generateTable (JavaGenerator.java:6102)
    at org.jooq.codegen.JavaGenerator.generateTables (JavaGenerator.java:6081)
    at org.jooq.codegen.JavaGenerator.generate (JavaGenerator.java:690)
    at org.jooq.codegen.JavaGenerator.generate (JavaGenerator.java:644)
    at org.jooq.codegen.JavaGenerator.generate0 (JavaGenerator.java:552)
    at org.jooq.codegen.AbstractGenerator.generate (AbstractGenerator.java:207)
    at org.jooq.codegen.JavaGenerator.generate (JavaGenerator.java:237)
    at org.jooq.codegen.GenerationTool.run0 (GenerationTool.java:980)
    at org.jooq.codegen.GenerationTool.run (GenerationTool.java:245)
    at org.jooq.codegen.GenerationTool.generate (GenerationTool.java:240)
    at org.jooq.codegen.maven.Plugin.execute (Plugin.java:216)
    at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo (DefaultBuildPluginManager.java:126)
    at org.apache.maven.lifecycle.internal.MojoExecutor.doExecute2 (MojoExecutor.java:342)
    at org.apache.maven.lifecycle.internal.MojoExecutor.doExecute (MojoExecutor.java:330)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:213)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:175)
    at org.apache.maven.lifecycle.internal.MojoExecutor.access$000 (MojoExecutor.java:76)
    at org.apache.maven.lifecycle.internal.MojoExecutor$1.run (MojoExecutor.java:163)
    at org.apache.maven.plugin.DefaultMojosExecutionStrategy.execute (DefaultMojosExecutionStrategy.java:39)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:160)
    at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:105)
    at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:73)
    at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build (SingleThreadedBuilder.java:53)
    at org.apache.maven.lifecycle.internal.LifecycleStarter.execute (LifecycleStarter.java:118)
    at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:261)
    at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:173)
    at org.apache.maven.DefaultMaven.execute (DefaultMaven.java:101)
    at org.apache.maven.cli.MavenCli.execute (MavenCli.java:827)
    at org.apache.maven.cli.MavenCli.doMain (MavenCli.java:272)
    at org.apache.maven.cli.MavenCli.main (MavenCli.java:195)
    at jdk.internal.reflect.DirectMethodHandleAccessor.invoke (DirectMethodHandleAccessor.java:104)
    at java.lang.reflect.Method.invoke (Method.java:578)
    at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced (Launcher.java:282)
    at org.codehaus.plexus.classworlds.launcher.Launcher.launch (Launcher.java:225)
    at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode (Launcher.java:406)
    at org.codehaus.plexus.classworlds.launcher.Launcher.main (Launcher.java:347)
Caused by: java.sql.SQLException: [Simba][BigQueryJDBCDriver](100032) Error executing query job. Message: 404 Not Found
POST https://bigquery.googleapis.com/bigquery/v2/projects/xxx/jobs
{
  "code": 404,
  "errors": [
    {
      "domain": "global",
      "message": "Not found: Dataset xxx:TEST was not found in location US",
      "reason": "notFound"
    }
  ],
  "message": "Not found: Dataset xxx:TEST was not found in location US",
  "status": "NOT_FOUND"
}
    at com.simba.googlebigquery.googlebigquery.client.requests.jobs.JobsInsertRequest.throwException (Unknown Source)
    at com.simba.googlebigquery.googlebigquery.client.requests.AbstractRequestWithRetry.executeWithRetry (Unknown Source)
    at com.simba.googlebigquery.googlebigquery.client.queryclient.QueryClient.executeDryRun (Unknown Source)
    at com.simba.googlebigquery.googlebigquery.client.BQClient.prepare (Unknown Source)
    at com.simba.googlebigquery.googlebigquery.dataengine.BQSQLExecutor.internalPrepare (Unknown Source)
    at com.simba.googlebigquery.googlebigquery.dataengine.BQSQLExecutor.<init> (Unknown Source)
    at com.simba.googlebigquery.googlebigquery.dataengine.BQDataEngine.prepare (Unknown Source)
    at com.simba.googlebigquery.jdbc.common.SPreparedStatement.<init> (Unknown Source)
    at com.simba.googlebigquery.jdbc.jdbc41.S41PreparedStatement.<init> (Unknown Source)
    at com.simba.googlebigquery.jdbc.jdbc42.S42PreparedStatement.<init> (Unknown Source)
    at com.simba.googlebigquery.googlebigquery.jdbc42.BQJDBC42ObjectFactory.createPreparedStatement (Unknown Source)
    at com.simba.googlebigquery.jdbc.common.JDBCObjectFactory.newPreparedStatement (Unknown Source)
    at com.simba.googlebigquery.jdbc.common.SConnection$5.create (Unknown Source)
    at com.simba.googlebigquery.jdbc.common.SConnection$5.create (Unknown Source)
    at com.simba.googlebigquery.jdbc.common.SConnection$StatementCreator.create (Unknown Source)
    at com.simba.googlebigquery.jdbc.common.SConnection.prepareStatement (Unknown Source)
    at com.simba.googlebigquery.jdbc.common.SConnection.prepareStatement (Unknown Source)
    at com.simba.googlebigquery.jdbc.common.SConnection.prepareStatement (Unknown Source)
    at org.jooq.impl.ProviderEnabledConnection.prepareStatement (ProviderEnabledConnection.java:109)
    at org.jooq.impl.SettingsEnabledConnection.prepareStatement (SettingsEnabledConnection.java:82)
    at org.jooq.impl.AbstractResultQuery.prepare (AbstractResultQuery.java:216)
    at org.jooq.impl.AbstractQuery.execute (AbstractQuery.java:315)
    at org.jooq.impl.AbstractResultQuery.fetch (AbstractResultQuery.java:290)
    at org.jooq.impl.MetaImpl$MetaSchema.lambda$source$13 (MetaImpl.java:695)
    at org.jooq.impl.MetaImpl.withCatalog (MetaImpl.java:222)
    at org.jooq.impl.MetaImpl$MetaSchema.lambda$source$14 (MetaImpl.java:694)
    at org.jooq.impl.MetaImpl.lambda$meta$0 (MetaImpl.java:193)
    at org.jooq.impl.DefaultDSLContext.connectionResult (DefaultDSLContext.java:655)
    at org.jooq.impl.MetaImpl.meta (MetaImpl.java:193)
    at org.jooq.impl.MetaImpl$MetaSchema.source (MetaImpl.java:693)
    at org.jooq.impl.MetaImpl.tableOption (MetaImpl.java:776)
    at org.jooq.impl.MetaImpl$MetaTable.<init> (MetaImpl.java:786)
    at org.jooq.impl.MetaImpl$MetaSchema.lambda$getTables$2 (MetaImpl.java:488)
    at org.jooq.impl.Tools.map (Tools.java:2504)
    at org.jooq.impl.MetaImpl$MetaSchema.getTables (MetaImpl.java:459)
    at org.jooq.meta.AbstractMetaDatabase.loadUniqueKeys (AbstractMetaDatabase.java:85)
    at org.jooq.meta.AbstractDatabase.lambda$40 (AbstractDatabase.java:3388)
    at org.jooq.meta.AbstractDatabase.onError (AbstractDatabase.java:4087)
    at org.jooq.meta.AbstractDatabase.getRelations0 (AbstractDatabase.java:3388)
    at org.jooq.meta.AbstractDatabase.lambda$32 (AbstractDatabase.java:3063)
    at org.jooq.meta.AbstractDatabase.onError (AbstractDatabase.java:4087)
    at org.jooq.meta.AbstractDatabase.getRelations (AbstractDatabase.java:3063)
    at org.jooq.meta.DefaultColumnDefinition.getPrimaryKey (DefaultColumnDefinition.java:161)
    at org.jooq.meta.AbstractTableDefinition.getPrimaryKey (AbstractTableDefinition.java:110)
    at org.jooq.codegen.JavaGenerator.generateTable (JavaGenerator.java:6102)
    at org.jooq.codegen.JavaGenerator.generateTables (JavaGenerator.java:6081)
    at org.jooq.codegen.JavaGenerator.generate (JavaGenerator.java:690)
    at org.jooq.codegen.JavaGenerator.generate (JavaGenerator.java:644)
    at org.jooq.codegen.JavaGenerator.generate0 (JavaGenerator.java:552)
    at org.jooq.codegen.AbstractGenerator.generate (AbstractGenerator.java:207)
    at org.jooq.codegen.JavaGenerator.generate (JavaGenerator.java:237)
    at org.jooq.codegen.GenerationTool.run0 (GenerationTool.java:980)
    at org.jooq.codegen.GenerationTool.run (GenerationTool.java:245)
    at org.jooq.codegen.GenerationTool.generate (GenerationTool.java:240)
    at org.jooq.codegen.maven.Plugin.execute (Plugin.java:216)
    at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo (DefaultBuildPluginManager.java:126)
    at org.apache.maven.lifecycle.internal.MojoExecutor.doExecute2 (MojoExecutor.java:342)
    at org.apache.maven.lifecycle.internal.MojoExecutor.doExecute (MojoExecutor.java:330)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:213)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:175)
    at org.apache.maven.lifecycle.internal.MojoExecutor.access$000 (MojoExecutor.java:76)
    at org.apache.maven.lifecycle.internal.MojoExecutor$1.run (MojoExecutor.java:163)
    at org.apache.maven.plugin.DefaultMojosExecutionStrategy.execute (DefaultMojosExecutionStrategy.java:39)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:160)
    at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:105)
    at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:73)
    at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build (SingleThreadedBuilder.java:53)
    at org.apache.maven.lifecycle.internal.LifecycleStarter.execute (LifecycleStarter.java:118)
    at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:261)
    at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:173)
    at org.apache.maven.DefaultMaven.execute (DefaultMaven.java:101)
    at org.apache.maven.cli.MavenCli.execute (MavenCli.java:827)
    at org.apache.maven.cli.MavenCli.doMain (MavenCli.java:272)
    at org.apache.maven.cli.MavenCli.main (MavenCli.java:195)
    at jdk.internal.reflect.DirectMethodHandleAccessor.invoke (DirectMethodHandleAccessor.java:104)
    at java.lang.reflect.Method.invoke (Method.java:578)
    at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced (Launcher.java:282)
    at org.codehaus.plexus.classworlds.launcher.Launcher.launch (Launcher.java:225)
    at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode (Launcher.java:406)
    at org.codehaus.plexus.classworlds.launcher.Launcher.main (Launcher.java:347)
Caused by: com.simba.googlebigquery.googlebigquery.client.exceptions.JobExecutionErrorException: [Simba][BigQueryJDBCDriver](100032) Error executing query job. Message: 404 Not Found
POST https://bigquery.googleapis.com/bigquery/v2/projects/xxx/jobs
{
  "code": 404,
  "errors": [
    {
      "domain": "global",
      "message": "Not found: Dataset xxx:TEST was not found in location US",
      "reason": "notFound"
    }
  ],
  "message": "Not found: Dataset xxx:TEST was not found in location US",
  "status": "NOT_FOUND"
}
    at com.simba.googlebigquery.googlebigquery.client.requests.jobs.JobsInsertRequest.throwException (Unknown Source)
    at com.simba.googlebigquery.googlebigquery.client.requests.AbstractRequestWithRetry.executeWithRetry (Unknown Source)
    at com.simba.googlebigquery.googlebigquery.client.queryclient.QueryClient.executeDryRun (Unknown Source)
    at com.simba.googlebigquery.googlebigquery.client.BQClient.prepare (Unknown Source)
    at com.simba.googlebigquery.googlebigquery.dataengine.BQSQLExecutor.internalPrepare (Unknown Source)
    at com.simba.googlebigquery.googlebigquery.dataengine.BQSQLExecutor.<init> (Unknown Source)
    at com.simba.googlebigquery.googlebigquery.dataengine.BQDataEngine.prepare (Unknown Source)
    at com.simba.googlebigquery.jdbc.common.SPreparedStatement.<init> (Unknown Source)
    at com.simba.googlebigquery.jdbc.jdbc41.S41PreparedStatement.<init> (Unknown Source)
    at com.simba.googlebigquery.jdbc.jdbc42.S42PreparedStatement.<init> (Unknown Source)
    at com.simba.googlebigquery.googlebigquery.jdbc42.BQJDBC42ObjectFactory.createPreparedStatement (Unknown Source)
    at com.simba.googlebigquery.jdbc.common.JDBCObjectFactory.newPreparedStatement (Unknown Source)
    at com.simba.googlebigquery.jdbc.common.SConnection$5.create (Unknown Source)
    at com.simba.googlebigquery.jdbc.common.SConnection$5.create (Unknown Source)
    at com.simba.googlebigquery.jdbc.common.SConnection$StatementCreator.create (Unknown Source)
    at com.simba.googlebigquery.jdbc.common.SConnection.prepareStatement (Unknown Source)
    at com.simba.googlebigquery.jdbc.common.SConnection.prepareStatement (Unknown Source)
    at com.simba.googlebigquery.jdbc.common.SConnection.prepareStatement (Unknown Source)
    at org.jooq.impl.ProviderEnabledConnection.prepareStatement (ProviderEnabledConnection.java:109)
    at org.jooq.impl.SettingsEnabledConnection.prepareStatement (SettingsEnabledConnection.java:82)
    at org.jooq.impl.AbstractResultQuery.prepare (AbstractResultQuery.java:216)
    at org.jooq.impl.AbstractQuery.execute (AbstractQuery.java:315)
    at org.jooq.impl.AbstractResultQuery.fetch (AbstractResultQuery.java:290)
    at org.jooq.impl.MetaImpl$MetaSchema.lambda$source$13 (MetaImpl.java:695)
    at org.jooq.impl.MetaImpl.withCatalog (MetaImpl.java:222)
    at org.jooq.impl.MetaImpl$MetaSchema.lambda$source$14 (MetaImpl.java:694)
    at org.jooq.impl.MetaImpl.lambda$meta$0 (MetaImpl.java:193)
    at org.jooq.impl.DefaultDSLContext.connectionResult (DefaultDSLContext.java:655)
    at org.jooq.impl.MetaImpl.meta (MetaImpl.java:193)
    at org.jooq.impl.MetaImpl$MetaSchema.source (MetaImpl.java:693)
    at org.jooq.impl.MetaImpl.tableOption (MetaImpl.java:776)
    at org.jooq.impl.MetaImpl$MetaTable.<init> (MetaImpl.java:786)
    at org.jooq.impl.MetaImpl$MetaSchema.lambda$getTables$2 (MetaImpl.java:488)
    at org.jooq.impl.Tools.map (Tools.java:2504)
    at org.jooq.impl.MetaImpl$MetaSchema.getTables (MetaImpl.java:459)
    at org.jooq.meta.AbstractMetaDatabase.loadUniqueKeys (AbstractMetaDatabase.java:85)
    at org.jooq.meta.AbstractDatabase.lambda$40 (AbstractDatabase.java:3388)
    at org.jooq.meta.AbstractDatabase.onError (AbstractDatabase.java:4087)
    at org.jooq.meta.AbstractDatabase.getRelations0 (AbstractDatabase.java:3388)
    at org.jooq.meta.AbstractDatabase.lambda$32 (AbstractDatabase.java:3063)
    at org.jooq.meta.AbstractDatabase.onError (AbstractDatabase.java:4087)
    at org.jooq.meta.AbstractDatabase.getRelations (AbstractDatabase.java:3063)
    at org.jooq.meta.DefaultColumnDefinition.getPrimaryKey (DefaultColumnDefinition.java:161)
    at org.jooq.meta.AbstractTableDefinition.getPrimaryKey (AbstractTableDefinition.java:110)
    at org.jooq.codegen.JavaGenerator.generateTable (JavaGenerator.java:6102)
    at org.jooq.codegen.JavaGenerator.generateTables (JavaGenerator.java:6081)
    at org.jooq.codegen.JavaGenerator.generate (JavaGenerator.java:690)
    at org.jooq.codegen.JavaGenerator.generate (JavaGenerator.java:644)
    at org.jooq.codegen.JavaGenerator.generate0 (JavaGenerator.java:552)
    at org.jooq.codegen.AbstractGenerator.generate (AbstractGenerator.java:207)
    at org.jooq.codegen.JavaGenerator.generate (JavaGenerator.java:237)
    at org.jooq.codegen.GenerationTool.run0 (GenerationTool.java:980)
    at org.jooq.codegen.GenerationTool.run (GenerationTool.java:245)
    at org.jooq.codegen.GenerationTool.generate (GenerationTool.java:240)
    at org.jooq.codegen.maven.Plugin.execute (Plugin.java:216)
    at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo (DefaultBuildPluginManager.java:126)
    at org.apache.maven.lifecycle.internal.MojoExecutor.doExecute2 (MojoExecutor.java:342)
    at org.apache.maven.lifecycle.internal.MojoExecutor.doExecute (MojoExecutor.java:330)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:213)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:175)
    at org.apache.maven.lifecycle.internal.MojoExecutor.access$000 (MojoExecutor.java:76)
    at org.apache.maven.lifecycle.internal.MojoExecutor$1.run (MojoExecutor.java:163)
    at org.apache.maven.plugin.DefaultMojosExecutionStrategy.execute (DefaultMojosExecutionStrategy.java:39)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:160)
    at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:105)
    at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:73)
    at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build (SingleThreadedBuilder.java:53)
    at org.apache.maven.lifecycle.internal.LifecycleStarter.execute (LifecycleStarter.java:118)
    at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:261)
    at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:173)
    at org.apache.maven.DefaultMaven.execute (DefaultMaven.java:101)
    at org.apache.maven.cli.MavenCli.execute (MavenCli.java:827)
    at org.apache.maven.cli.MavenCli.doMain (MavenCli.java:272)
    at org.apache.maven.cli.MavenCli.main (MavenCli.java:195)
    at jdk.internal.reflect.DirectMethodHandleAccessor.invoke (DirectMethodHandleAccessor.java:104)
    at java.lang.reflect.Method.invoke (Method.java:578)
    at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced (Launcher.java:282)
    at org.codehaus.plexus.classworlds.launcher.Launcher.launch (Launcher.java:225)
    at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode (Launcher.java:406)
    at org.codehaus.plexus.classworlds.launcher.Launcher.main (Launcher.java:347)
Caused by: com.google.api.client.googleapis.json.GoogleJsonResponseException: 404 Not Found
POST https://bigquery.googleapis.com/bigquery/v2/projects/xxx/jobs
{
  "code": 404,
  "errors": [
    {
      "domain": "global",
      "message": "Not found: Dataset xxx:TEST was not found in location US",
      "reason": "notFound"
    }
  ],
  "message": "Not found: Dataset xxx:TEST was not found in location US",
  "status": "NOT_FOUND"
}
    at com.google.api.client.googleapis.json.GoogleJsonResponseException.from (GoogleJsonResponseException.java:146)
    at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError (AbstractGoogleJsonClientRequest.java:118)
    at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError (AbstractGoogleJsonClientRequest.java:37)
    at com.google.api.client.googleapis.services.AbstractGoogleClientRequest$1.interceptResponse (AbstractGoogleClientRequest.java:439)
    at com.google.api.client.http.HttpRequest.execute (HttpRequest.java:1111)
    at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed (AbstractGoogleClientRequest.java:525)
    at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed (AbstractGoogleClientRequest.java:466)
    at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute (AbstractGoogleClientRequest.java:576)
    at com.simba.googlebigquery.googlebigquery.client.requests.jobs.JobsInsertRequest.execute (Unknown Source)
    at com.simba.googlebigquery.googlebigquery.client.requests.jobs.JobsInsertRequest.execute (Unknown Source)
    at com.simba.googlebigquery.googlebigquery.client.requests.AbstractRequestWithRetry.executeWithRetry (Unknown Source)
    at com.simba.googlebigquery.googlebigquery.client.queryclient.QueryClient.executeDryRun (Unknown Source)
    at com.simba.googlebigquery.googlebigquery.client.BQClient.prepare (Unknown Source)
    at com.simba.googlebigquery.googlebigquery.dataengine.BQSQLExecutor.internalPrepare (Unknown Source)
    at com.simba.googlebigquery.googlebigquery.dataengine.BQSQLExecutor.<init> (Unknown Source)
    at com.simba.googlebigquery.googlebigquery.dataengine.BQDataEngine.prepare (Unknown Source)
    at com.simba.googlebigquery.jdbc.common.SPreparedStatement.<init> (Unknown Source)
    at com.simba.googlebigquery.jdbc.jdbc41.S41PreparedStatement.<init> (Unknown Source)
    at com.simba.googlebigquery.jdbc.jdbc42.S42PreparedStatement.<init> (Unknown Source)
    at com.simba.googlebigquery.googlebigquery.jdbc42.BQJDBC42ObjectFactory.createPreparedStatement (Unknown Source)
    at com.simba.googlebigquery.jdbc.common.JDBCObjectFactory.newPreparedStatement (Unknown Source)
    at com.simba.googlebigquery.jdbc.common.SConnection$5.create (Unknown Source)
    at com.simba.googlebigquery.jdbc.common.SConnection$5.create (Unknown Source)
    at com.simba.googlebigquery.jdbc.common.SConnection$StatementCreator.create (Unknown Source)
    at com.simba.googlebigquery.jdbc.common.SConnection.prepareStatement (Unknown Source)
    at com.simba.googlebigquery.jdbc.common.SConnection.prepareStatement (Unknown Source)
    at com.simba.googlebigquery.jdbc.common.SConnection.prepareStatement (Unknown Source)
    at org.jooq.impl.ProviderEnabledConnection.prepareStatement (ProviderEnabledConnection.java:109)
    at org.jooq.impl.SettingsEnabledConnection.prepareStatement (SettingsEnabledConnection.java:82)
    at org.jooq.impl.AbstractResultQuery.prepare (AbstractResultQuery.java:216)
    at org.jooq.impl.AbstractQuery.execute (AbstractQuery.java:315)
    at org.jooq.impl.AbstractResultQuery.fetch (AbstractResultQuery.java:290)
    at org.jooq.impl.MetaImpl$MetaSchema.lambda$source$13 (MetaImpl.java:695)
    at org.jooq.impl.MetaImpl.withCatalog (MetaImpl.java:222)
    at org.jooq.impl.MetaImpl$MetaSchema.lambda$source$14 (MetaImpl.java:694)
    at org.jooq.impl.MetaImpl.lambda$meta$0 (MetaImpl.java:193)
    at org.jooq.impl.DefaultDSLContext.connectionResult (DefaultDSLContext.java:655)
    at org.jooq.impl.MetaImpl.meta (MetaImpl.java:193)
    at org.jooq.impl.MetaImpl$MetaSchema.source (MetaImpl.java:693)
    at org.jooq.impl.MetaImpl.tableOption (MetaImpl.java:776)
    at org.jooq.impl.MetaImpl$MetaTable.<init> (MetaImpl.java:786)
    at org.jooq.impl.MetaImpl$MetaSchema.lambda$getTables$2 (MetaImpl.java:488)
    at org.jooq.impl.Tools.map (Tools.java:2504)
    at org.jooq.impl.MetaImpl$MetaSchema.getTables (MetaImpl.java:459)
    at org.jooq.meta.AbstractMetaDatabase.loadUniqueKeys (AbstractMetaDatabase.java:85)
    at org.jooq.meta.AbstractDatabase.lambda$40 (AbstractDatabase.java:3388)
    at org.jooq.meta.AbstractDatabase.onError (AbstractDatabase.java:4087)
    at org.jooq.meta.AbstractDatabase.getRelations0 (AbstractDatabase.java:3388)
    at org.jooq.meta.AbstractDatabase.lambda$32 (AbstractDatabase.java:3063)
    at org.jooq.meta.AbstractDatabase.onError (AbstractDatabase.java:4087)
    at org.jooq.meta.AbstractDatabase.getRelations (AbstractDatabase.java:3063)
    at org.jooq.meta.DefaultColumnDefinition.getPrimaryKey (DefaultColumnDefinition.java:161)
    at org.jooq.meta.AbstractTableDefinition.getPrimaryKey (AbstractTableDefinition.java:110)
    at org.jooq.codegen.JavaGenerator.generateTable (JavaGenerator.java:6102)
    at org.jooq.codegen.JavaGenerator.generateTables (JavaGenerator.java:6081)
    at org.jooq.codegen.JavaGenerator.generate (JavaGenerator.java:690)
    at org.jooq.codegen.JavaGenerator.generate (JavaGenerator.java:644)
    at org.jooq.codegen.JavaGenerator.generate0 (JavaGenerator.java:552)
    at org.jooq.codegen.AbstractGenerator.generate (AbstractGenerator.java:207)
    at org.jooq.codegen.JavaGenerator.generate (JavaGenerator.java:237)
    at org.jooq.codegen.GenerationTool.run0 (GenerationTool.java:980)
    at org.jooq.codegen.GenerationTool.run (GenerationTool.java:245)
    at org.jooq.codegen.GenerationTool.generate (GenerationTool.java:240)
    at org.jooq.codegen.maven.Plugin.execute (Plugin.java:216)
    at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo (DefaultBuildPluginManager.java:126)
    at org.apache.maven.lifecycle.internal.MojoExecutor.doExecute2 (MojoExecutor.java:342)
    at org.apache.maven.lifecycle.internal.MojoExecutor.doExecute (MojoExecutor.java:330)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:213)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:175)
    at org.apache.maven.lifecycle.internal.MojoExecutor.access$000 (MojoExecutor.java:76)
    at org.apache.maven.lifecycle.internal.MojoExecutor$1.run (MojoExecutor.java:163)
    at org.apache.maven.plugin.DefaultMojosExecutionStrategy.execute (DefaultMojosExecutionStrategy.java:39)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:160)
    at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:105)
    at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:73)
    at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build (SingleThreadedBuilder.java:53)
    at org.apache.maven.lifecycle.internal.LifecycleStarter.execute (LifecycleStarter.java:118)
    at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:261)
    at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:173)
    at org.apache.maven.DefaultMaven.execute (DefaultMaven.java:101)
    at org.apache.maven.cli.MavenCli.execute (MavenCli.java:827)
    at org.apache.maven.cli.MavenCli.doMain (MavenCli.java:272)
    at org.apache.maven.cli.MavenCli.main (MavenCli.java:195)
    at jdk.internal.reflect.DirectMethodHandleAccessor.invoke (DirectMethodHandleAccessor.java:104)
    at java.lang.reflect.Method.invoke (Method.java:578)
    at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced (Launcher.java:282)
    at org.codehaus.plexus.classworlds.launcher.Launcher.launch (Launcher.java:225)
    at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode (Launcher.java:406)
    at org.codehaus.plexus.classworlds.launcher.Launcher.main (Launcher.java:347)

Key is this part of the stack trace, it seems:

    at org.jooq.impl.MetaImpl$MetaSchema.source (MetaImpl.java:693)
    at org.jooq.impl.MetaImpl.tableOption (MetaImpl.java:776)
    at org.jooq.impl.MetaImpl$MetaTable.<init> (MetaImpl.java:786)
    at org.jooq.impl.MetaImpl$MetaSchema.lambda$getTables$2 (MetaImpl.java:488)
    at org.jooq.impl.Tools.map (Tools.java:2504)
    at org.jooq.impl.MetaImpl$MetaSchema.getTables (MetaImpl.java:459)
    at org.jooq.meta.AbstractMetaDatabase.loadUniqueKeys (AbstractMetaDatabase.java:85)

The error related to fetching sources is documented here as well:

And will receive a separate issue. It's far less an important problem than the fact that constraint information cannot be fetched.
@lukaseder lukaseder added this to the Version 3.19.0 milestone Aug 17, 2023
@lukaseder lukaseder added this to To do in 3.19 Other improvements via automation Aug 17, 2023
@lukaseder lukaseder mentioned this issue Aug 17, 2023
Closed
@lukaseder
Copy link
Member Author

Hmm, maybe, catching and logging this particular exception isn't the right approach. The exception can appear for any reason, including valid ones (not only bugs in the SQL), so catching it will produce a null source value for a view, which may lead to later exceptions that are much harder to debug.

Perhaps I should simply fix the underlying issue here, instead.

@lukaseder lukaseder changed the title Failure in MetaImpl.MetaSchema::source causes failure when querying for primary keys (e.g. in BigQueryDatabase) Failure in MetaImpl.MetaSchema::source in BigQueryDatabase Aug 17, 2023
@lukaseder
Copy link
Member Author

This will be fixed with #15472. The underlying issue is the same.

@lukaseder
Copy link
Member Author

lukaseder commented Aug 22, 2023 •
edited

Fixed in versions

3.19 Other improvements automation moved this from To do to Done Aug 22, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
C: Code Generation C: DB: BigQuery E: Enterprise Edition P: High R: Fixed T: Defect
Projects
No open projects
3.19 Other improvements
Done
Milestone
Version 3.19.0
Development

No branches or pull requests
1 participant
@lukaseder