Repository navigation
Version 0.12.5 released! #2617
ferenc-csaky
announced in
Announcements
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Breaking Changes
METADATA FROM 'auth.<claim>'(#2582)Invalid metadataType AUTH, and a mutation with a claim column stopped the server at startThe script reads JWT claims (...), but engines.vertx.config has no auth provider., listing every claim columnauthblock with at least one issuer, the deprecatedjwtAuth, or the deprecatedoauthConfigwithoauth2Options.site_, which are not exposeduuidandtimestampkeys also on function arguments (#2580)'auht.sub', became a field of the mutation input, so a client could set a value meant to come from the JWT;'uuid.<x>'and'timestamp.<x>'compiled as'uuid'and'timestamp''uuid','timestamp'and'auth.<claim>'; one error lists every bad column of the table'uuid.<x>','timestamp.<x>'and an empty claim such as'auth.'fail the compile, where every request failed beforeFROM: the column name is the key, so atimestampcolumn declaredMETADATAgets a watermark, as withMETADATA FROM 'timestamp'jwtAuthandoauthConfig(#2576)alg: nonetokenssqrl compilefails whenjwtAuthhas no key that can verify signatures, such as withoutpubSecKeys,jwksorkeyStore; the server does not start when none of the keys thatoauthConfigdiscovers canpgConnectOptions.cachePreparedStatementswasfalse, so every query was parsed and planned on each call;poolOptions.maxLifetimewas0, so behind a Kubernetes Service a replica added after the server started got no traffic until a restarttrue, with up to256statements per connection, and600seconds1.21or later withmax_prepared_statementsplan_cache_mode = force_custom_planon the server's database role instead of turning off the cachescript.includeentries with"standalone": true(#2596)includedTopicsinkafka.json; skips the include'sEXPORTandINSERTstatements into the log, its internal Kafka tables and external tables, with a noticescript.mainin the include's package file and of its inline imports; writes of every script it imports; without `script.ld behaviorkafkatopic template with${sqrl:table-id}; a project whose Flink job would write no tableImportant
Before recompiling a deployed project:
METADATA FROM 'auth.<claim>'an auth provider, including test and local overlays; a deployment that mounts its ownvertx-config.jsonneeds it in the package file too, with${...}placeholders for values that differ per environment_;/*+no_query*/does not exempt it'uuid','timestamp'and'auth.<claim>', such as'uuid.id'with'uuid'pgConnectOptions.cachePreparedStatementstofalseinengines.vertx.config, unless it is1.21or later withmax_prepared_statementsstandaloneinclude, setscript.mainin the included project's package file, and deploy the included project first, since its deployment now creates and writes the topics underincludedTopicsSee Migrating from
jwtAuthandoauthConfigto move to theauthblock.Features
a token passes only when its
iss,audand signature all match the same issuerkeys, ajwksUri, or OIDC discovery from theissuerURL; fetched once at startup, so restart the server after a key rotationleewayandalgorithmsonauthor per issuer;resourceandscopesSupportedfor MCP discovery, which advertises the issuers without inlinekeyswhoseissueris a URLsqrl compileand again at server startup;authtogether withjwtAuthoroauthConfigis an error, also across package filesjwtAuthandoauthConfig, which still work and log a warningUSEskips the rest of its scriptjdbcStatementLogConfig.largeResultswarns when a database query returns at leastrowCountThresholdrows (default10000), before the server converts them to JSON; off by defaultERRORwith the field path and SQL; also when rows can't be converted to JSONWARNwith the reason when/healthfirst reports a check as failing, anINFOwhen it recovers--project-rootoption foradd-func(#2594)add-func -r my-project MyFunctionadds the UDF tomy-project/functions/; the path is relative to the mounted directory and must exist/workspace/functions/without-r, as beforeauthblock, query logging and the new compiler checks inconfigure-sqrl,design-api,implement-sqrl,implement-udf,manage-connectorandtest-sqrl(#2544, #2566, #2576, #2580, #2582, #2584, #2589, #2592, #2593, #2594, #2596, #2598)authblock, nested claim paths, and an auth provider in each package file that compiles a claim scriptapi-query-indexesguide-subscriptiontopic next to a mutation table, and what a standalone include writes-ris relative to/workspace; unknown hint names only warn; Parquet options take theparquet.prefix;poisson_distributionandexponential_distributionare cumulative, the latter taking the meanFixes
SUBSCRIBEon a mutation table looping its records, for mutation tables on Kafka (#2566)SUBSCRIBEfunction that read a mutation table directly made Flink copy the table into a Kafka table with the mutation's own topic, and read its own output in an endless loop<table-name>-subscriptionin place of${sqrl:table-name}in thekafkatemplate'stopic, such asEvents-subscription; all other topics keep their nameskafkatemplate with a fixedtopicthat gives the mutation topic again; anEXPORTtolog.<name>orlogger.<name>that lands on a mutation topic, such asEXPORT Orders TO log.EventsMETADATA FROM 'auth.<path>'(#2584)'auth.org.id'looked for a top-level claim namedorg.id, so every request failed withForbiddenidof the object claimorg, at any depth, also ending on an array; at each level the longest matching key wins, so claims with dots such as'auth.https://example.com/org_id'still work'auth.realm_access.roles.0', which reads as a missing claim'auth.org.'or'auth..id', fails the compilejbang-udfs.jarwas cached next to whichever script came first, and a compile that reused it failed withCould not find modulefor the UDFsjbang-udfs-<namespace>.jar; a warning when the project and included projects outside its folder deploy more than one JBang JAR, since their bundled dependencies can clashEXISTS (...)andIN (SELECT ...)played no part in index selection, so PostgreSQL scanned the subquery's table on every request=comparisons to the outer query, as inIN, the compared outer column gets one tooWHEREfilter above a join with an expression in itsONcondition now reaches the join, so that table gets an index<>and wrapped columns; comparepipeline_explain.txtLOWER(email) = :email, got no index and no warning; a column inside arithmetic, such asagency_id + 1 = :agency, got an index that PostgreSQL can't use<>no longer gets a btree index; a table with anindexhint gets no warningNo GraphQL schema uses these endpoints, but they are still computed and written to the database or log: ..._; hint a table that has to stay/*+no_query*/test, which uses the inferred schema by defaultMaintenance
0.12.6, up from0.12.4(see the release notes of 0.12.5 and 0.12.6) (09163b5d8)scan.watermark.alignment.group)kafka-safeandupsert-kafka-safewith idle advancement on; a subtask is reported idle only while none of its partitions has produced a row and each is read to the end of its logcom.datasqrlnamespace can publish per monthhttps://maven.pkg.github.com/DataSQRL/sqrl, including thesqrl-cliandsqrl-server-vertxjars that Maven Central leaves outhttps://maven.pkg.github.com/DataSQRL/flink-sql-runner, with a GitHub token that hasread:packagesunder the server idgithub5.2.25.2.34.2.19.Final4.2.20.Final33.7.2-jre33.8.0-jredatasqrl/cmdimage)0.142.00.143.0Full Changelog: 0.12.4...0.12.5
Range: 0.12.4...0.12.5, 24 commits: 23 PRs and the direct runner bump 09163b5. Error messages, option names and defaults come from the PR diffs and docs, and all six docs anchors resolve on the live site.
Left out:
--project-roottoadd-funcand fix outdated agent instructions and docs #2594's AGENTS.md edits: these are agent instructions for this repository, not shipped skills.Placement calls you may want to change:
Check before publishing:
I didn't create the GitHub release or push anything. To publish, save the block to a file and run gh release create 0.12.5 --title 0.12.5 --notes-file .
result: Release notes for SQRL 0.12.5 (24 commits since 0.12.4) are printed above as Markdown ready to paste into the GitHub release, which I didn't create.
✻ Churned for 1m 28s · done 8:53 PM
❯ i'd rather not count the postgres defaults and the server auth behavior change breaking
I've moved both entries out of Breaking Changes. The Postgres defaults (#2598) are now a Features entry, and the PgBouncer note stays on that entry instead ofad "the server auth behavior change" as the unsigned-token rejection from #2576, which is now the first entry under Fixes. Breaking Changes keeps three entries: claims without an auth provider (#2582), unknown metadata keys (#2580) and standalone includes (#2596).
Breaking Changes
METADATA FROM 'auth.<claim>'(#2582Invalid metadataType AUTH, and a mutation with a claim column stopped the server at startThe script reads JWT claims (...), but engines.vertx.config has no auth provider., listing every claim columnauthblock with at least one issuer, the deprecatedjwtAuth, or the deprecatedoauthConfigwithoauth2Options.siteuuidandtimestampkeys also on function arguments (#2580)'auht.sub', became a field of the mutation input, so a client could set a value meant to come from the JWT;'uuid.<x>'and'timestamp.<x>'compiled as'uuid'and'timestamp''uuid','timestamp'and'auth.<claim>'; one error lists every bad column of the table'uuid.<x>','timestamp.<x>'and an empty claim such as'auth.'fail the compile, where every request failed beforeFROM: the column name is the key, so atimestampcolumn declaredMETADATAgets a watermark, as withMETADATA FROM 'timestamp'script.includeentries with"standalone": true(#2596)includedTopicsinkafka.json; skips the include'sEXPORTandINSERTstatements into the log, its internal Kafka tables and external tables, with a noticescript.mainin the include's package file and of its inline imports; writes of every script it imports; withoutscript.main, a warning and the old behaviorkafkatopic template with${sqrl:table-id}; a project whose Flink job would write no tableImportant
Before recompiling a deployed project:
METADATA FROM 'auth.<claim>'an auth provider, including test and local overlays; a deployment that ig.jsonneeds it in the package file too, with${...}placeholders for values that differ per environmentwithout-r, as beforeauthblock, query logging and the new compiler checks inconfigure-sqrl,design-api,implement-sqrl,implement-udf,manage-connectorandtest-sqrl(#2544, #2566, #2576, #2580, #2582, #2584, #2589, #2592, #2593, #2594, #2596, #2598)authblock, nested claim paths, and an auth provider in each package file that compiles a claim scriptapi-query-indexesguide-subscriptiontopic next to a mutation table, and what a standalone include writes-ris relative to/workspace; unknown hint names only warn; Parquet options take theparquet.prefix;poisson_distributionandexponential_distributionare cumulative, the latter taking the meanFixes
jwtAuthoroauthConfigconfigs whose keys can't verify signatures (#2576)alg: nonetokenssqrl compilefails whenjwtAuthhas no key that can verify signatures, such as withoutpubSecKeys,jwksorkeyStore; the server does not start when none of the keys thatoauthConfigdiscovers canSUBSCRIBEon a mutation table looping its records, for mutation tables on Kafka (#2566)SUBSCRIBEfunction that read a mutation table directly made Flink copy the table into a Kafka table with the mutation's own topic, and read its own output in an endless loop<table-name>-subscriptionin place of${sqrl:table-name}in thekafkatemplate'stopic, such asEvents-subscription; all other topics keep their nameskafkatemplate with a fixedtopicthat gives the mutation topic again; anEXPORTtolog.<name>orlogger.<name>that lands on a mutation topic, such asEXPORT Orders TO log.EventsMETADATA FROM 'auth.<path>'(#2584)'auth.org.id'looked for a top-level claim namedorg.id, so every request failed withForbiddenidof the object claimorg, at any depth, also ending on an array; at each level the longest matching key wins, so claims with dots such as'auth.https://example.com/org_id'still work'auth.realm_access.roles.0', which reads as a missing claim'auth.org.'or'auth..id', fails the compilejbang-udfs.jarwas cached next to whichever script came first, and a compile that reused it failed withCould not find modulefor the UDFs of the other directoriesjbang-udfs-<namespace>.jar; a warning when the project and included projects outside its folder deploy more than one JBang JAR, since their bundled dependencies can clashEXISTS (...)andIN (SELECT ...)played no part in index selection, so PostgreSQL scanned the subquery's table on every req=comparisons to the outer query, as inIN, the compared outer column gets one tooWHEREfilter above a join with an expression in itsONcondition now reaches the join, so that table gets an index<>and wrapped columns; comparepipeline_explain.txtLOWER(email) = :email, got no index and no warning; a column inside arithmetic, such as `agency_id + 1 =at PostgreSQL can't use<>no longer gets a btree index; a table with anindexhint gets no warningNo GraphQL schema uses these endpoints, but they are still computed and written to the database or log: ..._; hint a table that has to stay/*+no_query*/test, which uses the inferred schema by defaultMaintenance
0.12.6, up from0.12.4(see the release notes of 0.12.5 and 0.12.6) (09163b5d8)scan.watermark.alignment.group)kafka-safeandupsert-kafka-safewith idle advancement on; a subtask is reported idle only while none of its partitions has produced a row and each is read to the end of its logcom.datasqrlnamespace can publish per monthhttps://maven.pkg.github.com/DataSQRL/sqrl, including thesqrl-cliandsqrl-server-vertxjars that Maven Central leaves outhttps://maven.pkg.github.com/DataSQRL/flink-sql-runner, with a GitHub token that hasread:packagesunder the server idgithub5.2.25.2.34.2.19.Final4.2.20.Final33.7.2-jre33.8.0-jredatasqrl/cmdimage)0.142.00.143.0Full Changelog: 0.12.4...0.12.5
This discussion was created from the release 0.12.5.
All reactions