Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

SQLite: Migrations containing PRAGMA foreign_keys= should be marked as non-transactional #2190

ZumiKua opened this issue Oct 31, 2018 · 5 comments


Copy link

ZumiKua commented Oct 31, 2018

Which version and edition of Flyway are you using?

Flyway 5.2.1 (with Spring)

If this is not the latest version, can you reproduce the issue with the latest one as well?

this is the latest version in maven central.

Which client are you using? (Command-line, Java API, Maven plugin, Gradle plugin)

Java API? I'm using Spring boot and it seems that Spring boot handles migration for me.

Which database are you using (type & version)?

SQLite JDBC 3.25.2

Which operating system are you using?

Windows 10

What did you do?

Execute the following migration:

PRAGMA foreign_keys=OFF;


CREATE TABLE new_category(
    name TEXT NOT NULL,
    ord INTEGER

INSERT INTO new_category SELECT id, name, ord FROM category;

DROP TABLE category;

ALTER TABLE new_category RENAME TO category;

CREATE INDEX category_name_index ON category(name);

PRAGMA foreign_key_check;


PRAGMA foreign_keys=on;
What did you expect to see?

According to flyway documentation

If Flyway detects that a specific statement cannot be run within a transaction due to technical limitations of your database, it won’t run that migration within a transaction. Instead it will be marked as non-transactional.

So I expect flyway mark this migration as non-transactional

What did you see instead?

It still wrap this migration in a transaction.

SQL State  : null
Error Code : 1
Message    : [SQLITE_ERROR] SQL error or missing database (cannot start a transaction within a transaction)
Location   : db/migration/V14__RemoveHighlightColumnInCategoryTable.sql (...\out\production\resources\db\migration\V14__RemoveHighlightColumnInCategoryTable.sql)
Line       : 3

Copy link

This isn't trivial to solve as SQLite only supports a single transaction, via a single connection. Marking the migration as non-transactional isn't enough as it still poses issues with our schema history table management.

The workaround is easy: don't begin or commit transaction within a migration. Flyway already wraps every migration in a transaction for you.

Documented as a limitation.

Copy link

ZumiKua commented Nov 9, 2018

Sorry for my late reply.
Currently I'm using Java Migration to workaround this, by create a subclass of BaseJavaMigration and override canExecuteInTransaction to return false.
Will this cause any problem? Like flyway's schema history table's management you metioned?

BTW I think execute something outside transaction is important, like the migration I wrote on original post, PRAGMA foreign_keys=OFF; must be executed outside a transaction. And this is a very common usage to modify table schema.

Copy link

Your workaround should be fine for now. It could make sense for Flyway to automatically mark a migration containing PRAGMA foreign_keys= as non-transactional (even the statement can be run within a transaction, but then it is treated as a no-op which certainly isn't the desired behavior)

Copy link

ZumiKua commented Nov 12, 2018

Gotcha, thanks for your help.

@ZumiKua ZumiKua closed this as completed Nov 12, 2018
@axelfontaine axelfontaine reopened this Nov 12, 2018
@axelfontaine axelfontaine changed the title using BEGIN TRANSACTION; in migration cause migration failed. SQLite: Migrations containing PRAGMA foreign_keys= should be marked as non-transactional Nov 19, 2018
axelfontaine pushed a commit to flyway/ that referenced this issue Nov 19, 2018
Copy link

Fixed. Migration containing PRAGMA foreign_keys= are now automatically marked as non-transactional.

axelfontaine pushed a commit that referenced this issue Nov 19, 2018
dohrayme pushed a commit to dohrayme/flyway that referenced this issue Feb 3, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
None yet

No branches or pull requests

2 participants