Bug: Database/Live tests fail

[kenjis]

Describe the bug
I don't know why three tests fails.
The table db_migrations is gone.

$ vendor/bin/phpunit tests/system/Database/Live/ --no-coverage
PHPUnit 9.5.2 by Sebastian Bergmann and contributors.

................................................S.S..S.........  63 / 197 ( 31%)
............................................................... 126 / 197 ( 63%)
............FFF................................................ 189 / 197 ( 95%)
........                                                        197 / 197 (100%)

Time: 00:29.795, Memory: 22.00 MB

There were 3 failures:

1) CodeIgniter\Database\Live\MetadataTest::testListTables
Failed asserting that two arrays are equal.
--- Expected
+++ Actual
@@ @@
 Array (
-    0 => 'db_migrations'
-    1 => 'db_user'
-    2 => 'db_job'
-    3 => 'db_misc'
-    4 => 'db_type_test'
-    5 => 'db_empty'
-    6 => 'db_secondary'
-    7 => 'db_stringifypkey'
-    8 => 'db_without_auto_increment'
+    0 => 'db_user'
+    1 => 'db_job'
+    2 => 'db_misc'
+    3 => 'db_type_test'
+    4 => 'db_empty'
+    5 => 'db_secondary'
+    6 => 'db_stringifypkey'
+    7 => 'db_without_auto_increment'
 )

/Users/kenji/work/codeigniter/CodeIgniter4/tests/system/Database/Live/MetadataTest.php:46

2) CodeIgniter\Database\Live\MetadataTest::testListTablesConstrainPrefix
Failed asserting that two arrays are equal.
--- Expected
+++ Actual
@@ @@
 Array (
-    0 => 'db_migrations'
-    1 => 'db_user'
-    2 => 'db_job'
-    3 => 'db_misc'
-    4 => 'db_type_test'
-    5 => 'db_empty'
-    6 => 'db_secondary'
-    7 => 'db_stringifypkey'
-    8 => 'db_without_auto_increment'
+    0 => 'db_user'
+    1 => 'db_job'
+    2 => 'db_misc'
+    3 => 'db_type_test'
+    4 => 'db_empty'
+    5 => 'db_secondary'
+    6 => 'db_stringifypkey'
+    7 => 'db_without_auto_increment'
 )

/Users/kenji/work/codeigniter/CodeIgniter4/tests/system/Database/Live/MetadataTest.php:55

3) CodeIgniter\Database\Live\MetadataTest::testConstrainPrefixIgnoresOtherTables
Failed asserting that two arrays are equal.
--- Expected
+++ Actual
@@ @@
 Array (
-    0 => 'db_migrations'
-    1 => 'db_user'
-    2 => 'db_job'
-    3 => 'db_misc'
-    4 => 'db_type_test'
-    5 => 'db_empty'
-    6 => 'db_secondary'
-    7 => 'db_stringifypkey'
-    8 => 'db_without_auto_increment'
+    0 => 'db_user'
+    1 => 'db_job'
+    2 => 'db_misc'
+    3 => 'db_type_test'
+    4 => 'db_empty'
+    5 => 'db_secondary'
+    6 => 'db_stringifypkey'
+    7 => 'db_without_auto_increment'
 )

/Users/kenji/work/codeigniter/CodeIgniter4/tests/system/Database/Live/MetadataTest.php:86

FAILURES!
Tests: 197, Assertions: 419, Failures: 3, Skipped: 3.

CodeIgniter 4 version
develop branch.

Affected module(s)
Database tests

Expected behavior, and steps to reproduce if appropriate
All tests pass.

Context

• OS: [macOS 10.15.7]
• Web server [n/a]
• PHP version [7.4.15]

[paulbalandan]

I think this is depending on the result of a previous test case.

[kenjis]

Probably, but what is it?

Why db_migrations is missing?
If migrations go, the table is created.

And when I change test database from memory to sqlite file,
all tests pass.

[kenjis]

I don't know why, but now the tests pass.

$ vendor/bin/phpunit tests/system/Database/Live/ --no-coverage
PHPUnit 9.5.2 by Sebastian Bergmann and contributors.

......................................................S.S..S...  63 / 222 ( 28%)
............................................................... 126 / 222 ( 56%)
............................................................... 189 / 222 ( 85%)
.................................                               222 / 222 (100%)

Time: 00:50.342, Memory: 26.00 MB

OK, but incomplete, skipped, or risky tests!
Tests: 222, Assertions: 445, Skipped: 3.

[kenjis]

Both PHP 7.4.16 and PHP 7.3.27 are okay.

$ /usr/local/opt/php\@7.3/bin/php vendor/bin/phpunit tests/system/Database/Live/ --no-coverage
PHPUnit 9.5.2 by Sebastian Bergmann and contributors.

......................................................S.S..S...  63 / 222 ( 28%)
............................................................... 126 / 222 ( 56%)
............................................................... 189 / 222 ( 85%)
.................................                               222 / 222 (100%)

Time: 00:16.534, Memory: 24.00 MB

OK, but incomplete, skipped, or risky tests!
Tests: 222, Assertions: 445, Skipped: 3.

@paulbalandan If you pass the tests, close this issue, please.