Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

NOAI #9084

Merged
merged 2 commits into from
Sep 23, 2024
Merged

NOAI #9084

merged 2 commits into from
Sep 23, 2024

Conversation

MMeent
Copy link
Contributor

@MMeent MMeent commented Sep 20, 2024

We can't FlushOneBuffer when we're in redo-only mode on PageServer, so make execution of that function conditional on us not running in pageserver walredo mode.

Problem

https://neondb.slack.com/archives/C033RQ5SPDH/p1726847895245409

Summary of changes

We make sure to not call into FlushOneBuffer when we're in WALRedoPostgres mode.

See

Checklist before requesting a review

  • I have performed a self-review of my code.
  • If it is a core feature, I have added thorough tests.
  • Do we need to implement analytics? if so did you add the relevant metrics to the dashboard?
  • If this PR requires public announcement, mark it with /release-notes label and add several sentences in this section.

Checklist before merging

  • Do not forget to reformat commit message to not include the above checklist

@MMeent MMeent requested a review from a team as a code owner September 20, 2024 17:20
Copy link
Member

@skyzh skyzh left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

works with my testing

@MMeent MMeent force-pushed the fix/hash-xlog-flushes-in-walredo-pg branch from 3804a1c to 9eb7ce0 Compare September 20, 2024 17:27
@hlinnaka
Copy link
Contributor

Can we add a test to the test suite, please?

@MMeent MMeent force-pushed the fix/hash-xlog-flushes-in-walredo-pg branch 4 times, most recently from 196d804 to 205c4f3 Compare September 20, 2024 21:15
@MMeent
Copy link
Contributor Author

MMeent commented Sep 20, 2024

Can we add a test to the test suite, please?

I've updated the test that checks compatibility with unlogged tables, would that be sufficient?

Copy link

github-actions bot commented Sep 20, 2024

5029 tests run: 4865 passed, 0 failed, 164 skipped (full report)


Flaky tests (4)

Postgres 17

Postgres 16

Postgres 14

Code coverage* (full report)

  • functions: 32.1% (7446 of 23213 functions)
  • lines: 49.9% (59956 of 120174 lines)

* collected from Rust tests only


The comment gets automatically updated with the latest test results
7eb96e2 at 2024-09-23T21:26:16.583Z :recycle:

@MMeent
Copy link
Contributor Author

MMeent commented Sep 23, 2024

cc @hlinnaka

@MMeent MMeent force-pushed the fix/hash-xlog-flushes-in-walredo-pg branch 3 times, most recently from d073e6a to 742ab85 Compare September 23, 2024 11:03
We can't FlushOneBuffer when we're in redo-only mode on PageServer,
so make execution of that function conditional on us not running in
pageserver walredo mode.
Fix: Don't flush a buffer in am_wal_redo_postgres mode

WalRedoPostgres operates on private buffers, which causes issues
with FlushOneBuffer, which expects to handle only shared buffers.
@MMeent MMeent force-pushed the fix/hash-xlog-flushes-in-walredo-pg branch from 742ab85 to 30674a5 Compare September 23, 2024 12:03
coderabbitai[bot]

This comment was marked as off-topic.

@MMeent MMeent changed the title Fix issues in hash xlog processing NOAI Sep 23, 2024
@neondatabase neondatabase deleted a comment from coderabbitai bot Sep 23, 2024
@neondatabase neondatabase deleted a comment from coderabbitai bot Sep 23, 2024
@neondatabase neondatabase deleted a comment from coderabbitai bot Sep 23, 2024
@neondatabase neondatabase deleted a comment from coderabbitai bot Sep 23, 2024
@neondatabase neondatabase deleted a comment from coderabbitai bot Sep 23, 2024
@MMeent MMeent enabled auto-merge (squash) September 23, 2024 12:23
@arpad-m
Copy link
Member

arpad-m commented Sep 23, 2024

very strange @hlinnaka @bayandin link:

  HEAD is now at 4d5add9 compact_level0_phase1: remove final traces of value access mode config (#8935)
  M	vendor/postgres-v14
  M	vendor/postgres-v15
  M	vendor/postgres-v16
  M	vendor/postgres-v17
  vendor/postgres-v16
  fatal: unable to read tree (1d7081a3b076ddf5086e0b118d4329820e6a7427)
  fatal: Unable to checkout '1d7081a3b076ddf5086e0b118d4329820e6a7427' in submodule path 'vendor/postgres-v16'
  Error: __Line:133__Error: Could not checkout submodule hash referenced by main. It may not be pushed to remote or deeper than workflow shallow clone

@MMeent MMeent merged commit d865881 into main Sep 23, 2024
82 checks passed
@MMeent MMeent deleted the fix/hash-xlog-flushes-in-walredo-pg branch September 23, 2024 21:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants