5 Releases published by 1 person

• release-compute-7991

  published Mar 5, 2025

• release-8010

  published Mar 5, 2025

• release-proxy-7808

  published Mar 6, 2025

• release-8080

  published Mar 7, 2025

• release-compute-8053

  published Mar 10, 2025

66 Pull requests merged by 19 people

• Fix caclulation of LFC used_pages

  #11095 merged Mar 10, 2025

• Add configuration options to disable prevlink checks

  #11138 merged Mar 10, 2025

• safekeeper: use max end lsn as start of next batch

  #11152 merged Mar 10, 2025

• pageserver: https for management API

  #11025 merged Mar 10, 2025

• Compute release 2025-03-07

  #11129 merged Mar 10, 2025

• fix(ci): use <!subteam^ID> syntax for pinging groups on slack

  #11135 merged Mar 10, 2025

• Appease cargo deny errors

  #11142 merged Mar 10, 2025

• fix(proxy): Use testodrome query id for latency measurement

  #11150 merged Mar 10, 2025

• storcon: update scheduler stats when changing node's preferred az

  #11147 merged Mar 10, 2025

• Print state of connection buffer when no response is receioved from PS for a long time

  #11145 merged Mar 9, 2025

• Fetch remote extension in ALTER EXTENSION UPDATE statements

  #11102 merged Mar 9, 2025

• Storage release 2025-03-07

  #11128 merged Mar 7, 2025

• Fix dropping role with table privileges granted by non-neon_superuser

  #10964 merged Mar 7, 2025

• feat(pageserver): add force patch index_part API

  #11119 merged Mar 7, 2025

• storcon: use https safekeeper api

  #11065 merged Mar 7, 2025

• storage controller: API-driven graceful migrations

  #10913 merged Mar 7, 2025

• pageserver: enable previous heatmaps by default

  #11132 merged Mar 7, 2025

• safekeeper: don't skip empty records for shard zero

  #11137 merged Mar 7, 2025

• Support workflow_dispatch event in _meta.yml

  #11133 merged Mar 7, 2025

• storcon: initial autosplit tweaks

  #11134 merged Mar 7, 2025

• storcon: require safekeeper jwt's in strict mode

  #11116 merged Mar 7, 2025

• remove CODEOWNER assignement for the test_runner/

  #11130 merged Mar 7, 2025

• feat(compute_ctl): Add a basic HTTP API benchmark

  #11123 merged Mar 7, 2025

• update ring to 0.17.13

  #11131 merged Mar 7, 2025

• feat(pageserver): yield gc-compaction to L0 compaction

  #11120 merged Mar 6, 2025

• Add performance-correctness to the CODEOWNERS

  #11124 merged Mar 6, 2025

• fix(compute_ctl): Properly escape identifiers inside PL/pgSQL blocks

  #11045 merged Mar 6, 2025

• Spawn rsyslog from neonvm

  #11111 merged Mar 6, 2025

• run periodic page bench more frequently to simplify bi-secting regressions

  #11121 merged Mar 6, 2025

• feat(pageserver): more statistics for gc-compaction

  #11103 merged Mar 6, 2025

• fix(compute/sql_exporter): Ignore invalid DBs when collecting size

  #11097 merged Mar 6, 2025

• pageserver: mark unarchival heatmap layers as cold

  #11098 merged Mar 6, 2025

• pageserver: allow for unit test stress test

  #11112 merged Mar 6, 2025

• pageserver: add amortized read amp metrics

  #11093 merged Mar 6, 2025

• Update Jinja2 to 3.1.6

  #11109 merged Mar 6, 2025

• Proxy release 2025-03-06

  #11106 merged Mar 6, 2025

• proxy: Small adjustments to json logging

  #11107 merged Mar 6, 2025

• rfc: add 041-rel-sparse-keyspace

  #10412 merged Mar 5, 2025

• test(pageserver): use reldirv2 by default in regress tests

  #11081 merged Mar 5, 2025

• compute/lfc: Add chunk size to neon_lfc_stats

  #11100 merged Mar 5, 2025

• fix grafana dashboard link for pooler endoints

  #11099 merged Mar 5, 2025

• Update postgres_exporter to 0.17.1

  #11094 merged Mar 5, 2025

• feat(compute): Add filename label to remote ext requests metric

  #11091 merged Mar 5, 2025

• Setup compute_ctl pgaudit and rsyslog

  #10615 merged Mar 5, 2025

• feat(pageserver): revisit error types for gc-compaction

  #11082 merged Mar 5, 2025

• storcon db: load safekeepers from DB again

  #11087 merged Mar 5, 2025

• Storage release 2025-03-05

  #11090 merged Mar 5, 2025

• fix(ci): make deploy job depend on pushing images to dev registries

  #11089 merged Mar 5, 2025

• test_runner/regress: speed up test_check_visibility_map

  #11086 merged Mar 5, 2025

• pageserver: gate previous heatmap behind config flag

  #11088 merged Mar 5, 2025

• Compute release 2025-02-28

  #11039 merged Mar 5, 2025

• pageserver: do big reads to fetch slru segment

  #11029 merged Mar 5, 2025

• Skip dropping tablesync replication slots on the publisher from branch

  #11073 merged Mar 5, 2025

• utils: log Sentry initialization

  #11077 merged Mar 5, 2025

• proxy: JSON logging field refactor

  #11078 merged Mar 5, 2025

• exclude separate perf tests from bench step

  #11084 merged Mar 5, 2025

• Check response status in prefetch_lookup

  #11080 merged Mar 5, 2025

• Distinguish manually submitted runs for periodic pagebench in grafana dashboard

  #11079 merged Mar 4, 2025

• Authorize compute_ctl requests from the control plane

  #10530 merged Mar 4, 2025

• compute_tools: appease unused lint on macOS

  #11074 merged Mar 4, 2025

• fix(test): use the same value for reldir v1+v2

  #11070 merged Mar 4, 2025

• http-utils: generate heap profiles with jemalloc_pprof

  #11075 merged Mar 4, 2025

• tests: remove obsolete err log whitelisting

  #11069 merged Mar 4, 2025

• storcon: add per-tenant rate limiting for API requests

  #10924 merged Mar 3, 2025

• feat(pageserver): persist reldir v2 migration status

  #10980 merged Mar 3, 2025

• fix(pageserver): avoid flooding gc-compaction logs

  #11024 merged Mar 3, 2025

17 Pull requests opened by 9 people

• Make collecting the installed extensions metric async

  #11071 opened Mar 3, 2025

• Remove clone in compute_ctl /metrics.json handler

  #11076 opened Mar 4, 2025

• Add performance test for prefetch in LFC

  #11083 opened Mar 5, 2025

• CI run for PR #10739

  #11085 opened Mar 5, 2025

• Fix pageserver_try_receive

  #11096 opened Mar 5, 2025

• feat(pageserver): skip gc-compaction if we likely cannot collect garbage

  #11104 opened Mar 5, 2025

• Document Neon specific explain options

  #11108 opened Mar 6, 2025

• Add /configure_telemetry API endpoint

  #11117 opened Mar 6, 2025

• storcon: add repeated auto-splits and initial splits

  #11122 opened Mar 6, 2025

• pageserver: remove legacy TimelineInfo::latest_gc_cutoff field (2/2)

  #11136 opened Mar 7, 2025

• utils: explicit OTEL export config and OTEL enablement via common entry point

  #11139 opened Mar 7, 2025

• pageserver: optionally export perf traces in OTEL format

  #11140 opened Mar 7, 2025

• fix(test): force L0 compaction before gc-compaction

  #11143 opened Mar 7, 2025

• pageserver: remove legacy `TimelineInfo::latest_gc_cutoff` field (1/2)

  #11149 opened Mar 10, 2025

• fix(ci): fail meta using jq halt_error if data is unexpectedly missing

  #11151 opened Mar 10, 2025

• storcon: do not update observed state on node activation

  #11155 opened Mar 10, 2025

• pageserver: add `max_logical_size_per_shard` for `get_top_tenants`

  #11157 opened Mar 10, 2025

7 Issues closed by 6 people

• Epic: investigate `anon` root access requirement

  #7910 closed Mar 10, 2025

• storage controller: "home" scheduler stats become stale when changing tenant's preferred AZ

  #10493 closed Mar 10, 2025

• pageserver: filter out the keys from parent shard but not belong to this shard when create delta layer

  #11018 closed Mar 10, 2025

• unlimited db's

  #11141 closed Mar 10, 2025

• storcon: safer manual migration API

  #10540 closed Mar 7, 2025

• safekeeper: speed up timeline deletion

  #10265 closed Mar 7, 2025

• Track cold_start_info for archive branches

  #11115 closed Mar 6, 2025

16 Issues opened by 10 people

• `pageserver_io_operations_bytes_total` not lifecycled correctly for secondaries

  #11156 opened Mar 10, 2025

• storcon: split based on total logical size, not max logical size

  #11154 opened Mar 10, 2025

• test_gc_feedback performance test is unstable

  #11153 opened Mar 10, 2025

• storage controller: shards sometimes left in bad state when reconcile races with re-attach

  #11148 opened Mar 10, 2025

• Add test extension with library in `test_download_extensions.py`

  #11146 opened Mar 9, 2025

• pageserver: manual compaction API should not yield to L0

  #11144 opened Mar 7, 2025

• Don't make remote extension requests for extensions in `shared_preload_libraries`

  #11127 opened Mar 6, 2025

• Move extension server code out of Postgres fork

  #11126 opened Mar 6, 2025

• pageserver: shard-ancestor compaction should yield to L0 compaction

  #11125 opened Mar 6, 2025

• Return 500 Internal Server Error on panic in HTTP handler

  #11118 opened Mar 6, 2025

• Improve backoff stratagy for redis reconnection

  #11114 opened Mar 6, 2025

• Refactor PageserverClient and SafekeeperClient

  #11113 opened Mar 6, 2025

• gc-compaction: avoid wasted work across restarts

  #11105 opened Mar 5, 2025

• Parallelism for LR subscriber

  #11101 opened Mar 5, 2025

• Failed to open file "xxxx/00000001000000870000001D" for wal backup

  #11092 opened Mar 5, 2025

• Support the pg_temporal extensions

  #11072 opened Mar 3, 2025

37 Unresolved conversations

Sometimes conversations happen on old items that aren’t yet closed. Here is a list of all the Issues and Pull Requests with unresolved conversations.

• Add workflow to run particular test(s) N times

  #11050 commented on Mar 7, 2025 • 35 new comments

• storcon: timetime table, creation and deletion

  #11058 commented on Mar 10, 2025 • 33 new comments

• moving LastWrittenLSNCache to Neon Extension

  #11031 commented on Mar 10, 2025 • 24 new comments

• Reuse artifacts from release PRs

  #11061 commented on Mar 10, 2025 • 22 new comments

• RFC: Endpoint Persistent Unlogged Files Storage

  #9661 commented on Mar 10, 2025 • 16 new comments

• feat(compute_ctl): use TLS if configured

  #10972 commented on Mar 5, 2025 • 10 new comments

• Add lazy_slru_download flag to compute spec to enable lazy SLRU download for the particular region

  #11012 commented on Mar 6, 2025 • 6 new comments

• walproposer: pre generations refactoring

  #11060 commented on Mar 7, 2025 • 3 new comments

• RFC: Rewrite Postgres <-> Pageserver communication

  #10799 commented on Mar 10, 2025 • 1 new comment

• pageserver_api: implement keyspace range iterator (#6435)

  #10796 commented on Mar 6, 2025 • 1 new comment

• safekeeper: retain segments locally for a minimum interval

  #10989 commented on Mar 4, 2025 • 0 new comments

• impr: propagate VirtualFile metrics via RequestContext

  #7202 commented on Mar 10, 2025 • 0 new comments

• Vlad/perf span

  #10537 commented on Mar 7, 2025 • 0 new comments

• Prewarm using lfc prefetch

  #10591 commented on Mar 4, 2025 • 0 new comments

• pageserver: remove resident size from billing metrics

  #10739 commented on Mar 5, 2025 • 0 new comments

• random api test

  #10986 commented on Mar 10, 2025 • 0 new comments

• add benchmark demonstrating `metrics`/`prometheus` crate multicore scalability pitfalls & workarounds

  #11019 commented on Mar 10, 2025 • 0 new comments

• test(pageserver): add small tenant compaction

  #11049 commented on Mar 10, 2025 • 0 new comments

• for #10993: cancellation sensitivity for buffered writer

  #11052 commented on Mar 10, 2025 • 0 new comments

• small tenant compaction tests to catch issues like #10548

  #10881 commented on Mar 4, 2025 • 0 new comments

• pageserver: generate image layers at L0/in-mem boundary (or L0/L1 boundary)

  #11063 commented on Mar 4, 2025 • 0 new comments

• pageserver: size trigger for image layer generation

  #11064 commented on Mar 4, 2025 • 0 new comments

• pageserver produces panic errors "must not use after we returned an error" after I/O error (ENOSPC)

  #10856 commented on Mar 4, 2025 • 0 new comments

• pageserver: relv2 test timeout on arm64 / further optimize read latency

  #11067 commented on Mar 4, 2025 • 0 new comments

• storage controller: panic in `push_secondary` in `test_sharding_autosplit`

  #10926 commented on Mar 4, 2025 • 0 new comments

• pageserver: upload/delete race

  #10283 commented on Mar 4, 2025 • 0 new comments

• Improvement: Move the last written LSN (LwLSN) cache into neon extension

  #10973 commented on Mar 4, 2025 • 0 new comments

• Incorrect command in updating postgres documentation

  #11056 commented on Mar 4, 2025 • 0 new comments

• pageserver: support 1 million relations

  #9516 commented on Mar 4, 2025 • 0 new comments

• compute: metric for used vs. cold data in LFC

  #11062 commented on Mar 5, 2025 • 0 new comments

• Epic: pageserver: updated detach API (enable doing ancestor detach on timelines that have more than one ancestor)

  #10310 commented on Mar 6, 2025 • 0 new comments

• Epic: productionize gc-compaction

  #9114 commented on Mar 6, 2025 • 0 new comments

• Epic: safekeepers dynamic membership change (Phase 2)

  #8614 commented on Mar 7, 2025 • 0 new comments

• Store timeline locations on storage controller (schema, insert, timeline creation and passthrough to the majority)

  #9011 commented on Mar 7, 2025 • 0 new comments

• pageserver: concurrent IO on the get page read path

  #9378 commented on Mar 10, 2025 • 0 new comments

• Epic: proper vacuuming for databases that are not always on

  #6228 commented on Mar 10, 2025 • 0 new comments

• Failure in `test_isolation[None]`

  #10652 commented on Mar 10, 2025 • 0 new comments