3.65

What's Changed

• Helm Chart

  • Helm chart readme - clarify details about multiple filers and datastore by @tomeresk in #5384
  • helm chart: make s3 ingress annotations consistent by @mergwyn in #5463

• Filer

  • fix get file metadata bug by @jerebear12 in #5394
  • Add TLS support, initial etcd connection check, fix key_prefix handling for etcd backend meta storage by @sample in #5403
  • fix filer address parsing by @doc-sheet in #5415
  • Move ListDirectoryEntries logic to ListDirectoryPrefixedEntries in etcd meta storage backend by @sample in #5416
  • fix: adjust condition in prefixFilterEntries prevent infinite loop by @sample in #5440
  • fix: ensure complete gRPC stream consumption in doListFilerEntries to prevent context canceled errors. by @sample in #5441
  • fix: filer authenticate with with volume server by @hencoappel in #5480
  • fix append disorder by @kungf in #5492

• Filer Sync

  • fix: sync without dir /buckets/some/.uploads/hash_hash by @kmlebedev in #5402

• Filer Replication

  • fix: panic: assignment to entry in nil map on S3Sink.CreateEntry by @kmlebedev in #5406

• S3

  • Fix iam service response 500 by @zuzuviewer in #5405
  • fix s3api: delimeter properly takes prefixes into account by @adasauce in #5411
  • [tests] add action s3 tests by @kmlebedev in #5427
  • fix completed multiupload lost data by @kungf in #5460
  • fix: correctly form partNumber from new entry.Name format in "listObjectParts" by @sample in #5470
  • [s3] fix s3 test_multipart_resend_first_finishes_last by @kmlebedev in #5471
  • [s3] add s3 pass test_multipart_upload by @kmlebedev in #5474
  • [s3] add s3 pass test_multipart_upload_size_too_small by @kmlebedev in #5475
  • [s3] fix s3 test_multipart_get_part by @kmlebedev in #5476

• Mount

  • fix GetAttr blocks count by @wusongANKANG in #5409
  • fix git clone into fuse mount fails with inflate: data stream error #5412

• Misc

  • add basic support for sentry error reporting by @doc-sheet in #5410
  • chore: fix function names in comment by @clonefetch in #5478
  • chore: fix some typos in comments by @yudrywet in #5497

• Master

  • [master] add test for PickForWrite add metrics for volume layout by @kmlebedev in #5413
  • fix panic 5435 by @kmlebedev in #5436
  • [master] grow volumes if no writable volumes in current dataCenter by @kmlebedev in #5434
  • fix panic at isAllWritable by @kmlebedev in #5457

• Volume Server

  • fix: always close volume file (#4530) by @hencoappel in #5459
  • Correct type for volume logs and idx values by @mergwyn in #5462
  • fix(volume.fix.replication): adjust volume count, not free volume count by @CodeRusher in #5479
  • [volume] Reduce the number of buffers for uploading one chunk by @kmlebedev in #5458

New Contributors

• @tomeresk made their first contribution in #5384
• @zuzuviewer made their first contribution in #5405
• @doc-sheet made their first contribution in #5410
• @sample made their first contribution in #5403
• @mergwyn made their first contribution in #5462
• @clonefetch made their first contribution in #5478
• @CodeRusher made their first contribution in #5479
• @yudrywet made their first contribution in #5497

Full Changelog: 3.64...3.65

3.64

What's Changed

• Filer
  • Disable filer UI in configuration by @jerebear12 in #5297
  • [filer] replace an invalid methods in a metric with an invalid one by @kmlebedev in #5378
• Mount
  • Moved noapplexattr under runtime.GOARCH == "amd64" to resolve the fin… by @Bia3 in #5351
• Shell
  • [shell] fs log purge by @kmlebedev in #5344
• S3 API
  • feat: add support for S3 ListObjects and ListObjectsV2 by @adasauce in #5350
• Volume
  • Add deleted bytes to total_disk_size by @SmsS4 in #5161
• Filer Backup
  • [filer.backup] add param uploader_part_size for S3sink by @kmlebedev in #5352
• Minor
  • remove repetitive words by @rustrover in #5364
  • Document default method used by compact by @SystemZ in #5379

New Contributors

• @Bia3 made their first contribution in #5351
• @adasauce made their first contribution in #5350
• @rustrover made their first contribution in #5364
• @SystemZ made their first contribution in #5379

Full Changelog: 3.63...3.64

3.63

What's Changed

• Filer

  • [filer] avoid return http ok for not allowed methods by @kmlebedev in #5209
  • chore: filer healthz handler check filer store by @kmlebedev in #5208
  • Update the solution when a file cannot be located. by @LuuucasChen in #5223
  • filer: reduce delete entry ErrNotFound logs by @sberthier in #5301
  • fix: http range request return status 500 by @sberthier in #5251

• Helm Chart

  • Fix(k8s-chart-helm): helm upgrade statefulset error by @sberthier in #5207
  • fix: publish helm chart at new release by @sberthier in #5265
  • fix helm install error for No such file or directory by @cuisongliu in #5250
  • helm enable resource for template by @cuisongliu in #5268
  • helm using external master address by @cuisongliu in #5267
  • k8s-chart-helm: unify extraEnvironmentVars by @sberthier in #5327

• Shell

  • weed/shell: Fix volume.balance logic by @BenoitKnecht in #5238
  • weed/shell: Cleanup volume balance logic by @BenoitKnecht in #5241
  • weed/shell: Cluster check other disk types by @BenoitKnecht in #5245
  • fix: fs verify error counter by @kmlebedev in #5261

• S3

  • fix: skip s3 .uploads by @bernardx in #5216
  • fix: s3tests test_get_object_ifnonematch_good by @kmlebedev in #5237
  • Adapt S3 POST ContentType by @sxlehua in #5275
  • Add s3 postpolicy support header by @sxlehua in #5280
  • Fix/s3 config secret by @spastorclovr in #5302
  • fix: only admin auth can delete S3 bucket by @7y-9 in #5312
  • refactor: put the auth outside by @7y-9 in #5313

• Volume Server

  • Enable multiple disks per volume server. Also streamline the use of /logs & /idx by @spastorclovr in #5236
  • [volume] requests that were canceled by the client are not an internal server problem(500 => 499) by @kmlebedev in #5304
  • weed/storage: Fix volume info file permissions by @BenoitKnecht in #5246
  • avoid unexpected compact size by @kmlebedev in #5272

• Master

  • fix: clean metric MasterReplicaPlacementMismatch for unregister volume by @kmlebedev in #5239

• Mount

  • Fix/bad mount path better default value by @spastorclovr in #5253
  • fix unaligned 64-bit atomic operation in weed mount on arm when readi… by @chrislusf in #5308

• Minor

  • chore: fix typos in scaffold help output by @andrewazores in #5211
  • Update README.md by @eltociear in #5282
  • Fix Broken Links by @justindhillon in #5287

New Contributors

• @andrewazores made their first contribution in #5211
• @LuuucasChen made their first contribution in #5223
• @spastorclovr made their first contribution in #5236
• @BenoitKnecht made their first contribution in #5238
• @cuisongliu made their first contribution in #5250
• @sxlehua made their first contribution in #5275
• @eltociear made their first contribution in #5282
• @justindhillon made their first contribution in #5287
• @7y-9 made their first contribution in #5312

Full Changelog: 3.62...3.63

3.62

What's Changed

• Filer
  • Removed problematic if statement by @jerebear12 in #5180
  • chore: add status code for request_total metrics by @kmlebedev in #5188
• Volume Server
  • fix write volume over size MaxPossibleVolumeSize by @kungf in #5190
  • can vacuum volume when size mismatch by @kungf in #5200
  • factor in existing ec volume count when estimating max volume count #5191
• Filer.sync
  • Fix filer sync set offset by @kmlebedev in #5197
  • Fix doDeleteFiles deletes files by @kmlebedev in #5198

New Contributors

• @kungf made their first contribution in #5190

Full Changelog: 3.61...3.62

3.61

What's Changed

• Filer

  • Fix v3.60 bug : panic: runtime error: invalid memory address or nil pointer dereference #5153

• WebDAV

  • fix: return etag with md5 in webdav responses by @kmlebedev in #5158
  • fix: webdav avoid create empty files by @kmlebedev in #5160
  • chore: add maxMB option for webdav by @kmlebedev in #5165

• S3 API

  • Fix missing VersionConfiguration node in get-bucket-versioning response by @kmlebedev in #5162

• Filer Sync

  • chore: filer sync add doDeleteFiles option for create only mode by @kmlebedev in #5166

Full Changelog: 3.60...3.61

3.60

What's Changed

• FUSE Mount

  • Waiting for writes to complete with acquired lock may lead to deadlock by @kvaster in https://github.com/seaweedfs/seaweedfs/pull/
  • Fix OOM from increasing RSS memory usage on long term #5082

• Weed Fix

  • Fix weed fix by @SmsS4 in #5020

• Filer

  • Set allowed origins in config by @jerebear12 in #5109
  • chore: add dsn for connection to mysql by @kmlebedev in #5060
  • [filerstore] mysql falls back to update only if error contains msg "duplicate entry" by @kmlebedev in #5085
  • Add a way to use a JWT sent in an HTTP only cookie by @jerebear12 in #5077
  • verify content-md5 in header by @julor in #5016

• S3

  • [s3api] add default response for GetBucketVersioning by @kmlebedev in #4998

• Helm Charts

  • fix: k8s-chart-helm master metrics scraping by @sberthier in #5142
  • Fix: helm: remove deprecated values that caused helm template error for post install hook by @jessebot in #5108
  • Update helm_ci.yml - add ct flag --target-branch ${{ github.event.repository.default_branch }} by @jessebot in #5106
  • #5122 Add support for sidecar containers by @Davidsod in #5125
  • Always include volumes in statefulsets by @dzsibi in #5081
  • Helm: add post install hook to support creating default buckets by @cloudymax in #5048
  • Use global.serviceAccountName to populate ServiceAccount, ClusterRole, and ClusterRoleBinding by @jessebot in #5049
  • support tls in master-ingress by @Programmeris in #4946
  • Helm chart: Allow existing S3 config secret for the filer statefulset and the s3 deployment by @jessebot in #5039
  • Enable support for Restic-based tools (K8up, Velero) to perform backup and restore operations by @cloudymax in #5034
  • Update helm_chart_release.yml - run helm chart release on push to master on changes to k8s/chart files by @jessebot in #5035
  • helm chart: fix annotations templating for s3.ingress.annotations and document it and s3.ingress.tls in values.yaml by @jessebot in #5023
  • [helm] fix: use metricsPort correctly by @niuqg in #5010

• Shell

  • shell meta load add concurrency by @kmlebedev in #4529
  • Add modifyTimeAgo to volume.fsck by @SmsS4 in #5133
  • Fix cutoffTimeAgo in findMissingChunksInFiler by @SmsS4 in #5132
  • fs.mergeVolumes: Make a plan based on volumes size by @yeganemehr in #4999
  • fs.mergeVolumes: change dir to a named parameter by @yeganemehr in #5003

• Filer Backup

  • filer backup add option for exclude file names that match regexp to sync on filer by @kmlebedev in #5002
  • fix: add doDeleteFile option for filer backup by @kmlebedev in #5018

• Filer Remote Sync

  • Using filer.remote.sync concurrency in filer.remote.gateway by @itsfarbod in #5123
  • Remote gateway Bug fix by @itsfarbod in #5100
  • Fix wrong option #5102

• Filer Copy

  • Add option to filer.copy with public volume server url #5126

• Minor

  • Minor cleanup & gitignore update by @varunu28 in #5144
  • weed/server: remove unneeded err from streamReadOneVolume() signature by @alrs in #5143
  • weed/storage: fix dropped test errors by @alrs in #5083
  • logging PickForWrite error by @kmlebedev in #4920
  • fix TestMisplacedChecking() and add test-case by @zehweh in #5040
  • weed/command: fix dropped error by @alrs in #5027
  • Fix shell 'help' for all commands by @yeganemehr in #5000

New Contributors

• @niuqg made their first contribution in #5010
• @jessebot made their first contribution in #5023
• @julor made their first contribution in #5016
• @cloudymax made their first contribution in #5034
• @dzsibi made their first contribution in #5081
• @itsfarbod made their first contribution in #5100
• @Davidsod made their first contribution in #5125
• @vivekkoya made their first contribution in #5134
• @sberthier made their first contribution in #5142
• @varunu28 made their first contribution in #5144

Full Changelog: 3.59...3.60

3.59

What's Changed

• Volume Server

  • Add ErrorGetNotFound and ErrorGetInternal to volume server metrics by @SmsS4 in #4960
  • Fix twice increase metric counter by @SmsS4 in #4961
  • Replace an invalid method in a metric with an invalid one by @kmlebedev in #4987

• Helm Charts

  • Add podLabels & podAnnotations to all pods by @tehasdf in #4959

• S3 API

  • Pass correct Filer's gRPC port to S3 server. by @tired-engineer in #4972
  • chore(tests): update S3 compat tests by @t3hmrman in #4992

• WebDAV

  • refactor webdav subdirectory, fixes #4967 by @Cottand in #4969
  • weed/server: fix dropped webdav error by @alrs in #4990

• Shell

  • fix isMisplaced() in command_volume_fix_replication.go by @zehweh in #4988
  • ec.decode: mount the collected ec shards by @cctags in #4995

New Contributors

• @tehasdf made their first contribution in #4959
• @tired-engineer made their first contribution in #4972
• @cctags made their first contribution in #4995

Full Changelog: 3.58...3.59

3.58

What's Changed

• Volume

  • fix: make dev_tls with volume https by @kmlebedev in #4866
  • weed/replication/sub: fix dropped error by @alrs in #4865
  • fix: avoid error file name too long when writing a file by @kmlebedev in #4876
  • Erasure Coding: volumes created by foreign collection due to bug in ec balance by @wzrdtales in #4864

• S3

  • [s3acl] Step1: move s3account.AccountManager into to iam.S3ApiConfiguration by @kmlebedev in #4859
  • remove compare to fix #4668 issue by @lakeland1990 in #4924
  • [s3] do reload s3 static config by @kmlebedev in #4923
  • fix copying .vif file in VolumeCopy by @zehweh in #4943

• Shell

  • fix: avoid deleting more than one replica by @kmlebedev in #4873
  • fix: avoid deleting one replica without sync by @kmlebedev in #4875
  • fix: logger place msg by @kmlebedev in #4880
  • fix: skipping checking active volumes with the same number of files at the moment by @kmlebedev in #4893
  • add fs.mergeVolumes command into shell by @yeganemehr in #4907
  • fix has changes false if deleted result size eq zero by @kmlebedev in #4909

• Helm Charts

  • Allow override internalTrafficPolicy by @aronneagu in #4877
  • add ingress for seaweedfs s3 by @Programmeris in #4887
  • Helm chart jwt signing configuration by @yuvalyacoby in #4894
  • Helm use external certificates by @yuvalyacoby in #4913
  • Remove hardcoded podManagmentPolicy value in a helm chart by @Programmeris in #4941

• Misc

  • weed/operation: fix dropped error by @alrs in #4888
  • Fix filer.backup local sink to propagate file mode changes by @werdnum in #4896
  • golang up version to 1.21.3 by @kmlebedev in #4911
  • Add optional flags to enable mTLS with verification of client certificate by @jameskhedley in #4910
  • add make benchmark with WARP by @kmlebedev in #4914
  • see_dat add print name by @binbinshi in #4930

• Filer

  • added healthz endpoint to filer by @yuvalyacoby in #4899

• Filer Store

  • Fix: Filer's tikv filestore's prefix query error #4950 by @duanhongyi in #4952

New Contributors

• @yuvalyacoby made their first contribution in #4894
• @jameskhedley made their first contribution in #4910
• @lakeland1990 made their first contribution in #4924
• @zehweh made their first contribution in #4943

Full Changelog: 3.57...3.58

3.57

What's Changed

• S3 API
  • Fix s3 api object list with params max-keys and prefix by @annluda in #4834
  • [s3] optimization iam lookup for reducing algorithm complexity by @kmlebedev in #4857
  • [s3acl] Step 0: Put bucket ACL only responds success if the ACL is private. by @kmlebedev in #4856
  • [iam] Replace action read/write to readAcp/writeAcp for handlers with acl by @kmlebedev in #4858
• FUSE Mount
  • Fix mount write proxy filer by @zemul in #4840
  • Ordered read write locks for each file handle
• Helm Charts
  • Wrong default value for volume.resource by @armandleopold in #4855
• Minor
  • avoid pass lock by value by @wusongANKANG in #4839
  • fix: weed/storage: dropped error by @alrs in #4841

New Contributors

• @annluda made their first contribution in #4834

Full Changelog: 3.56...3.57

3.56

What's Changed

• Volume Server

  • Fix resource leaks by @Zamony in #4737
  • Save disk space metrics immediately by @Zamony in #4740
  • weed/storage/erasure_coding: Error Handling Fixes by @alrs in #4819

• Master

  • Implement SRV lookups for filer by @Cottand in #4767
  • Add stream API to assign file id to reduce connection overhead.

• Helm Chart

  • fix: replace volume.pvc_exists with master.pvc_exists by @togettoyou in #4762
  • fix bugs: seaweedfs master ingress host configuration do not work by @gfhe in #4781
  • [helm] add possibility to use array for imagePullSecrets by @tikhon-opsfleet in #4782
  • [helm] fix log to stderr and default host for ingress by @Dimonyga in #4787
  • [heml] complete redesign of labels by @Dimonyga in #4788
  • k8s: allow configuring serviceAccountName by @aviau in #4790
  • helm: allow setting master.toml config by @aviau in #4797
  • [heml] fix default affinity and allow owerride ingress annotations by @Dimonyga in #4799
  • improve k8s probes templating in helm chart by @Programmeris in #4805

• S3 API

  • Improve S3 request signing performance by @Woellchen in #4148
  • Fix s3.clean.uploads by @SmsS4 in #4766
  • Add time to first byte metric for s3 by @SmsS4 in #4768
  • ErrInvalidPart when completed parts has extra parts. #4746

• Metrics

  • Add master servers to grafana dashboard by @ginn13 in #4801

• Java API

  • SeaweedOutputStream add option to pass in collection.

• Mount

  • add separate cache directory -cacheDirWrite for write buffers.

• Minor

  • minor by @wusongANKANG in #4723
  • Update weed fix description by @SmsS4 in #4745
  • weed/util: fix dropped errors by @alrs in #4803

New Contributors

• @Zamony made their first contribution in #4737
• @togettoyou made their first contribution in #4762
• @t3hmrman made their first contribution in #4769
• @dimm0 made their first contribution in #4736
• @gfhe made their first contribution in #4781
• @tikhon-opsfleet made their first contribution in #4782
• @Cottand made their first contribution in #4767
• @Dimonyga made their first contribution in #4787
• @aviau made their first contribution in #4790
• @alrs made their first contribution in #4803

Full Changelog: 3.55...3.56