3.36

I am started to work on https://github.com/seaweedfs/seaweed-up , which can help to create a SeaweedFS cluster quickly. Hackers are welcome to participate!

What's Changed

• Volume Server
  • Include meta in ReadAllNeedles by @jameshartig in #3991
  • Include name/mime in ReadAllNeedles by @jameshartig in #4005
• Filer
  • fix: Lost Content-Encoding metadata by @famosss in #4010
  • Return ETag from remote when file doesn't exist on Filer by @aronneagu in #4025
• Metrics
  • [metrics] Add the ability to control bind ip by @JiffsMaverick in #4012
• S3
  • avoid recursive deleting newly created empty directories by @kmlebedev in #4016
• Shell
  • volume.list show volumes only from the specified dc/rack/dn by @kmlebedev in #4024

New Contributors

• @JiffsMaverick made their first contribution in #4012

Full Changelog: 3.35...3.36

3.35

What's Changed

• Filer Store
  • filer store: skip disabled location specific filer store initialization #3971
• Filer UI
  • file name escape uri #3969
• filer.remote.sync
  • Replace dashes with underscores in x-amz-meta headers by @aronneagu in #3965
• Volume Server
  • Lazy loading by @guol-fnst in #3958
• S3
  • feat:add a uuid after uploadid by @famosss in #3963
  • fix 'NoSuchUpload' when upload part by @shichanglin5 in #3968

New Contributors

• @aronneagu made their first contribution in #3965

Full Changelog: 3.34...3.35

3.34

What's Changed

• Shell
  • [volume.fsck] check needles status from volume server by @kmlebedev in #3926
  • [volume.fsck] param volumeId is comma separated the volume id by @kmlebedev in #3933
  • [volume.fsck] collect ids without cut off time for finding missing data from volumes by @kmlebedev in #3934
  • [filer.backup] add retention_duration by @zemul in #3941
• S3
  • Bug fix: empty key in DeleteMultipleObjects request caused bucket delete by @pavelzhurov in #3939
• filer.remote.sync
  • fix sync to azure with metadata and ContentType by @kmlebedev in #3949

New Contributors

• @pavelzhurov made their first contribution in #3939
• @645775992 made their first contribution in #3947

Full Changelog: 3.33...3.34

3.33

This release fixed a long time bug: when creating new replicated volumes, sometimes one of the replica creation fails because of disk space, failed disk, or limited file handles, etc. Previously the other successfully created volume replicas are not purged. But these volumes are not in use since they are under replicated. So a lot of empty volumes are created quickly. This release purges these partially replicated volumes.

What's Changed

• Master
  • Remove extra volume if creating one of the replicated volumes failed.
  • avoid vacuum if not enough replica copies by @kmlebedev in #3924
• Volume Server
  • add Content-MD5 header when UploadData to replication in ReplicatedWrite by @paochiang in #3881
  • ReadNeedleMeta recovery panic occurred by @kmlebedev in #3883
  • ensure monotonic n.AppendAtNs in each place by @kmlebedev in #3880
• Other
  • Corrected the dashboard to use the new series name. by @egguy in #3887
  • fix volume statefulset helm chart's tolerations by @theRealWardo in #3911
• S3
  • Fix err info for ErrMalformedDate by @guol-fnst in #3893
  • fix: set user metadata key to lowercase by @famosss in #3894
  • fix: isTruncated returns problematic by @famosss in #3907
• Shell
  • avoid fix missing of deleted needles by @kmlebedev in #3909
  • [voluche.chek.disk] needles older than the cutoff time are not missing yet by @kmlebedev in #3922
  • [volume.chek.disk] sync of deletions the fix by @kmlebedev in #3923
• weed fix
  • add param for ignore error by @kmlebedev in #3918

New Contributors

• @egguy made their first contribution in #3887
• @theRealWardo made their first contribution in #3911

Full Changelog: 3.32...v3.33

3.32

What's Changed

• Volume Server
  • revert disabling FSync for non Mac by @kmlebedev in #3814
  • Optimize leveldb metric by @guol-fnst in #3830
  • Set the default value of "hasSlowRead" to true by @famosss in #3710 This value will be default and this option will be removed.
  • avoid load volume file with BytesOffset mismatch by @kmlebedev in #3841
  • ensure monotonic n.AppendAtNs #3852
• Java
  • fix bug : read error when position after 2147483647 by @livehl in #3829
• Filer
  • Get directory metadata by @zemul in #3833
• Filer Store
  • Redis stores reduce from 2 redis operations to 1 for updates.
  • Sqlite serialize sqlite operations #3827
• Master
  • Fix interruption through ctrl+c by @kmlebedev in #3834
  • vacuum metrics and force sync dst files by @kmlebedev in #3832
• Cloud Tier
  • add retry when copying data file #3828
• Shell
  • volume.move handles volume moved to cloud tier #3803
  • volume.tier.upload clean up replicated copies #3804
  • volume.fsck by volume by @kmlebedev in #3851
  • volume.fsck hotfix apply purging and add option verifyNeedle #3860 by @kmlebedev in #3861
• filer.sync
  • fix invalid memory address or nil pointer dereference #3826
• Code Improvements:
  • avoid data race of LogBuffer isStopping by @kmlebedev in #3859
  • avoid data race of TraverseBfs by @kmlebedev in #3856

New Contributors

• @livehl made their first contribution in #3829
• @zemul made their first contribution in #3833

Full Changelog: 3.31...3.32

3.31

What's Changed

• filer.sync
  • limit concurrency when fetching file chunks #3787
• S3
  • avoid increasing the coordinates of metric labels by @kmlebedev in #3785
• Shell
  • show raft leader via shell by @kmlebedev in #3796
• Master
  • master server graceful stop by @kmlebedev in #3797
  • configure raft metrics by @kmlebedev in #3798
  • metric shows who is currently blocking the cluster or not by @kmlebedev in #3799
• Volume Server
  • Parallelize volume loading from different dirs during startup. by @kvaster in #3802
  • fix bug with snowflake id geneartion: compact_map get error mismatching cookie by @binbinshi in #3748
• FUSE mount
  • Fix mount -t weed with extra options by @BakerBunker in #3807
• Mount
  • Remove mount directory from generating cache directory id #3811

New Contributors

• @kvaster made their first contribution in #3802
• @BakerBunker made their first contribution in #3807

Full Changelog: 3.30...3.31

3.30

What's Changed

• Shell
  • fs.meta.load can selectively load any dirs by @kmlebedev in #3747
  • volume.fsck fix panics #3746. by @lyang24 in #3763
• Filer
  • Allow CORS on Filer by @jerebear12 in #3750
• Server
  • Adjust set master options for single server by @kmlebedev in #3708
• Volume server
  • Add new volumes to HUP(reload) signal by @kmlebedev in #3755
• Java
  • client-java: handle server HTTP errors by @kvtb in #3762
  • client-java: provide Content-MD5 when uploading chunks by @kvtb in #3761
• filer.sync
  • fix delete key panic of remote sync dir by @kmlebedev in #3770

New Contributors

• @jerebear12 made their first contribution in #3750
• @kvtb made their first contribution in #3762

Full Changelog: 3.29...3.30

3.29

• Mount
  • Fix the problem that files uploaded via s3 or Java http clients show 0 size. #3660
• filer.sync
  • filer replication: compare content changes directly #3714

3.28

• Master
  • Skip delta heart beat if data node is empty #3630
  • Implement gRPC VolumeMarkWritable #3657
• Filer
  • Clean up failed data chunks with replicated writes #3591
• S3
  • Fix nil pointer with localFilerSocket #3654
  • IsTruncated returned by the ListMultipartUploads method should be set to false #3682
  • File size is 0 for s3 multipart uploaded file #3683
• Mount
  • Build on mac should be fixed now!
• Volume Server
  • Add experimental option hasSlowRead
  • Add experimental option readBufferSizeMB

3.27 (weed shell has a bug with volume.balance command)

• Shell
  • volume.fsck fix orphan entries while filer.copy running #2578
  • Add option in volume.fix.replication to only fix under-replication and not delete volumes #3640
  • volume.balance handle edge cases where max=1
  • volume.balance change default value to balance all collections instead of each collection.
• Volume Server
  • Use smaller lock scope to avoid slow download causing upload requests to wait
  • fix: volume Deadlock when exception is thrown #3613
• Master Server
  • fix: volume heartbeat processing error #3616
• Data Racing fixes
  • avoid data race on calc freeVolumeSlotCount #3594
  • avoid data race on currentDiskUsage.maxVolumeCount #3592
• Mount
  • fix new inode allocation #3633
  • Write operation locks are ordered.
• Filer Store
  • arangodb s3 bucket name compatibility #3588
• filer.remote.sync
  • Clean up AWS tags to sync with Cloudflare R2 #3636