make new s3 v3 provider default

[bentsku]

Motivation

This PR will make the new s3 v3 provider default for the new 3.0 release.

Changes

Make the new provider default, create a new legacy_v2 provider for S3 for us to advertise instead of v2 or asf which don't communicate well the fact that it's the previous implementation.

Remove checks for NATIVE_PROVIDER as it's now default, and invert the checks.

Add a warning if people are still using v2.

Updated the CI job to test legacy v2, we can keep until the release of 3.1 to ensure stability and visibility into moto changes.

Note: sorry for the changes once again in the tests conditions, I missed this change in the removal of the legacy code.

Contained PRs (30):

• regenerate S3 snapshots #8830 (test PR)
• introduce new S3 native provider #8786
• implement S3 native multiparts operations #8787
• add S3 CORS test with referer header and regenerate CORS snaphots #8776 (test PR)
• implement S3 native bucket versioning #8799
• add S3 native bucket encryption and AWS KMS managed key #8800
• implement S3 native notifications #8802
• implement S3 native tagging #8811
• implement S3 native CORS #8814
• implement S3 native Lifecycle + mocked Bucket APIs #8863
  • Bucket Lifecycle
  • AnalyticsConfiguration
  • IntelligentTieringConfiguration
  • InventoryConfiguration
• implement S3 native Website #8864
• implement S3 native object lock #8884
  • ObjectLockConfiguration
  • ObjectRetention
  • ObjectLegalHold
• implement S3 native RequestPayment, GetObject Part, Preconditions #8885
  • BucketRequestPayment
  • minor fixes after CI run
  • implement Precondition headers check
  • GetObject PartNumber
• implement S3 native PublicAccessBlock and ObjectOwnership #8886
• implement S3 native Bucket Policy and AccelerateConfig #8889
• implement S3 native BucketLogging and BucketReplication #8901
• implement S3 native ACL #8902
• implement S3 native pre-signed POST (PostObject) #8907
• implement S3 v3 pre-signed handler #8918
• improve S3 v3 storage layer #8927
• replace CircleCI job for S3 stream to v3 and remove stream provider #9043
• implement Content-MD5 check for PutObject #9064
• fix S3 v3 Range handling #9082
• fix S3 v3 HeadObject with checksum #9297
• fix s3 v3 multipart overwrite when key exists #9388
• fix s3 v3 EncodingType in List* operations #9429
• fix s3 v3 ListObjectsV2 and ListObjectVersions pagination #9430
• fix s3 v3 preconditions #9448
• re-introduce S3 virtual host rewriter for v3 #9450
• harden s3 v3 concurrency #9517

Incoming PRs:

• /

[github-actions]

LocalStack Community integration with Pro

       2 files  ±0         2 suites  ±0   1h 11m 46s ⏱️ +57s
2 325 tests ±0  1 790 ✔️ +43  535 💤  - 43  0 ❌ ±0 
2 326 runs  ±0  1 790 ✔️ +43  536 💤  - 43  0 ❌ ±0 

Results for commit b6a5649. ± Comparison against base commit 99278b3.

♻️ This comment has been updated with latest results.

[bentsku]

Update: around 60 tests are still failing on 23/09/10, mostly related to pre-signed URLs

[bentsku]

Update: only 1 or 2 tests are failing:

• test_delete_has_empty_content_length_header
• test_apigateway_rust_lambda

edit: this was due to some wrong logic in the storage layer, this should now be fixed 🎉

[coveralls]

coverage: 83.796% (-0.03%) from 83.827%
when pulling b6a5649 on new-s3-native-provider
into 99278b3 on release/v3.0.

[alexrashed]

Nice! Really great to see the native provider becoming the default! 🚀 🧹