Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Queue Splitting Feature #2173

Merged
merged 96 commits into from
Aug 16, 2024
Merged

Queue Splitting Feature #2173

merged 96 commits into from
Aug 16, 2024

Commits on May 6, 2024

  1. Splitter CRD 

    Add new features enum and field for operator

The old enum cannot be extended as it would break old clients.
So we define a new extensible enum and a new field for it.
We make all of those fields private so that users of that struct
only access them via a getter that handles objects deserialized
from either old or new versions.

use copy target when splitting
    @t4lz
    t4lz committed May 6, 2024
    Configuration menu
    Copy the full SHA
    73e6789 View commit details
    Browse the repository at this point in the history

Commits on May 7, 2024

  1. working env

    @t4lz
    t4lz committed May 7, 2024
    Configuration menu
    Copy the full SHA
    b3fcadd View commit details
    Browse the repository at this point in the history

Commits on May 14, 2024

  1. deletecollection for sqs sessions

    @t4lz
    t4lz committed May 14, 2024
    Configuration menu
    Copy the full SHA
    df32b32 View commit details
    Browse the repository at this point in the history

Commits on May 15, 2024

  1. change SqsMessageFilter to BTreeMap for iterating.

    @t4lz
    t4lz committed May 15, 2024
    Configuration menu
    Copy the full SHA
    d07bc08 View commit details
    Browse the repository at this point in the history

  2. change queue_names to BTreeMap for iterating

    @t4lz
    t4lz committed May 15, 2024
    Configuration menu
    Copy the full SHA
    cb91e2d View commit details
    Browse the repository at this point in the history

  3. change config_map_updates to BTreeMap for iterating

    @t4lz
    t4lz committed May 15, 2024
    Configuration menu
    Copy the full SHA
    4147d22 View commit details
    Browse the repository at this point in the history

  4. change queue_names to BTreeMap for iterating

    @t4lz
    t4lz committed May 15, 2024
    Configuration menu
    Copy the full SHA
    d17d15a View commit details
    Browse the repository at this point in the history

  5. change queues to BTreeMap for iterating

    @t4lz
    t4lz committed May 15, 2024
    Configuration menu
    Copy the full SHA
    186867a View commit details
    Browse the repository at this point in the history

Commits on May 21, 2024

  1. get output queue names from splitter status

    @t4lz
    t4lz committed May 21, 2024
    Configuration menu
    Copy the full SHA
    0cc6d96 View commit details
    Browse the repository at this point in the history

  2. splitter status

    @t4lz
    t4lz committed May 21, 2024
    Configuration menu
    Copy the full SHA
    fdc7ced View commit details
    Browse the repository at this point in the history

Commits on May 22, 2024

  1. todo

    @t4lz
    t4lz committed May 22, 2024
    Configuration menu
    Copy the full SHA
    2578ddd View commit details
    Browse the repository at this point in the history

  2. set -> vec

    @t4lz
    t4lz committed May 22, 2024
    Configuration menu
    Copy the full SHA
    37795f5 View commit details
    Browse the repository at this point in the history

Commits on May 25, 2024

  1. tags

    @t4lz
    t4lz committed May 25, 2024
    Configuration menu
    Copy the full SHA
    b1524f7 View commit details
    Browse the repository at this point in the history

Commits on May 27, 2024

  1. docs

    @t4lz
    t4lz committed May 27, 2024
    Configuration menu
    Copy the full SHA
    ba17e1c View commit details
    Browse the repository at this point in the history

Commits on May 31, 2024

  1. remove active_sessions from splitter status

    @t4lz
    t4lz committed May 31, 2024
    Configuration menu
    Copy the full SHA
    0a52ca5 View commit details
    Browse the repository at this point in the history

  2. MirrordQueueSplitter -> MirrordWorkloadQueueRegistry, splitters. -> q… 

    …ueues.
    @t4lz
    t4lz committed May 31, 2024
    Configuration menu
    Copy the full SHA
    d213e4f View commit details
    Browse the repository at this point in the history

Commits on Jun 4, 2024

  1. Merge branch 'main' into sqs

    @t4lz
    t4lz committed Jun 4, 2024
    Configuration menu
    Copy the full SHA
    fffd267 View commit details
    Browse the repository at this point in the history

  2. merge fix

    @t4lz
    t4lz committed Jun 4, 2024
    Configuration menu
    Copy the full SHA
    44fd364 View commit details
    Browse the repository at this point in the history

Commits on Jun 12, 2024

  1. Merge branch 'main' into sqs

    @t4lz
    t4lz committed Jun 12, 2024
    Configuration menu
    Copy the full SHA
    80ee8ff View commit details
    Browse the repository at this point in the history

  2. lock

    @t4lz
    t4lz committed Jun 12, 2024
    Configuration menu
    Copy the full SHA
    da74d6d View commit details
    Browse the repository at this point in the history

Commits on Jun 20, 2024

  1. Merge branch 'main' into sqs

    @t4lz
    t4lz committed Jun 20, 2024
    Configuration menu
    Copy the full SHA
    ca997c9 View commit details
    Browse the repository at this point in the history

  2. mergefix

    @t4lz
    t4lz committed Jun 20, 2024
    Configuration menu
    Copy the full SHA
    ab38356 View commit details
    Browse the repository at this point in the history

Commits on Jun 24, 2024

  1. remove pod spec from session status

    @t4lz
    t4lz committed Jun 24, 2024
    Configuration menu
    Copy the full SHA
    b58bb85 View commit details
    Browse the repository at this point in the history

Commits on Jun 25, 2024

  1. remove podspec from registry crd status

    @t4lz
    t4lz committed Jun 25, 2024
    Configuration menu
    Copy the full SHA
    c2d412f View commit details
    Browse the repository at this point in the history

Commits on Jun 26, 2024

  1. save only updates instead of containers

    @t4lz
    t4lz committed Jun 26, 2024
    Configuration menu
    Copy the full SHA
    dff91db View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into sqs

    @t4lz
    t4lz committed Jun 26, 2024
    Configuration menu
    Copy the full SHA
    ddbab39 View commit details
    Browse the repository at this point in the history

  3. docs

    @t4lz
    t4lz committed Jun 26, 2024
    Configuration menu
    Copy the full SHA
    951acc7 View commit details
    Browse the repository at this point in the history

  4. changelog

    @t4lz
    t4lz committed Jun 26, 2024
    Configuration menu
    Copy the full SHA
    6ad3a66 View commit details
    Browse the repository at this point in the history

  5. remove tests (moved to sqs-tests branch)

    @t4lz
    t4lz committed Jun 26, 2024
    Configuration menu
    Copy the full SHA
    4a0a682 View commit details
    Browse the repository at this point in the history

  6. docs and improvements

    @t4lz
    t4lz committed Jun 26, 2024
    Configuration menu
    Copy the full SHA
    192a749 View commit details
    Browse the repository at this point in the history

  7. cargo fmt

    @t4lz
    t4lz committed Jun 26, 2024
    Configuration menu
    Copy the full SHA
    86f532a View commit details
    Browse the repository at this point in the history

  8. mirrord-schema.json

    @t4lz
    t4lz committed Jun 26, 2024
    Configuration menu
    Copy the full SHA
    8e3f08d View commit details
    Browse the repository at this point in the history

Commits on Jun 27, 2024

  1. Merge branch 'main' into sqs

    @t4lz
    t4lz committed Jun 27, 2024
    Configuration menu
    Copy the full SHA
    01a5b7a View commit details
    Browse the repository at this point in the history

  2. run medschool

    @t4lz
    t4lz committed Jun 27, 2024
    Configuration menu
    Copy the full SHA
    cfd608e View commit details
    Browse the repository at this point in the history

Commits on Jul 4, 2024

  1. Merge branch 'main' into sqs

    @t4lz
    t4lz committed Jul 4, 2024
    Configuration menu
    Copy the full SHA
    8fd8e62 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into sqs

    @t4lz
    t4lz committed Jul 4, 2024
    Configuration menu
    Copy the full SHA
    4c420e9 View commit details
    Browse the repository at this point in the history

  3. fmt

    @t4lz
    t4lz committed Jul 4, 2024
    Configuration menu
    Copy the full SHA
    cdd691c View commit details
    Browse the repository at this point in the history

Commits on Jul 9, 2024

  1. oops

    @t4lz
    t4lz committed Jul 9, 2024
    Configuration menu
    Copy the full SHA
    c8884c9 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into sqs

    @t4lz
    t4lz committed Jul 9, 2024
    Configuration menu
    Copy the full SHA
    24efd56 View commit details
    Browse the repository at this point in the history

Commits on Jul 11, 2024

  1. merge

    @t4lz
    t4lz committed Jul 11, 2024
    Configuration menu
    Copy the full SHA
    ed3d13f View commit details
    Browse the repository at this point in the history

Commits on Jul 14, 2024

  1. Merge branch 'main' into sqs

    @t4lz
    t4lz committed Jul 14, 2024
    Configuration menu
    Copy the full SHA
    03caf46 View commit details
    Browse the repository at this point in the history

Commits on Jul 15, 2024

  1. display Q consumer

    @t4lz
    t4lz committed Jul 15, 2024
    Configuration menu
    Copy the full SHA
    20ff89d View commit details
    Browse the repository at this point in the history

  2. fix merge

    @t4lz
    t4lz committed Jul 15, 2024
    Configuration menu
    Copy the full SHA
    88f87cb View commit details
    Browse the repository at this point in the history

  3. fix feature use

    @t4lz
    t4lz committed Jul 15, 2024
    Configuration menu
    Copy the full SHA
    84c05e4 View commit details
    Browse the repository at this point in the history

Commits on Jul 18, 2024

  1. rename sqs details and make optional

    @t4lz
    t4lz committed Jul 18, 2024
    Configuration menu
    Copy the full SHA
    4ea2282 View commit details
    Browse the repository at this point in the history

  2. rename QueueDetails -> ActiveSqsSplits

    @t4lz
    t4lz committed Jul 18, 2024
    Configuration menu
    Copy the full SHA
    4f003e5 View commit details
    Browse the repository at this point in the history

  3. move output_q_names to ActiveSqsSplits

    @t4lz
    t4lz committed Jul 18, 2024
    Configuration menu
    Copy the full SHA
    770e225 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'main' into sqs

    @t4lz
    t4lz committed Jul 18, 2024
    Configuration menu
    Copy the full SHA
    17afeea View commit details
    Browse the repository at this point in the history

  5. fmt

    @t4lz
    t4lz committed Jul 18, 2024
    Configuration menu
    Copy the full SHA
    ce09b3a View commit details
    Browse the repository at this point in the history

Commits on Jul 26, 2024

  1. CR: lambda var name

    @t4lz
    t4lz committed Jul 26, 2024
    Configuration menu
    Copy the full SHA
    8eaeebd View commit details
    Browse the repository at this point in the history

  2. move method call to own .map call

    @t4lz
    t4lz committed Jul 26, 2024
    Configuration menu
    Copy the full SHA
    b621750 View commit details
    Browse the repository at this point in the history

  3. CR: remove match arm for future variants.

    @t4lz
    t4lz committed Jul 26, 2024
    Configuration menu
    Copy the full SHA
    e88bfc2 View commit details
    Browse the repository at this point in the history

  4. CR: document SqsMessageFilter

    @t4lz
    t4lz committed Jul 26, 2024
    Configuration menu
    Copy the full SHA
    7551467 View commit details
    Browse the repository at this point in the history

  5. CR: remove get_target_type

    @t4lz
    t4lz committed Jul 26, 2024
    Configuration menu
    Copy the full SHA
    e4ac7d4 View commit details
    Browse the repository at this point in the history

Commits on Jul 30, 2024

  1. CR: Operator feature variant names.

    @t4lz
    t4lz committed Jul 30, 2024
    Configuration menu
    Copy the full SHA
    f642417 View commit details
    Browse the repository at this point in the history

  2. CR: unused type

    @t4lz
    t4lz committed Jul 30, 2024
    Configuration menu
    Copy the full SHA
    53a2188 View commit details
    Browse the repository at this point in the history

Commits on Jul 31, 2024

  1. CR: docs: "pod spec" -> "pod template" 

    Co-authored-by: Michał Smolarek <34063647+Razz4780@users.noreply.github.com>
    @t4lz @Razz4780
    t4lz and Razz4780 committed Jul 31, 2024
    Configuration menu
    Copy the full SHA
    9a56c85 View commit details
    Browse the repository at this point in the history

Commits on Aug 2, 2024

  1. CR: remove dead configmaps code

    @t4lz
    t4lz committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    87a7af1 View commit details
    Browse the repository at this point in the history

Commits on Aug 5, 2024

  1. CR: make session status enum

    @t4lz
    t4lz committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    643bf23 View commit details
    Browse the repository at this point in the history

  2. CR: remove non_exauhstive

    @t4lz
    t4lz committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    cc33089 View commit details
    Browse the repository at this point in the history

Commits on Aug 6, 2024

  1. status enum stuff

    @t4lz
    t4lz committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    ec5809e View commit details
    Browse the repository at this point in the history

  2. CR: sqs session error - code + reason

    @t4lz
    t4lz committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    05a4e2b View commit details
    Browse the repository at this point in the history

  3. just need to push a commit

    @t4lz
    t4lz committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    a0118d1 View commit details
    Browse the repository at this point in the history

  4. pub sqs details

    @t4lz
    t4lz committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    b9378d5 View commit details
    Browse the repository at this point in the history

  5. pub sqs details

    @t4lz
    t4lz committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    23d4e06 View commit details
    Browse the repository at this point in the history

  6. impl Display for SqsSessionError

    @t4lz
    t4lz committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    d2f7cde View commit details
    Browse the repository at this point in the history

Commits on Aug 7, 2024

  1. schema

    @t4lz
    t4lz committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    abe7f07 View commit details
    Browse the repository at this point in the history

  2. CR: add container to queue consumer

    @t4lz
    t4lz committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    82d1254 View commit details
    Browse the repository at this point in the history

  3. QueueConsumer registry matching

    @t4lz
    t4lz committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    3e6bbe9 View commit details
    Browse the repository at this point in the history

  4. QueueConsumer container getter

    @t4lz
    t4lz committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    254a47f View commit details
    Browse the repository at this point in the history

  5. Add RegisteringFilters Status variant

    @t4lz
    t4lz committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    11d388a View commit details
    Browse the repository at this point in the history

  6. get_split_details

    @t4lz
    t4lz committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    ce5c5e7 View commit details
    Browse the repository at this point in the history

  7. CR: registry docs

    @t4lz
    t4lz committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    0ec5115 View commit details
    Browse the repository at this point in the history

  8. CR: doc text formatting suggestion 

    Co-authored-by: Michał Smolarek <34063647+Razz4780@users.noreply.github.com>
    @t4lz @Razz4780
    t4lz and Razz4780 committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    ad9b009 View commit details
    Browse the repository at this point in the history

  9. CR: individual tags per queue

    @t4lz
    t4lz committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    56606f5 View commit details
    Browse the repository at this point in the history

  10. missing pub

    @t4lz
    t4lz committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    a86fc3e View commit details
    Browse the repository at this point in the history

  11. mark unstable

    @t4lz
    t4lz committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    aae011f View commit details
    Browse the repository at this point in the history

  12. CR: CopyTargetCrd, send queues config

    @t4lz
    t4lz committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    8dcccfa View commit details
    Browse the repository at this point in the history

  13. non non exauhstive

    @t4lz
    t4lz committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    571b5a2 View commit details
    Browse the repository at this point in the history

  14. CR: CopyTargetCrd, send queues config

    @t4lz
    t4lz committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    a92e633 View commit details
    Browse the repository at this point in the history

Commits on Aug 8, 2024

  1. Added unknown variant to QueueFilter

    @t4lz
    t4lz committed Aug 8, 2024
    Configuration menu
    Copy the full SHA
    5c36e00 View commit details
    Browse the repository at this point in the history

  2. CR: info log on implicit copy-target

    @t4lz
    t4lz committed Aug 8, 2024
    Configuration menu
    Copy the full SHA
    fca1a87 View commit details
    Browse the repository at this point in the history

Commits on Aug 9, 2024

  1. Change QueueConsumer to have a valid k8s schema

    @t4lz
    t4lz committed Aug 9, 2024
    Configuration menu
    Copy the full SHA
    4f2e53d View commit details
    Browse the repository at this point in the history

  2. CRD fixes: skip unknown variants in schema, change CleanupError statu… 

    …s for k8s
    @t4lz
    t4lz committed Aug 9, 2024
    Configuration menu
    Copy the full SHA
    e6e281d View commit details
    Browse the repository at this point in the history

  3. starting status has to have items

    @t4lz
    t4lz committed Aug 9, 2024
    Configuration menu
    Copy the full SHA
    78526f5 View commit details
    Browse the repository at this point in the history

Commits on Aug 10, 2024

  1. docs

    @t4lz
    t4lz committed Aug 10, 2024
    Configuration menu
    Copy the full SHA
    208ae7d View commit details
    Browse the repository at this point in the history

Commits on Aug 11, 2024

  1. change start time to str because I remember k8s actually can't deal w… 

    …ith unsigned integer of 64 bits and more
    @t4lz
    t4lz committed Aug 11, 2024
    Configuration menu
    Copy the full SHA
    d682427 View commit details
    Browse the repository at this point in the history

Commits on Aug 12, 2024

  1. rule to patch pods

    @t4lz
    t4lz committed Aug 12, 2024
    Configuration menu
    Copy the full SHA
    e2d2219 View commit details
    Browse the repository at this point in the history

  2. api group of pods is empty string

    @t4lz
    t4lz committed Aug 12, 2024
    Configuration menu
    Copy the full SHA
    0095c85 View commit details
    Browse the repository at this point in the history

  3. Can't patch pod container env :(

    @t4lz
    t4lz committed Aug 12, 2024
    Configuration menu
    Copy the full SHA
    24cae8a View commit details
    Browse the repository at this point in the history

Commits on Aug 14, 2024

  1. Merge branch 'main' into sqs

    @t4lz
    t4lz committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    3691c01 View commit details
    Browse the repository at this point in the history

Commits on Aug 15, 2024

  1. Merge branch 'main' into sqs

    @t4lz
    t4lz committed Aug 15, 2024
    Configuration menu
    Copy the full SHA
    ed5a76a View commit details
    Browse the repository at this point in the history

Commits on Aug 16, 2024

  1. CR: out of place serde tag 

    Co-authored-by: Michał Smolarek <34063647+Razz4780@users.noreply.github.com>
    @t4lz @Razz4780
    t4lz and Razz4780 committed Aug 16, 2024
    Configuration menu
    Copy the full SHA
    7b7f4dd View commit details
    Browse the repository at this point in the history

  2. Support installing an SQS-enabled operator via `mirrord operator setu… 

    …p` command
    @t4lz
    t4lz committed Aug 16, 2024
    Configuration menu
    Copy the full SHA
    08f5b26 View commit details
    Browse the repository at this point in the history

  3. incomplete flag docs

    @t4lz
    t4lz committed Aug 16, 2024
    Configuration menu
    Copy the full SHA
    0448780 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'main' into sqs

    @t4lz
    t4lz committed Aug 16, 2024
    Configuration menu
    Copy the full SHA
    2e43cdc View commit details
    Browse the repository at this point in the history