/synapse

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Already on GitHub? Sign in to your account

fed server: process PDUs for different rooms in parallel #2520

Merged
merged 2 commits into from Oct 10, 2017

Conversation

Reviewers

@erikjohnston erikjohnston

Assignees

@erikjohnston erikjohnston

Labels
None yet
Projects
None yet
Milestone
No milestone
2 participants
@richvdh @erikjohnston
@richvdh
Member

richvdh commented Oct 9, 2017 • edited

With luck, this will give a real-time improvement when there are many rooms
and the server ends up calling out to fetch missing events.

(includes #2518)

richvdh added some commits Oct 6, 2017

@richvdh
Fed server: use a linearizer for ongoing transactions 
We don't want to process the same transaction multiple times concurrently, so
use a linearizer.

Some checks were not successful

1 failing and 5 successful checks
@matrixbot
Sytest Dendron (Merged PR) — Build finished.
Details
@matrixbot
Sytest Postgres (Merged PR) — Build finished.
Details
@matrixbot
Sytest SQLite (Commit) — Build #3664 origin/rav/linearize_incoming_transactions succeeded in 1 min 45 sec
Details
@matrixbot
Sytest SQLite (Merged PR) — Build finished.
Details
continuous-integration/travis-ci/pr — The Travis CI build passed
Details
continuous-integration/travis-ci/push — The Travis CI build passed
Details
4c7c4d4
@richvdh
fed server: process PDUs for different rooms in parallel 
With luck, this will give a real-time improvement when there are many rooms and
the server ends up calling out to fetch missing events.

Some checks were not successful

1 errored, 1 failing, and 6 successful checks
@matrixbot
Sytest Dendron (Commit) — Build #2735 origin/rav/process_incoming_rooms_in_parallel failed in 2 min 15 sec
Details
@matrixbot
Sytest Dendron (Merged PR) — Build finished.
Details
@matrixbot
Sytest Postgres (Commit) — Build #3568 origin/rav/process_incoming_rooms_in_parallel succeeded in 4 min 7 sec
Details
@matrixbot
Sytest Postgres (Merged PR) — Build finished.
Details
@matrixbot
Sytest SQLite (Commit) — Build #3665 origin/rav/process_incoming_rooms_in_parallel succeeded in 1 min 44 sec
Details
@matrixbot
Sytest SQLite (Merged PR) — Build finished.
Details
continuous-integration/travis-ci/pr — The Travis CI build passed
Details
continuous-integration/travis-ci/push — The Travis CI build passed
Details
6a6cc27

@richvdh richvdh assigned erikjohnston Oct 9, 2017

@richvdh richvdh merged commit 79bea15 into develop Oct 10, 2017
6 of 8 checks passed

6 of 8 checks passed

Sytest Dendron (Commit) Build #2735 origin/rav/process_incoming_rooms_in_parallel failed in 2 min 15 sec
Details
Sytest Dendron (Merged PR) Build finished.
Details
Sytest Postgres (Commit) Build #3568 origin/rav/process_incoming_rooms_in_parallel succeeded in 4 min 7 sec
Details
Sytest Postgres (Merged PR) Build finished.
Details
Sytest SQLite (Commit) Build #3665 origin/rav/process_incoming_rooms_in_parallel succeeded in 1 min 44 sec
Details
Sytest SQLite (Merged PR) Build finished.
Details
continuous-integration/travis-ci/pr The Travis CI build passed
Details
continuous-integration/travis-ci/push The Travis CI build passed
Details

@richvdh richvdh deleted the rav/process_incoming_rooms_in_parallel branch Oct 10, 2017

@richvdh richvdh referenced this pull request Oct 10, 2017

Closed

Ralith's HS took 30 mins to process a single fed txn with 27 PDUs #1776

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment