From 65f3a88aa5de3535b93a23da05f2eeaa8bd28f95 Mon Sep 17 00:00:00 2001 From: Nandu <3322650+nairnandu@users.noreply.github.com> Date: Tue, 16 Apr 2024 18:26:38 -0400 Subject: [PATCH 01/11] Create selection-process.md --- 2025/selection-process.md | 76 +++++++++++++++++++++++++++++++++++++++ 1 file changed, 76 insertions(+) create mode 100644 2025/selection-process.md diff --git a/2025/selection-process.md b/2025/selection-process.md new file mode 100644 index 0000000..121678f --- /dev/null +++ b/2025/selection-process.md @@ -0,0 +1,76 @@ +### Interop 2025 proposal selection process + +Interop 2025 is an effort to increase interoperability across browsers in key technical areas that are of high priority to web developers and end users. This effort is part of the [web-platform-tests](https://github.com/web-platform-tests/wpt) (WPT) project — an automated test suite for web standards — and run by a team of representatives from companies that make substantial contributions to browser rendering engines (including Apple, Bocoup, Google, Igalia, Microsoft, and Mozilla). + +Please see the [Interop 2024 Dashboard](https://wpt.fyi/interop-2024) and [Interop 2024 README](https://github.com/web-platform-tests/interop/blob/main/2024/README.md) for the current iteration of the project. + +Each iteration of the project starts with an open call for proposals, followed by a selection and prioritization process by each participating organization. Final decision on the inclusion of a proposal is made by [consensus](https://github.com/web-platform-tests/interop/blob/main/charter.md#:~:text=The%20team%20makes%20decisions%20based%20on%20consensus.%20A%20decision%20has%20consensus%20if%20it%20has%20support%20from%20at%20least%20two%20participating%20organizations%20and%20no%20opposition). For Interop 2025, the timeline and the selection process is as described below. + + +### Timeline + +This is the general timeline for the Interop 2025 proposal selection process. The dates are centered on the Interop team meeting (Thursdays). Please note that the timelines are subject to change. + +* Proposal submission window (3 weeks): Sept 19th, 2024 to Oct 3rd, 2024 +* First round of feedback on proposals that do not meet the Interop project criteria (2 weeks): Oct 3rd, 2024 to Oct 17th, 2024 +* Proposal selection and prioritization: Oct - Dec 2024 +* Interop 2024 carryover evaluation and 2025 grouping: Dec 2024 - Jan 2025 +* Scope of the Interop 2025 project will be published, the first half of February, 2025. + + +### Proposal selection phases + + +#### Phase 1: Filtering (Oct 3rd to Oct 17th) + +Interop meeting dates: Oct 3rd, Oct 10th, Oct 17th +[Visibility] All decisions and results from this phase will be published on the Interop repo. + +In this stage, proposals that do not meet the criteria set by the Interop team will be filtered out. Feedback would be provided to the proposal authors to verify any additional data points that should be considered prior to exclusion. The Interop team will decide on the exclusion of proposals, based on consensus and proposal authors will be informed at the end of this phase. + +There are two steps to this phase: +1. Proposal refinement: Oct 4th, 2024 to Oct 10th, 2024 - feedback would be provided to proposal authors on the Interop repo. +2. First round of feedback on proposals that do not meet the Interop project criteria would be provided to proposal authors on the Interop repo. + + +#### Phase 2: Ranking (Oct 18th to Oct 31st) + +Interop meeting dates: Oct 24th, Oct 31st +[Visibility] All decisions, made in Interop team meetings during this phase, will be confidential. However, organizations can choose to publish their own rankings, outside of the Interop program. + +In this stage, the focus would be on organizations picking areas where there is internal alignment on the specific feature or area being important enough to work on from a user/web developer perspective. Each organization will have different rubrics for prioritization. However, where applicable, organizations can choose to have any data used for prioritization be shared publicly. + +3. Each organization will select proposals for the prioritization discussion by putting a High/Low priority signal against each proposal where they have internal alignment to do the work. A low priority signal would indicate a willingness to support the proposal, if other organizations also deem it to be important. Organizations can also express any objections at this point. +4. Any proposal that has at least 2 organizations expressing high priority and no objections, would be moved forward to the next phase of consensus building. Any organization that posts an objection would also outline the reasoning for it, to the Interop team. The ranking of proposals would be done asynchronously, ahead of the Interop meetings. + + +#### Phase 3: Prioritization (Nov 1st to Dec 5th) + +Interop meeting dates: Nov 7th, Nov 14th, Nov 21st, Dec 5th +[Visibility] All decisions made in this phase will be confidential. + +In this stage, each organization will further prioritize proposals for a specific year (Interop 2025). This is more involved and a complex process where each organization weighs engineering priorities and available resources. + +5. From the list of proposals that get through to Phase 3, each organization will have an opportunity to further prioritize internally and build consensus within the Interop Team based on available signals. +6. Organizations can also object to any proposal at this point. +7. Any proposal that has support from 2 organizations and does not have any objection, will be considered included in Interop 2025. At the end of this phase, the expectation is that the Interop team will have a first draft of proposals that are included in Interop 2025. + + +#### Phase 4: Carryovers and Grouping (Dec 6th to Dec 19th) + +Interop meeting dates: Dec 12th and Dec 19th +[Visibility] All decisions and results from this phase will be confidential. + +In this stage, the Interop team will evaluate progress made in Interop 2024 focus areas and create a first draft of areas that will be carried over to Interop 2025. In addition, the proposals from phase 3 will be weighed against any carryover focus areas from Interop 2024. The outcome from this phase is a second draft of prioritized proposals for Interop 2025 (this will include new proposals and carryover focus areas) with a high-level grouping. This stage will include the steps below: + +8. Interop 2024 carryover evaluation - this will be done live in the Interop team meeting. +9. Grouping of proposals, in conjunction with carryover areas - a draft will be created and worked on, asynchronously. Decisions would be made live in the Interop team meeting. +10. This phase will also include decisions on inclusion of investigation effort proposals, by consensus. + + +#### Phase 5: Final decisions (Jan 9th to Jan 30th) + +Interop meeting dates: Jan 9th, Jan 16th, Jan 23rd, Jan 30th +[Visibility] The final list of focus areas would be made public at launch + +In this stage, final decisions on prioritizations and grouping will be made. From 0f1bc468aaa094ff93b8e40111e22e5659dc6706 Mon Sep 17 00:00:00 2001 From: Nandu <3322650+nairnandu@users.noreply.github.com> Date: Tue, 16 Apr 2024 18:28:51 -0400 Subject: [PATCH 02/11] Update selection-process.md --- 2025/selection-process.md | 16 ++++++++-------- 1 file changed, 8 insertions(+), 8 deletions(-) diff --git a/2025/selection-process.md b/2025/selection-process.md index 121678f..836ace4 100644 --- a/2025/selection-process.md +++ b/2025/selection-process.md @@ -1,4 +1,4 @@ -### Interop 2025 proposal selection process +# Interop 2025 proposal selection process Interop 2025 is an effort to increase interoperability across browsers in key technical areas that are of high priority to web developers and end users. This effort is part of the [web-platform-tests](https://github.com/web-platform-tests/wpt) (WPT) project — an automated test suite for web standards — and run by a team of representatives from companies that make substantial contributions to browser rendering engines (including Apple, Bocoup, Google, Igalia, Microsoft, and Mozilla). @@ -7,7 +7,7 @@ Please see the [Interop 2024 Dashboard](https://wpt.fyi/interop-2024) and [Inter Each iteration of the project starts with an open call for proposals, followed by a selection and prioritization process by each participating organization. Final decision on the inclusion of a proposal is made by [consensus](https://github.com/web-platform-tests/interop/blob/main/charter.md#:~:text=The%20team%20makes%20decisions%20based%20on%20consensus.%20A%20decision%20has%20consensus%20if%20it%20has%20support%20from%20at%20least%20two%20participating%20organizations%20and%20no%20opposition). For Interop 2025, the timeline and the selection process is as described below. -### Timeline +## Timeline This is the general timeline for the Interop 2025 proposal selection process. The dates are centered on the Interop team meeting (Thursdays). Please note that the timelines are subject to change. @@ -18,10 +18,10 @@ This is the general timeline for the Interop 2025 proposal selection process. Th * Scope of the Interop 2025 project will be published, the first half of February, 2025. -### Proposal selection phases +## Proposal selection phases -#### Phase 1: Filtering (Oct 3rd to Oct 17th) +### Phase 1: Filtering (Oct 3rd to Oct 17th) Interop meeting dates: Oct 3rd, Oct 10th, Oct 17th [Visibility] All decisions and results from this phase will be published on the Interop repo. @@ -33,7 +33,7 @@ There are two steps to this phase: 2. First round of feedback on proposals that do not meet the Interop project criteria would be provided to proposal authors on the Interop repo. -#### Phase 2: Ranking (Oct 18th to Oct 31st) +### Phase 2: Ranking (Oct 18th to Oct 31st) Interop meeting dates: Oct 24th, Oct 31st [Visibility] All decisions, made in Interop team meetings during this phase, will be confidential. However, organizations can choose to publish their own rankings, outside of the Interop program. @@ -44,7 +44,7 @@ In this stage, the focus would be on organizations picking areas where there is 4. Any proposal that has at least 2 organizations expressing high priority and no objections, would be moved forward to the next phase of consensus building. Any organization that posts an objection would also outline the reasoning for it, to the Interop team. The ranking of proposals would be done asynchronously, ahead of the Interop meetings. -#### Phase 3: Prioritization (Nov 1st to Dec 5th) +### Phase 3: Prioritization (Nov 1st to Dec 5th) Interop meeting dates: Nov 7th, Nov 14th, Nov 21st, Dec 5th [Visibility] All decisions made in this phase will be confidential. @@ -56,7 +56,7 @@ In this stage, each organization will further prioritize proposals for a specifi 7. Any proposal that has support from 2 organizations and does not have any objection, will be considered included in Interop 2025. At the end of this phase, the expectation is that the Interop team will have a first draft of proposals that are included in Interop 2025. -#### Phase 4: Carryovers and Grouping (Dec 6th to Dec 19th) +### Phase 4: Carryovers and Grouping (Dec 6th to Dec 19th) Interop meeting dates: Dec 12th and Dec 19th [Visibility] All decisions and results from this phase will be confidential. @@ -68,7 +68,7 @@ In this stage, the Interop team will evaluate progress made in Interop 2024 focu 10. This phase will also include decisions on inclusion of investigation effort proposals, by consensus. -#### Phase 5: Final decisions (Jan 9th to Jan 30th) +### Phase 5: Final decisions (Jan 9th to Jan 30th) Interop meeting dates: Jan 9th, Jan 16th, Jan 23rd, Jan 30th [Visibility] The final list of focus areas would be made public at launch From 8e65fae219c7564175015e35b3158a5ff4105455 Mon Sep 17 00:00:00 2001 From: Nandu <3322650+nairnandu@users.noreply.github.com> Date: Tue, 16 Apr 2024 18:30:35 -0400 Subject: [PATCH 03/11] Update selection-process.md --- 2025/selection-process.md | 5 +++++ 1 file changed, 5 insertions(+) diff --git a/2025/selection-process.md b/2025/selection-process.md index 836ace4..5ea7663 100644 --- a/2025/selection-process.md +++ b/2025/selection-process.md @@ -24,6 +24,7 @@ This is the general timeline for the Interop 2025 proposal selection process. Th ### Phase 1: Filtering (Oct 3rd to Oct 17th) Interop meeting dates: Oct 3rd, Oct 10th, Oct 17th + [Visibility] All decisions and results from this phase will be published on the Interop repo. In this stage, proposals that do not meet the criteria set by the Interop team will be filtered out. Feedback would be provided to the proposal authors to verify any additional data points that should be considered prior to exclusion. The Interop team will decide on the exclusion of proposals, based on consensus and proposal authors will be informed at the end of this phase. @@ -36,6 +37,7 @@ There are two steps to this phase: ### Phase 2: Ranking (Oct 18th to Oct 31st) Interop meeting dates: Oct 24th, Oct 31st + [Visibility] All decisions, made in Interop team meetings during this phase, will be confidential. However, organizations can choose to publish their own rankings, outside of the Interop program. In this stage, the focus would be on organizations picking areas where there is internal alignment on the specific feature or area being important enough to work on from a user/web developer perspective. Each organization will have different rubrics for prioritization. However, where applicable, organizations can choose to have any data used for prioritization be shared publicly. @@ -47,6 +49,7 @@ In this stage, the focus would be on organizations picking areas where there is ### Phase 3: Prioritization (Nov 1st to Dec 5th) Interop meeting dates: Nov 7th, Nov 14th, Nov 21st, Dec 5th + [Visibility] All decisions made in this phase will be confidential. In this stage, each organization will further prioritize proposals for a specific year (Interop 2025). This is more involved and a complex process where each organization weighs engineering priorities and available resources. @@ -59,6 +62,7 @@ In this stage, each organization will further prioritize proposals for a specifi ### Phase 4: Carryovers and Grouping (Dec 6th to Dec 19th) Interop meeting dates: Dec 12th and Dec 19th + [Visibility] All decisions and results from this phase will be confidential. In this stage, the Interop team will evaluate progress made in Interop 2024 focus areas and create a first draft of areas that will be carried over to Interop 2025. In addition, the proposals from phase 3 will be weighed against any carryover focus areas from Interop 2024. The outcome from this phase is a second draft of prioritized proposals for Interop 2025 (this will include new proposals and carryover focus areas) with a high-level grouping. This stage will include the steps below: @@ -71,6 +75,7 @@ In this stage, the Interop team will evaluate progress made in Interop 2024 focu ### Phase 5: Final decisions (Jan 9th to Jan 30th) Interop meeting dates: Jan 9th, Jan 16th, Jan 23rd, Jan 30th + [Visibility] The final list of focus areas would be made public at launch In this stage, final decisions on prioritizations and grouping will be made. From 84fbede5f6571c394dd1575bf92ed2101b1ca16f Mon Sep 17 00:00:00 2001 From: Nandu <3322650+nairnandu@users.noreply.github.com> Date: Wed, 17 Apr 2024 12:39:13 -0400 Subject: [PATCH 04/11] Update selection-process.md --- 2025/selection-process.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/2025/selection-process.md b/2025/selection-process.md index 5ea7663..e52f046 100644 --- a/2025/selection-process.md +++ b/2025/selection-process.md @@ -56,7 +56,7 @@ In this stage, each organization will further prioritize proposals for a specifi 5. From the list of proposals that get through to Phase 3, each organization will have an opportunity to further prioritize internally and build consensus within the Interop Team based on available signals. 6. Organizations can also object to any proposal at this point. -7. Any proposal that has support from 2 organizations and does not have any objection, will be considered included in Interop 2025. At the end of this phase, the expectation is that the Interop team will have a first draft of proposals that are included in Interop 2025. +7. Any proposal that has support from 2 organizations and does not have an objection, will be considered included in Interop 2025. At the end of this phase, the expectation is that the Interop team will have a first draft of proposals that are included in Interop 2025. ### Phase 4: Carryovers and Grouping (Dec 6th to Dec 19th) From 1712a1af3093de8a1c0fb336dd351f7c3df80686 Mon Sep 17 00:00:00 2001 From: Nandu <3322650+nairnandu@users.noreply.github.com> Date: Thu, 2 May 2024 09:45:54 -0400 Subject: [PATCH 05/11] Update selection-process.md --- 2025/selection-process.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/2025/selection-process.md b/2025/selection-process.md index e52f046..4cbe116 100644 --- a/2025/selection-process.md +++ b/2025/selection-process.md @@ -25,7 +25,7 @@ This is the general timeline for the Interop 2025 proposal selection process. Th Interop meeting dates: Oct 3rd, Oct 10th, Oct 17th -[Visibility] All decisions and results from this phase will be published on the Interop repo. +[Visibility] Outcomes from this phase will be published on the Interop repo. In this stage, proposals that do not meet the criteria set by the Interop team will be filtered out. Feedback would be provided to the proposal authors to verify any additional data points that should be considered prior to exclusion. The Interop team will decide on the exclusion of proposals, based on consensus and proposal authors will be informed at the end of this phase. @@ -38,7 +38,7 @@ There are two steps to this phase: Interop meeting dates: Oct 24th, Oct 31st -[Visibility] All decisions, made in Interop team meetings during this phase, will be confidential. However, organizations can choose to publish their own rankings, outside of the Interop program. +[Visibility] All decisions, made in Interop team meetings during this phase, will be confidential. However, organizations can choose to publish their own priorities, for the Interop proposals, outside of the Interop program. In this stage, the focus would be on organizations picking areas where there is internal alignment on the specific feature or area being important enough to work on from a user/web developer perspective. Each organization will have different rubrics for prioritization. However, where applicable, organizations can choose to have any data used for prioritization be shared publicly. From 1741ff1b1c5c3c78b02a8a2da3284336b1e576aa Mon Sep 17 00:00:00 2001 From: James Graham Date: Thu, 13 Jun 2024 10:36:50 +0100 Subject: [PATCH 06/11] Update Interop 2025 Process proposal Replace with a version of the proposal in https://github.com/web-platform-tests/interop/pull/657#issuecomment-2114865553 aimed at iteratively building consensus. --- 2025/selection-process.md | 186 +++++++++++++++++++++++++++++--------- 1 file changed, 144 insertions(+), 42 deletions(-) diff --git a/2025/selection-process.md b/2025/selection-process.md index 4cbe116..74066f0 100644 --- a/2025/selection-process.md +++ b/2025/selection-process.md @@ -1,81 +1,183 @@ # Interop 2025 proposal selection process -Interop 2025 is an effort to increase interoperability across browsers in key technical areas that are of high priority to web developers and end users. This effort is part of the [web-platform-tests](https://github.com/web-platform-tests/wpt) (WPT) project — an automated test suite for web standards — and run by a team of representatives from companies that make substantial contributions to browser rendering engines (including Apple, Bocoup, Google, Igalia, Microsoft, and Mozilla). - -Please see the [Interop 2024 Dashboard](https://wpt.fyi/interop-2024) and [Interop 2024 README](https://github.com/web-platform-tests/interop/blob/main/2024/README.md) for the current iteration of the project. - -Each iteration of the project starts with an open call for proposals, followed by a selection and prioritization process by each participating organization. Final decision on the inclusion of a proposal is made by [consensus](https://github.com/web-platform-tests/interop/blob/main/charter.md#:~:text=The%20team%20makes%20decisions%20based%20on%20consensus.%20A%20decision%20has%20consensus%20if%20it%20has%20support%20from%20at%20least%20two%20participating%20organizations%20and%20no%20opposition). For Interop 2025, the timeline and the selection process is as described below. - +Interop 2025 is an effort to increase interoperability across browsers +in key technical areas that are of high priority to web developers and +end users. This effort is part of the +[web-platform-tests](https://github.com/web-platform-tests/wpt) (WPT) +project — an automated test suite for web standards — and run by a +team of representatives from companies that make substantial +contributions to browser rendering engines (including Apple, Bocoup, +Google, Igalia, Microsoft, and Mozilla). + +Please see the [Interop 2024 Dashboard](https://wpt.fyi/interop-2024) +and [Interop 2024 +README](https://github.com/web-platform-tests/interop/blob/main/2024/README.md) +for the current iteration of the project. + +Each iteration of the project starts with an open call for proposals, +followed by a selection and prioritization process by each +participating organization. Final decision on the inclusion of a +proposal is made by +[consensus](https://github.com/web-platform-tests/interop/blob/main/charter.md#:~:text=The%20team%20makes%20decisions%20based%20on%20consensus.%20A%20decision%20has%20consensus%20if%20it%20has%20support%20from%20at%20least%20two%20participating%20organizations%20and%20no%20opposition). For +Interop 2025, the timeline and the selection process is as described +below. ## Timeline This is the general timeline for the Interop 2025 proposal selection process. The dates are centered on the Interop team meeting (Thursdays). Please note that the timelines are subject to change. * Proposal submission window (3 weeks): Sept 19th, 2024 to Oct 3rd, 2024 -* First round of feedback on proposals that do not meet the Interop project criteria (2 weeks): Oct 3rd, 2024 to Oct 17th, 2024 -* Proposal selection and prioritization: Oct - Dec 2024 -* Interop 2024 carryover evaluation and 2025 grouping: Dec 2024 - Jan 2025 -* Scope of the Interop 2025 project will be published, the first half of February, 2025. +* Proposal selection: Before December 19th 2024 +* Scope of the Interop 2025 project published: the first half of February, 2025. + +## Proposal selection process + +The aim of the proposal selection process is to generate a shared +understanding of the merits of each proposal, and converge on a +decision about the most impactful areas in which we can improve +interop on the web over 2025. + + +### Prior to Proposal Submission + +**Timeline**: Before September 19th 2024 + +The interop team will develop a non-exhaustive set of signals/criteria +that are considered important when assessing proposals. These will be +made available to proposal authors, and used later in the process when +championing and assessing different proposals. However they are not +binding on any specific participant i.e. participants are free to +consider additional criteria (such as individual resource constraints) +and weigh the shared criteria as they choose. + +### Proposal Submission + +**Timeline**: Before September 19th to October 3rd + +Members of the web community, including participants, will be invited +to submit proposals for Interop 2025. These will take the form of +issues on the Interop GitHub repository. Issue templates and +documentation will be provided to guide proposers towards proposals +that meet the formal criteria (e.g. around testability) and which can +be assessed according to the agreed criteria. + +Items from Interop 2024 which have not yet reached full +interoperability will be automatically resubmitted, and will go +through the process as for any other proposal. In addition new +proposals can be submitted that extend the scope of existing focus +areas (whether or not they have reached full interoperability). + +As in previous years proposals can either be for focus areas or +investigations. For simplicity the remainder of this document will +only refer to focus area proposals, but this also covers proposals for +investigation efforts. + +### Champion Selection + +**Timeline**: October 3rd, 10th, 17th + +Interop participants propose focus areas, consisting of one or more +proposals, that they would like to champion. Proposals will initially +be shared in time for the meeting on October 10th, and champions +finalised on October 17th. + +Where more than one participant wants to champion the same focus area +proposal a single champion must be nominated for the remainder of the +process. +Champions and seconds (i.e. organizations that would champion a focus +area but were not the final selected champion) are recorded for each +proposal. -## Proposal selection phases +There is no assigned limit to the number of proposals one participant +may champion. +_Alternative_: Each participant is expected to champion a minimum of +three proposals. -### Phase 1: Filtering (Oct 3rd to Oct 17th) +In case different focus areas are put forward with overlapping sets of +proposals, the participants are encouraged to work out a way to divide +the proposals into focus areas in a way that satisfies everyone. If +this is impossible then carrying forward multiple competing focus area +proposals is permitted, but final selections will only allow each +proposal to appear in a single focus area. -Interop meeting dates: Oct 3rd, Oct 10th, Oct 17th +Any proposal without a champion will not be carried forward. -[Visibility] Outcomes from this phase will be published on the Interop repo. +### Focus Area Proposal Refinement -In this stage, proposals that do not meet the criteria set by the Interop team will be filtered out. Feedback would be provided to the proposal authors to verify any additional data points that should be considered prior to exclusion. The Interop team will decide on the exclusion of proposals, based on consensus and proposal authors will be informed at the end of this phase. +**Timeline**: October 24th and 31st -There are two steps to this phase: -1. Proposal refinement: Oct 4th, 2024 to Oct 10th, 2024 - feedback would be provided to proposal authors on the Interop repo. -2. First round of feedback on proposals that do not meet the Interop project criteria would be provided to proposal authors on the Interop repo. +Champions gather evidence of the impact of their proposals, using the +rubric developed earlier. Specific participants may also be asked +to provide (publicly available) information for all proposals where +that participant has ownership of the information (e.g. standards +positions, use counter data). +### Focus Area Proposal Presentation -### Phase 2: Ranking (Oct 18th to Oct 31st) +**Timeline**: November 7th and 14th -Interop meeting dates: Oct 24th, Oct 31st +Each participant gets 15 minutes of meeting time to present the +proposals they are championing, and make the case that they should be +considered a priority for inclusion in Interop 2025. -[Visibility] All decisions, made in Interop team meetings during this phase, will be confidential. However, organizations can choose to publish their own priorities, for the Interop proposals, outside of the Interop program. +_Alternative_: Have a longer meeting on either November 7th or November +14th so that all the proposals are presented in the same week. -In this stage, the focus would be on organizations picking areas where there is internal alignment on the specific feature or area being important enough to work on from a user/web developer perspective. Each organization will have different rubrics for prioritization. However, where applicable, organizations can choose to have any data used for prioritization be shared publicly. +### Focus Area Proposal Ranking -3. Each organization will select proposals for the prioritization discussion by putting a High/Low priority signal against each proposal where they have internal alignment to do the work. A low priority signal would indicate a willingness to support the proposal, if other organizations also deem it to be important. Organizations can also express any objections at this point. -4. Any proposal that has at least 2 organizations expressing high priority and no objections, would be moved forward to the next phase of consensus building. Any organization that posts an objection would also outline the reasoning for it, to the Interop team. The ranking of proposals would be done asynchronously, ahead of the Interop meetings. +**Timeline**: Before December 5th +Participants rank each proposal as P1 (highest priority) to P3 (lowest +priority), or veto. -### Phase 3: Prioritization (Nov 1st to Dec 5th) +There is no preset limit on how many proposals each participant may +assign each rank. -Interop meeting dates: Nov 7th, Nov 14th, Nov 21st, Dec 5th +Initial rankings are submitted in time for the December 5th meeting. -[Visibility] All decisions made in this phase will be confidential. +### Focus Area Ranking and Selection -In this stage, each organization will further prioritize proposals for a specific year (Interop 2025). This is more involved and a complex process where each organization weighs engineering priorities and available resources. +**Timeline**: December 5th, 12th, 19th -5. From the list of proposals that get through to Phase 3, each organization will have an opportunity to further prioritize internally and build consensus within the Interop Team based on available signals. -6. Organizations can also object to any proposal at this point. -7. Any proposal that has support from 2 organizations and does not have an objection, will be considered included in Interop 2025. At the end of this phase, the expectation is that the Interop team will have a first draft of proposals that are included in Interop 2025. +Focus areas with any vetoes are eliminated. +Proposals that have strong positive consensus (majority P1 rankings, +no P3 rankings) are immediately adopted. Proposals with a strong +negative consensus (majority P3 rankings, no P1 ranking, or P1 only +from the champion) are immediately dropped. -### Phase 4: Carryovers and Grouping (Dec 6th to Dec 19th) +Proposals with mixed rankings are ordered according to the number of +P1 rankings, followed by the number of P2 rankings, followed by the +number of P3 rankings. Starting from the top of the ordered list +participants who ranked the proposal lower are given an opportunity to +explain their concerns, and suggest any adjustments that would change +their perspective. Proposal champions get final say on whether to +adjust their proposals in response to this feedback. -Interop meeting dates: Dec 12th and Dec 19th +Following each meeting participants may adjust their rankings for the +remaining proposals up or down in response to discussions, any agreed +changes to the proposals, or the overall composition of the project, +and the process repeats in the following meeting. -[Visibility] All decisions and results from this phase will be confidential. +Before the end of the December 19th meeting there's a formal call for +consensus on the set of selected focus areas. -In this stage, the Interop team will evaluate progress made in Interop 2024 focus areas and create a first draft of areas that will be carried over to Interop 2025. In addition, the proposals from phase 3 will be weighed against any carryover focus areas from Interop 2024. The outcome from this phase is a second draft of prioritized proposals for Interop 2025 (this will include new proposals and carryover focus areas) with a high-level grouping. This stage will include the steps below: +_Alternative_: We share a fixed set of rankings and attempt to reach +consensus based on an ordered list without formal adjustment. -8. Interop 2024 carryover evaluation - this will be done live in the Interop team meeting. -9. Grouping of proposals, in conjunction with carryover areas - a draft will be created and worked on, asynchronously. Decisions would be made live in the Interop team meeting. -10. This phase will also include decisions on inclusion of investigation effort proposals, by consensus. +### Communication and Publication +**Timeline**: Jan 9th, Jan 16th, Jan 23rd, Jan 30th -### Phase 5: Final decisions (Jan 9th to Jan 30th) +Launch date is finalized. Focus area tests are labeled. Feedback for +proposal authors written. -Interop meeting dates: Jan 9th, Jan 16th, Jan 23rd, Jan 30th +### Launch -[Visibility] The final list of focus areas would be made public at launch +**Timeline**: February 6th 2025 (provisional) -In this stage, final decisions on prioritizations and grouping will be made. +The Interop 2025 dashboard is published. Proposal authors are provided +with feedback and the original GitHub issues are closed. Participants +publish announcements of the launch. From 5a223b8eb796ab9f34cdf8713614a0e6c228ed9e Mon Sep 17 00:00:00 2001 From: jgraham Date: Thu, 27 Jun 2024 14:16:09 +0100 Subject: [PATCH 07/11] Calrify no changes to working mode --- 2025/selection-process.md | 3 +++ 1 file changed, 3 insertions(+) diff --git a/2025/selection-process.md b/2025/selection-process.md index 74066f0..aad50aa 100644 --- a/2025/selection-process.md +++ b/2025/selection-process.md @@ -37,6 +37,9 @@ understanding of the merits of each proposal, and converge on a decision about the most impactful areas in which we can improve interop on the web over 2025. +As in previous years, details of proposal selection and ranking remain +participant confidential throughout the process. Final decisions will +be published as the Interop team. ### Prior to Proposal Submission From 764a6e2be97f4a3fced4e21a2c289eaec1f19888 Mon Sep 17 00:00:00 2001 From: jgraham Date: Thu, 27 Jun 2024 14:32:15 +0100 Subject: [PATCH 08/11] Fix some review comments and remove alternatives --- 2025/selection-process.md | 32 +++++++++++++------------------- 1 file changed, 13 insertions(+), 19 deletions(-) diff --git a/2025/selection-process.md b/2025/selection-process.md index aad50aa..98532f9 100644 --- a/2025/selection-process.md +++ b/2025/selection-process.md @@ -24,7 +24,9 @@ below. ## Timeline -This is the general timeline for the Interop 2025 proposal selection process. The dates are centered on the Interop team meeting (Thursdays). Please note that the timelines are subject to change. +This is the general timeline for the Interop 2025 proposal selection +process. The dates are centered on the Interop team meeting (Thursdays). +Please note that the timelines are subject to change. * Proposal submission window (3 weeks): Sept 19th, 2024 to Oct 3rd, 2024 * Proposal selection: Before December 19th 2024 @@ -37,9 +39,9 @@ understanding of the merits of each proposal, and converge on a decision about the most impactful areas in which we can improve interop on the web over 2025. -As in previous years, details of proposal selection and ranking remain -participant confidential throughout the process. Final decisions will -be published as the Interop team. +As in Interop 2023 and 2024, details of proposal selection and ranking +remain participant confidential throughout the process. Final decisions +will be published as the Interop team. ### Prior to Proposal Submission @@ -95,9 +97,6 @@ proposal. There is no assigned limit to the number of proposals one participant may champion. -_Alternative_: Each participant is expected to champion a minimum of -three proposals. - In case different focus areas are put forward with overlapping sets of proposals, the participants are encouraged to work out a way to divide the proposals into focus areas in a way that satisfies everyone. If @@ -119,15 +118,12 @@ positions, use counter data). ### Focus Area Proposal Presentation -**Timeline**: November 7th and 14th +**Timeline**: November 7th (double-length meeting) Each participant gets 15 minutes of meeting time to present the proposals they are championing, and make the case that they should be considered a priority for inclusion in Interop 2025. -_Alternative_: Have a longer meeting on either November 7th or November -14th so that all the proposals are presented in the same week. - ### Focus Area Proposal Ranking **Timeline**: Before December 5th @@ -146,10 +142,10 @@ Initial rankings are submitted in time for the December 5th meeting. Focus areas with any vetoes are eliminated. -Proposals that have strong positive consensus (majority P1 rankings, -no P3 rankings) are immediately adopted. Proposals with a strong -negative consensus (majority P3 rankings, no P1 ranking, or P1 only -from the champion) are immediately dropped. +Proposals that have strong positive consensus (e.g. majority P1 +rankings, no P3 rankings) are adopted. Proposals with a strong +consensus of low priority (e.g. many P3 ranking and no P1 +ranking, or many P3 and P1 only from the champion) are dropped. Proposals with mixed rankings are ordered according to the number of P1 rankings, followed by the number of P2 rankings, followed by the @@ -164,12 +160,10 @@ remaining proposals up or down in response to discussions, any agreed changes to the proposals, or the overall composition of the project, and the process repeats in the following meeting. -Before the end of the December 19th meeting there's a formal call for +Before the end of the December 19th meeting there's a final decision +on any proposals whithout a clear resolution formal call for consensus on the set of selected focus areas. -_Alternative_: We share a fixed set of rankings and attempt to reach -consensus based on an ordered list without formal adjustment. - ### Communication and Publication **Timeline**: Jan 9th, Jan 16th, Jan 23rd, Jan 30th From 68990ba806d6414326152349ae197dd45abb7b92 Mon Sep 17 00:00:00 2001 From: jgraham Date: Thu, 27 Jun 2024 18:00:53 +0100 Subject: [PATCH 09/11] Update 2025/selection-process.md --- 2025/selection-process.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/2025/selection-process.md b/2025/selection-process.md index 98532f9..71fbd47 100644 --- a/2025/selection-process.md +++ b/2025/selection-process.md @@ -161,7 +161,7 @@ changes to the proposals, or the overall composition of the project, and the process repeats in the following meeting. Before the end of the December 19th meeting there's a final decision -on any proposals whithout a clear resolution formal call for +on any proposals without a clear resolution, and formal call for consensus on the set of selected focus areas. ### Communication and Publication From f6b1e99208a46ba27331154fc2a4afb35c0c103f Mon Sep 17 00:00:00 2001 From: Daniel Clark Date: Tue, 9 Jul 2024 16:34:43 -0700 Subject: [PATCH 10/11] Clarify that confidentiality does not limit sharing roadmaps. Add that orgs can share their championed proposals. --- 2025/selection-process.md | 5 +++++ 1 file changed, 5 insertions(+) diff --git a/2025/selection-process.md b/2025/selection-process.md index 71fbd47..565d171 100644 --- a/2025/selection-process.md +++ b/2025/selection-process.md @@ -43,6 +43,11 @@ As in Interop 2023 and 2024, details of proposal selection and ranking remain participant confidential throughout the process. Final decisions will be published as the Interop team. +Participating organizations are free to publish the list of proposals +that they choose to champion and their reasoning for choosing them. +Confidentiality also does not prevent participating organizations from +sharing their own priorities or roadmaps outside of the Interop program. + ### Prior to Proposal Submission **Timeline**: Before September 19th 2024 From 38b6b6e49715425a19eb1ed102d18d5e4964601a Mon Sep 17 00:00:00 2001 From: Daniel Clark Date: Thu, 11 Jul 2024 11:12:22 -0700 Subject: [PATCH 11/11] Revert sentence on orgs sharing championed proposals --- 2025/selection-process.md | 4 +--- 1 file changed, 1 insertion(+), 3 deletions(-) diff --git a/2025/selection-process.md b/2025/selection-process.md index 565d171..ada6064 100644 --- a/2025/selection-process.md +++ b/2025/selection-process.md @@ -43,9 +43,7 @@ As in Interop 2023 and 2024, details of proposal selection and ranking remain participant confidential throughout the process. Final decisions will be published as the Interop team. -Participating organizations are free to publish the list of proposals -that they choose to champion and their reasoning for choosing them. -Confidentiality also does not prevent participating organizations from +Confidentiality does not prevent participating organizations from sharing their own priorities or roadmaps outside of the Interop program. ### Prior to Proposal Submission