feat: introduce richer input #1615

bassosimone · 2024-06-05T19:36:39Z

Most of the existing code is designed to move around lists of model.OOAPIURLInfo and measuring such URLs.

The model.OOAPIURLInfo type is like:

// internal/model/ooapi.go

type OOAPIURLInfo struct {
	CategoryCode string
	CountryCode string
	URL string
}

This design originally suited Web Connectivity but it's not good enough for richer input because it does not contain options.

With this diff, we move into the direction of richer input by replacing model.OOAPIURLInfo lists with lists of:

// internal/model/experiment.go

type ExperimentTarget struct {
	Category() string
	Country() string
	Input() string
}

where *model.OOAPIURLInfo implements model.ExperimentTarget in a trivial way and where, additionally:

the InputLoader is modified to load ExperimentTarget;
the Experiment is modify to measure an ExperimentTarget.

In addition to applying these changes, this diff also adapts the whole tree to use ExperimentTarget in all places and adds a trivial constructor to obtain OOAPIURLInfo when the category code and the country code are unknown.

With this diff merged, implementing richer input for real is a matter of implementing the following changes:

the *registry.Factory has a new func field, defined by each experiment, that loads a list of ExperimentTarget;
we have a library for input loading containing the same code that we currently use for the input loader;
the InputLoader is gone and instead we use the factory (or its *engine.experimentBuilder wrapper) for input loading;
we modify the ExperimentArgs passed to the ExperimentMeasurer to contain an additional field that is the ExperimentTarget we want to measure;
each experiment that needs richer input type-casts from the ExperimentTarget interface to the concrete type that the experiment richer input should have and accesses any option.

Part of #1612.

This implementation strategy emerged while discussing this matter with @ainghazal, thank you so much for that!

@ainghazal

Most of the existing code is designed to move around lists of `model.OOAPIURLInfo` and measuring such URLs. This design originally suited Web Connectivity but it's not good enough for richer input because it does not contain options. With this diff, we move into the direction of richer input by replacing `model.OOAPIURLInfo` lists with lists of: ```Go // internal/model/experiment.go type ExperimentTarget struct { Category() string Country() string Input() string } ``` where `*model.OOAPIURLInfo` implements `model.ExperimentTarget` in a trivial way and where, additionally: 1. the `InputLoader` is modified to load `ExperimentTarget`; 2. the `Experiment` is modify to measure an `ExperimentTarget`. In addition to applying these changes, this diff also adapts the whole tree to use `ExperimentTarget` in all places and adds a trivial constructor to obtain `OOAPIURLInfo` when the category code and the country code are unknown. With this diff merged, implementing richer input for real is a matter of implementing the following changes: 1. the `*registry.Factory` has a new func field, defined by each experiment, that loads a list of `ExperimentTarget`; 2. we have a library for input loading containing the same code that we currently use for the input loader; 3. the `InputLoader` is gone and instead we use the factory (or its `*engine.experimentBuilder` wrapper for input loading; 4. we modify the `ExperimentArgs` passed to the `ExperimentMeasurer` to contain an additional field that is the `ExperimentTarget` we want to measure; 5. each experiment that needs richer input type-casts from the `ExperimentTarget` interface to the concrete type that the experiment richer input should have and accesses any option. Part of #1612. This implementation strategy emerged while discussing this matter with @ainghazal, thank you so much for that!

bassosimone · 2024-06-05T21:09:54Z

internal/engine/experiment.go

@@ -204,7 +207,7 @@ func (e *experiment) MeasureWithContext(ctx context.Context, input string) (*mod
 	// by adding the test keys etc. Please, note that, as of 2024-06-05, we're using
 	// the measurement Input to provide input to an experiment. We'll probably
 	// change this, when we'll have finished implementing richer input.
-	measurement := e.newMeasurement(input)
+	measurement := e.newMeasurement(target.Input())


A follow-up diff will modify newMeasurement to also read the options from the target such that we can correctly field the top-level key named options of the measurement.

bassosimone · 2024-06-05T21:12:27Z

internal/engine/inputloader.go

 	for _, URL := range input {
 		if _, err := url.Parse(URL); err != nil {
 			return nil, err
 		}
-		output = append(output, model.OOAPIURLInfo{
-			CategoryCode: "MISC", // hard to find a category
-			CountryCode:  "XX",   // representing no country


Actually, ZZ represents no country. I don't know where I did take XX from.

Is this something that check-in may possibly return?! (I am not sure here!)

Yeah, it's what check-in would do: https://github.com/ooni/backend/blob/f7a93f477111c7278424996815b91e6300d66b83/api/ooniapi/prio.py#L182.

So, I guess we should revert back to using "ZZ", since it's what we'd get if check-in didn't know the country.

Fixed by 5830436

DecFox

The diff looks good to me. I left a bikeshedding remark.

internal/engine/inputloader.go

Co-authored-by: DecFox <33030671+DecFox@users.noreply.github.com>

Conflicts: internal/engine/inputloader.go

DecFox

LGTM!

This commit moves the engine.InputLoader type to a new package called inputloading and adapts the naming to avoid stuttering. The reason for moving InputLoader is that the engine package depends on registry, and, per the plan described by the first richer input PR, #1615, we want to move input loading directly inside the registry. To this end, we need to move the input loading feature outside of engine to avoid creating import loops. We keep an integration test inside the engine package because it seems such an integration test was checking both engine and the InputLoader together. We may further refactor this test in the future. Part of #1612

This commit moves the engine.InputLoader type to a new package called inputloading and adapts the naming to avoid stuttering. We therefore have engine.InputLoaderSession => targetloading.Session and other similar renames. The reason for moving InputLoader is that the engine package depends on registry, and, per the plan described by the first richer input PR, #1615, we want to move target loading directly inside the registry. To this end, we need to move the target loading feature outside of engine to avoid creating import loops, which prevent the code from compiling because Go does not support them. While there, name the package targetloading rather than inputloading since richer input is all about targets, where a target is defined by the (input, options) tuple. Also, try to consistently rename types to mention targets. We keep an integration test inside the engine package because it seems such an integration test was checking both engine and the Loader together. We may further refactor this test in the future. Part of #1612 --------- Co-authored-by: DecFox <33030671+DecFox@users.noreply.github.com>

bassosimone force-pushed the issue/2607d branch 3 times, most recently from f59d7fc to 5846dfe Compare June 5, 2024 19:55

bassosimone force-pushed the issue/2607d branch from 5846dfe to 8b308c8 Compare June 5, 2024 19:55

bassosimone added 2 commits June 5, 2024 22:56

x

30cd3db

x

3d622ac

bassosimone commented Jun 5, 2024

View reviewed changes

x

449913d

bassosimone marked this pull request as ready for review June 5, 2024 21:20

bassosimone requested review from hellais and DecFox as code owners June 5, 2024 21:20

x

5830436

DecFox requested changes Jun 6, 2024

View reviewed changes

internal/engine/inputloader.go Outdated Show resolved Hide resolved

bassosimone and others added 2 commits June 6, 2024 11:23

Update internal/engine/inputloader.go

3ef9769

Co-authored-by: DecFox <33030671+DecFox@users.noreply.github.com>

Merge branch 'master' into issue/2607d

8eb8e0d

Conflicts: internal/engine/inputloader.go

DecFox approved these changes Jun 6, 2024

View reviewed changes

bassosimone merged commit 7f53b45 into master Jun 6, 2024
17 checks passed

bassosimone deleted the issue/2607d branch June 6, 2024 09:43

bassosimone mentioned this pull request Jun 6, 2024

refactor: move engine.InputLoader to targetloading #1616

Merged

bassosimone added the 2024-06-richer-input Tracking 2024-06 richer input work label Jul 2, 2024

BrewTestBot mentioned this pull request Aug 8, 2024

ooniprobe 3.23.0 Homebrew/homebrew-core#180481

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

feat: introduce richer input #1615

feat: introduce richer input #1615

bassosimone commented Jun 5, 2024 •

edited

Loading

bassosimone Jun 5, 2024 •

edited

Loading

bassosimone Jun 5, 2024 •

edited

Loading

bassosimone Jun 6, 2024 •

edited

Loading

bassosimone Jun 6, 2024

DecFox left a comment

DecFox left a comment

feat: introduce richer input #1615

feat: introduce richer input #1615

Conversation

bassosimone commented Jun 5, 2024 • edited Loading

bassosimone Jun 5, 2024 • edited Loading

Choose a reason for hiding this comment

bassosimone Jun 5, 2024 • edited Loading

Choose a reason for hiding this comment

bassosimone Jun 6, 2024 • edited Loading

Choose a reason for hiding this comment

bassosimone Jun 6, 2024

Choose a reason for hiding this comment

DecFox left a comment

Choose a reason for hiding this comment

DecFox left a comment

Choose a reason for hiding this comment

bassosimone commented Jun 5, 2024 •

edited

Loading

bassosimone Jun 5, 2024 •

edited

Loading

bassosimone Jun 5, 2024 •

edited

Loading

bassosimone Jun 6, 2024 •

edited

Loading