Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Store DNS additional answer in OONI data #2373

Closed
Te-k opened this issue Dec 2, 2022 · 3 comments
Closed

Store DNS additional answer in OONI data #2373

Te-k opened this issue Dec 2, 2022 · 3 comments
Assignees
Labels
enhancement improving existing code or new feature fixed-by-webconnectivity-lte The next version of webconnectivity fixes this issue methodology issues related to the testing methodology ooni/probe-engine priority/medium user feedback requests that have been added to the backlog as a direct result of user feedback or testing

Comments

@Te-k
Copy link

Te-k commented Dec 2, 2022

Hi,

One ISP in France is providing some interesting additional data when censoring a website in DNS additional data :

dig libgen.rs

; <<>> DiG 9.18.8-1-Debian <<>> libgen.rs
;; global options: +cmd
;; Got answer:
;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 48155
;; flags: qr rd ra; QUERY: 1, ANSWER: 1, AUTHORITY: 0, ADDITIONAL: 2

;; OPT PSEUDOSECTION:
; EDNS: version: 0, flags:; udp: 1232
; COOKIE: 86fd76bbf9cd28da0100000063832b9cd9165dee9adce850 (good)
;; QUESTION SECTION:
;libgen.rs.			IN	A

;; ANSWER SECTION:
libgen.rs.		5	IN	A	127.0.0.1

;; ADDITIONAL SECTION:
justice-autre.		1	IN	SOA	ns1.orange.fr. postmaster.wanadoo.com. 2022112521 216000 3600 3600000 172800

The additional section is a part of the DNS answer message that contains a DNS entry having the same format as the answer section.
Have you seen that in other countries? If yes, I think it would be a useful addition to the data gathered by the OONI probe and could be stored in the DNS test results.

@bassosimone bassosimone added enhancement improving existing code or new feature methodology issues related to the testing methodology ooni/probe-engine priority/medium user feedback requests that have been added to the backlog as a direct result of user feedback or testing labels Feb 1, 2023
@bassosimone bassosimone self-assigned this Feb 1, 2023
@YadavGulshan
Copy link

YadavGulshan commented Jul 24, 2023

Hi!

I found the similar response for carrefour.fr.

; <<>> DiG 9.18.12-0ubuntu0.22.04.2-Ubuntu <<>> carrefour.fr
;; global options: +cmd
;; Got answer:
;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 4993
;; flags: qr rd ra; QUERY: 1, ANSWER: 2, AUTHORITY: 5, ADDITIONAL: 6

;; OPT PSEUDOSECTION:
; EDNS: version: 0, flags:; udp: 65494
;; QUESTION SECTION:
;carrefour.fr.			IN	A

;; ANSWER SECTION:
carrefour.fr.		3600	IN	A	104.18.7.94
carrefour.fr.		3600	IN	A	104.18.6.94

;; AUTHORITY SECTION:
carrefour.fr.		3579	IN	NS	antor.carrefour.com.
carrefour.fr.		3579	IN	NS	pendragon.carrefour.com.
carrefour.fr.		3579	IN	NS	keu.carrefour.com.
carrefour.fr.		3579	IN	NS	ns1.eu.rrpproxy.net.
carrefour.fr.		3579	IN	NS	ns2.eu.rrpproxy.net.

;; ADDITIONAL SECTION:
keu.carrefour.com.	113467	IN	A	213.137.173.17
antor.carrefour.com.	113467	IN	A	217.77.225.150
pendragon.carrefour.com. 113467	IN	A	217.77.230.17
keu.carrefour.com.	113467	IN	AAAA	2a00:2000:4701:d::1
pendragon.carrefour.com. 113467	IN	AAAA	2001:67c:280c:d::1

;; Query time: 252 msec
;; SERVER: 127.0.0.53#53(127.0.0.53) (UDP)
;; WHEN: Mon Jul 24 15:08:04 IST 2023
;; MSG SIZE  rcvd: 303

@bassosimone
Copy link
Member

bassosimone commented Feb 8, 2024

@Te-k @YadavGulshan The next version of Web Connectivity that we're going to probably ship in the March release performs DNS-over-UDP and collects DNS responses. See, for example, this measurement. Check the test_keys.queries[0] entry. The raw response is the base64 of the bytes we received, therefore it includes the sections you're interested in.

If you have some spare cycles to test this functionality for your use case, that would be awesome! To this end, your should either compile miniooni for yourself from the master branch (see instructions) or use a nightly build.

The command to run is:

./miniooni -i https://libgen.rs/ web_connectivity@v0.5

(Add -y to the command line if it's the first time that you use miniooni.)

Towards the end of the output, the command will print the Explorer URL of the measurement.

I am tentatively going to close the issue because AFAICT it should be possible to observe the additional sections. Please, reopen the issue if Web Connectivity v0.5 does not collect all the data you need.

Thank you!

@bassosimone bassosimone added the fixed-by-webconnectivity-lte The next version of webconnectivity fixes this issue label Feb 8, 2024
@Te-k
Copy link
Author

Te-k commented Feb 8, 2024

That's great, thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement improving existing code or new feature fixed-by-webconnectivity-lte The next version of webconnectivity fixes this issue methodology issues related to the testing methodology ooni/probe-engine priority/medium user feedback requests that have been added to the backlog as a direct result of user feedback or testing
Projects
None yet
Development

No branches or pull requests

3 participants