Skip to content

Commit 22c74f2

Browse files
authored
Add browser key and mention on how to interpret certain failures (#270)
* Add `browser` key and mention on how to interpret certain failures * Update ts-036-browser_web.md
1 parent bfb7d57 commit 22c74f2

1 file changed

Lines changed: 4 additions & 1 deletion

File tree

nettests/ts-036-browser_web.md

Lines changed: 4 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -67,6 +67,7 @@ fail and appear to be a result of blocking.
6767
Firefox users should be asked, if they have strict enhanced tracking protection
6868
enabled, to add a whitelist rule for the website hosting the experiment,
6969
however this is not a guarantee that they will run the test with it on.
70+
If a site is deemed inaccessible as a result of specific settings the user has in their browser, the `load_time_ms` will generally be significantly lower than a truly blocked website. When interpreting the data this should be taken into account.
7071

7172
# Expected output
7273

@@ -89,6 +90,7 @@ where:
8990
while it will be `error` in the case of a failure;
9091
* `load_time_ms` (`float`) indicates the number of milliseconds it took to load
9192
the requested resource.
93+
* `browser` (`string`) indicates the name of the browser used to run the experiment (ex. `firefox` or `chrome`)
9294

9395
## Possible conclusions
9496

@@ -114,7 +116,8 @@ user.
114116
"test_runtime": 0.4044000000059605,
115117
"test_keys": {
116118
"result": "ok",
117-
"load_time_ms": 404.40000000596046
119+
"load_time_ms": 404.40000000596046,
120+
"browser": "chrome"
118121
}
119122
}
120123
```

0 commit comments

Comments
 (0)