OK
https://www.redditstatic.com/robots.txt
Estonia
Country
Network
September 19, 2024, 06:09 PM UTC
Date & Time
Websites
Websites
Runtime: 818ms
On September 19, 2024, 06:09 PM UTC, https://www.redditstatic.com/robots.txt was accessible when tested on AS34702 in Estonia.

Failures

HTTP Experiment
null
DNS Experiment
null
Control
null

DNS Queries

Resolver:
173.194.98.19
Query:
IN A www.redditstatic.com
Engine:
system
Name
Class
TTL
Type
DATA
@
IN
A
151.101.85.140

TCP Connections

Connection to 151.101.85.140:443 succeeded.

HTTP Requests

URL
GET https://www.redditstatic.com/robots.txt
Response Headers
Accept-Ranges:
bytes
Content-Length:
507
Content-Type:
text/plain
Date:
Thu, 19 Sep 2024 18:08:58 GMT
Nel:
{"report_to": "w3-reporting-nel", "max_age": 14400, "include_subdomains": false, "success_fraction": 0.02, "failure_fraction": 0.02}
Report-To:
{"group": "w3-reporting-nel", "max_age": 14400, "include_subdomains": true, "endpoints": [{ "url": "https://w3-reporting-nel.reddit.com/reports" }]}, {"group": "w3-reporting", "max_age": 14400, "include_subdomains": true, "endpoints": [{ "url": "https://w3-reporting.reddit.com/reports" }]}, {"group": "w3-reporting-csp", "max_age": 14400, "include_subdomains": true, "endpoints": [{ "url": "https://w3-reporting-csp.reddit.com/reports" }]}
Retry-After:
0
Server:
snooserv
Vary:
Origin
Via:
1.1 varnish
Response Body

User-Agent: *
Disallow: /
Allow: /desktop2x/img/favicon/*
Allow: /favicon.ico
Allow: /icon.png
Allow: /new-icon.png
Allow: /desktop2x/img/social-sharing/*
Allow: /talk/assets/social-sharing/*
Allow: /marketplace-assets/*

User-agent: Googlebot
User-agent: AdsBot-Google
User-agent: AdsBot-Google-Mobile
User-agent: AdsBot-Google-Mobile-Apps
User-agent: Googlebot-Image
User-agent: Googlebot-Video
User-agent: Applebot
User-agent: ClarityBot
Disallow:

User-agent: bingbot
User-agent: MSNBot-Media
Allow: /

Resolver

Resolver ASN
AS15169
Resolver IP
173.194.98.19
Resolver Network Name
Google LLC
Report ID
20240919T175512Z_webconnectivity_EE_34702_n1_YGGgoK3nSq4rTGW9
Platform
windows
Software Name
ooniprobe-desktop-unattended (3.23.0)
Measurement Engine
ooniprobe-engine (3.23.0)

Raw Measurement Data

Loading