OK
https://s.gr-assets.com/robots.txt
Websites
Runtime: 1.2s
On April 04, 2025, 01:45 PM UTC, https://s.gr-assets.com/robots.txt was accessible when tested on AS8866 in Bulgaria.
Failures
HTTP Experiment
null
DNS Experiment
null
Control
null
DNS Queries
Resolver:
162.158.60.70
Query:
IN A s.gr-assets.com
Engine:
system
Name
Class
TTL
Type
DATA
@
IN
A
18.165.68.25
TCP Connections
Connection to 18.165.68.25:443 succeeded.
HTTP Requests
URL
GET https://s.gr-assets.com/robots.txt
Response Headers
Cache-Control:max-age=0, private, must-revalidateContent-Type:text/plain; charset=utf-8Date:Fri, 04 Apr 2025 13:45:46 GMTEtag:W/"fd7c1a42fb4d8567a8e4648cedc614a6"Server:ServerStrict-Transport-Security:max-age=63072000; includeSubDomains; preloadVary:Accept-EncodingVia:1.1 fb211c90e9ef3584bea8fd177f57995a.cloudfront.net (CloudFront), 1.1 a691127ceb6e813dc3ada040272c1fae.cloudfront.net (CloudFront)X-Amz-Cf-Id:SkT7KOqgsiiWLLCMygg2NifwKBAQtbEbUemAXG9sN79nHNcEYxZvzA==X-Amz-Cf-Pop:LHR50-P4X-Amz-Rid:QTFESJS3MEVBG0P9N9EBX-Cache:Miss from cloudfrontX-Content-Type-Options:nosniffX-Frame-Options:ALLOWALLX-Request-Id:QTFESJS3MEVBG0P9N9EBX-Runtime:0.020840X-Xss-Protection:1; mode=block
Response Body
# See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file User-agent: EtaoSpider Disallow: / User-agent: GPTBot Disallow: / User-agent: CCBot Disallow: / User-agent: facebookexternalhit Allow: /user/year_in_books User-agent: Mediapartners-Google Disallow: /about/team_member/ Disallow: /admin Disallow: /api Disallow: /blog/list_rss Disallow: /book/reviews/ Disallow: /book_link/follow/ Disallow: /buy_buttons/ Disallow: /ebooks Disallow: /friend/add_as_friend Disallow: /home/index_rss Disallow: /oggiPlayerLoader.htm Disallow: /photo/group/ Disallow: /quotes/list_rss Disallow: /review/list Disallow: /review/list_rss Disallow: /review/rate Disallow: /shelf/user_shelves Disallow: /tooltips Disallow: /track Disallow: /trivia/answer Disallow: /user/updates_rss Disallow: /*reviewFilters User-agent: * Allow: /work/editions Allow: /work/quotes Disallow: /about/team_member/ Disallow: /admin Disallow: /api Disallow: /blog/list_rss Disallow: /book/reviews/ Disallow: /book_link/follow/ Disallow: /buy_buttons/ Disallow: /ebooks Disallow: /friend/add_as_friend Disallow: /home/index_rss Disallow: /oggiPlayerLoader.htm Disallow: /photo/group/ Disallow: /quotes/list_rss Disallow: /quotes/tag Disallow: /review/list Disallow: /review/list_rss Disallow: /review/rate Disallow: /review/show Disallow: /search Disallow: /shelf/user_shelves Disallow: /tooltips Disallow: /track Disallow: /trivia/answer Disallow: /user/updates_rss Disallow: /user/year_in_books Disallow: /videos/ Disallow: /work Disallow: /*reviewFilters Sitemap: https://www.goodreads.com/siteindex.author.xml Sitemap: https://www.goodreads.com/siteindex.author_community_question.xml Sitemap: https://www.goodreads.com/siteindex.award.xml Sitemap: https://www.goodreads.com/siteindex.blog.xml Sitemap: https://www.goodreads.com/siteindex.book_community_question.xml Sitemap: https://www.goodreads.com/siteindex.genre.xml Sitemap: https://www.goodreads.com/siteindex.giveaway.xml Sitemap: https://www.goodreads.com/siteindex.group.xml Sitemap: https://www.goodreads.com/siteindex.index.xml Sitemap: https://www.goodreads.com/siteindex.interview.xml Sitemap: https://www.goodreads.com/siteindex.list.xml Sitemap: https://www.goodreads.com/siteindex.quote.xml Sitemap: https://www.goodreads.com/siteindex.quote_tag.xml Sitemap: https://www.goodreads.com/siteindex.related_work.xml Sitemap: https://www.goodreads.com/siteindex.topic.xml Sitemap: https://www.goodreads.com/siteindex.user.xml
Resolver
Resolver ASN
AS13335
Resolver IP
162.158.60.70
Resolver Network Name
Cloudflare Inc
Report ID
20250404T134134Z_webconnectivity_BG_8866_n1_xFKxBzBR1ostUMBc
Platform
android
Software Name
ooniprobe-android-unattended (5.0.5)
Measurement Engine
ooniprobe-engine (3.24.0)