Domain Analyzer

What is a domain analyzer?

A domain analyzer is a tool that inspects a website’s technical infrastructure and configuration. It provides insights into how a site is built, its security features, and its hosting environment. This information is valuable for developers, security professionals, and anyone interested in understanding the technical aspects of a website.

What does the domain analyzer check?

The domain analyzer performs a thorough examination of various website components:

• HTTP Status and Response Time: It checks if the site is reachable and measures the time taken to get a response.
• TLS Certificate Details: It verifies the site’s SSL/TLS certificate, including issuer, expiry date, and the subdomains listed.
• Security Headers: It identifies the presence of key security headers such as HSTS, CSP, X-Frame-Options, X-Content-Type-Options, Referrer-Policy, and Permissions-Policy.
• DNS Records: It retrieves DNS records and checks for DMARC, CAA, and DNSSEC configurations.
• Registration Information: It provides data on the domain’s registration date, registrar, expiry, and registry status.
• Server and Hosting Details: It identifies the server’s location, hosting provider, and network (ASN) using IP geolocation.
• Website Structure: It analyzes the homepage title, description, word count, headings, and detects platform fingerprints like WordPress or Angular.
• Schema.org Types: It lists the schema.org types published on the site.
• Robots.txt and Sitemap: It checks robots.txt rules, including AI crawler blocks, and assesses the sitemap size.
• Redirect and Canonicalization: It analyzes redirect and canonicalization behavior.
• Error Handling: It shows what the domain returns for a non-existent URL.
• Third-Party Resources: It identifies third-party hosts, cookies, and trackers.
• Common Pages: It checks for the existence of about, contact, privacy, and terms pages at their usual paths.

What won’t the domain analyzer tell me?

The domain analyzer does not provide traffic estimates, domain authority scores, keyword rankings, or any SEO-related metrics. These aspects cannot be determined by inspecting a domain and require different tools and methodologies. The analyzer focuses on technical and configuration details rather than performance or search engine optimization metrics.

What if a site blocks the check?

If a website blocks automated requests, such as through a Cloudflare interstitial or by returning a 403 error to bots, the domain analyzer will still produce a report. However, the report will be labeled as blocked and will not include any data derived from the page content. Despite this, it will still show certificate, DNS, registration, and robots.txt information because these are served to everyone.

How does the domain analyzer handle privacy?

The domain analyzer collects data that is publicly accessible or served to everyone who accesses the site. Building a report involves querying the domain registry over RDAP and an IP geolocation service to obtain server location and hosting details. The tool does not collect or store any personal data or user information. It respects the privacy of website owners by only using publicly available data.

How is the data presented?

The data is presented in a clear and organized manner. The report includes a summary of key findings and detailed sections for each aspect of the analysis. A table is provided to compare what is measured directly against what is not provided:

FAQ

Question|||How often is the data updated?

Answer|||The reports are cached for 14 days. After that, a new report is generated when the domain is checked again.

Question|||Can I check any website?

Answer|||Yes, you can check any website as long as it is accessible and does not block the domain analyzer’s requests.

Question|||Is the tool free to use?

Answer|||Yes, the domain analyzer is free to use for anyone.

Question|||Does the tool work with subdomains?

Answer|||Yes, the tool can analyze subdomains as well as main domains.

Question|||Can I download the report?

Answer|||Currently, the report is only available to view online.

Question|||Is the tool secure?

Answer|||Yes, the tool only collects publicly available data and does not store any personal information.

How often is the domain analysis report refreshed?

Our free domain-analysis tool generates reports by querying multiple data sources in real-time when you submit a domain. However, to optimize performance and resource usage, we implement a caching mechanism for the results. Reports are typically cached for 24 to 48 hours, depending on the domain’s popularity and how frequently the data sources are updated.

Understanding the caching timeframe is crucial for interpreting the results accurately. If you run a report on a domain that has been analyzed recently, you will receive the cached data. This ensures faster load times and reduces the load on our servers and data providers. If you suspect that a domain’s configuration or underlying technology has changed recently, you can manually refresh the report. Keep in mind that refreshing the report will initiate a new real-time analysis, which may take slightly longer to complete.

For users who need the most up-to-date information regularly, consider running the analysis at intervals that align with the caching policy. This approach balances the need for current data with the tool’s performance efficiency.

What does the domain’s registration date indicate?

The registration date of a domain can provide some insights into the website’s history and credibility. Generally, an older registration date may suggest that the website has been around for a while, which can be an indicator of stability and longevity. However, this is not a definitive measure of the site’s trustworthiness or quality.

It’s important to note that the registration date does not reveal anything about the current ownership or the purpose of the website. A domain could have changed hands multiple times or been repurposed for different uses since its initial registration. Additionally, some legitimate websites may have recently registered domains, especially if they are new businesses or projects.

To gain a more comprehensive understanding of a website’s history, consider cross-referencing the registration date with other data points, such as the age of the content, the frequency of updates, and the domain’s historical WHOIS records. This holistic view can help you make a more informed assessment.

What does it mean when a domain blocks AI crawlers?

When a domain blocks AI crawlers, it indicates that the website has implemented measures to prevent automated bots, including those used by search engines and analysis tools, from accessing its content. This is often done to protect user privacy, prevent data scraping, or reduce server load.

From a technical standpoint, this means that our domain-analysis tool, like many others, may not be able to retrieve certain types of data from the website. For instance, the tool might not be able to analyze the site’s meta tags, internal links, or other on-page elements that are typically accessed by crawlers. As a result, the report may have incomplete information or lack specific details about the website’s structure and configuration.

If you encounter a domain that blocks AI crawlers, you can still gain some insights from the available data, such as the domain’s registration information and hosting details. However, for a more thorough analysis, you may need to reach out to the website administrator to request access or clarification on their crawler policies.

Frequently asked questions

13 domains analysed on this site.