Index sitemap content API
Fetch one public sitemap or sitemap index and return the listed URLs with lastmod, changefreq, and priority when those fields are present. Page URLs are not fetched.
The Index sitemap content operation is part of the Web & Page Intelligence API on BRAINIAC.software. Fetch one public sitemap or sitemap index and return the listed URLs with lastmod, changefreq, and priority when those fields are present. Page URLs are not fetched. It is exposed as POST /api/v1/web-intelligence/sitemap-content-index and priced at $0.03 USDC on Base. Payment uses the x402 exact scheme: an unpaid call returns HTTP 402 with payment requirements; after paying the exact USDC amount, retry the same request with a payment-signature header and Idempotency-Key. No account and no API key are required. Data sources for this product: The public http or https URL supplied in the request. A caller-supplied previous Markdown snapshot for change detection. Limitations: Only public http and https URLs on ports 80 and 443 are fetched. Local, private, and link-local addresses are refused, including after redirects and DNS resolution. JavaScript is not executed, so client-rendered text is absent. Login, paywall, and CAPTCHA walls are not bypassed. A null field means the value was not present in the fetched document. Change detection uses the caller-supplied snapshot and does not store it. Sitemap page URLs are listed, not fetched. Outputs are compliance prechecks, drafts, or data lookups for human review. They are not official determinations, legal advice, identity confirmation, or certified filings. Related operations in this group include Convert URL to Markdown, Extract structured page data, Detect page changes, Extract website metadata. Open the group documentation for the full request schema, field notes, and response examples before integrating.
/api/v1/web-intelligence/sitemap-content-indexExample request
curl -i -X POST "https://www.brainiac.software/api/v1/web-intelligence/sitemap-content-index" \
-H 'content-type: application/json' \
-H 'Idempotency-Key: <fresh-64-character-random-hex-key>' \
--data-binary @- <<'JSON'
{
"sitemapUrl": "https://www.sitemaps.org/sitemap.xml"
}
JSONAn unpaid probe returns HTTP 402 with x402 payment requirements. After paying the exact USDC amount on Base, retry the identical request with a payment-signature header.
FAQ
- Do I need an API key? No. Pay the listed USDC amount with x402.
- What network? Base (eip155:8453), USDC.
- Is this an official determination? No. Results are for human review against the cited sources.
Related operations
- Convert URL to Markdown — $0.04 USDC
- Extract structured page data — $0.05 USDC
- Detect page changes — $0.05 USDC
- Extract website metadata — $0.02 USDC