Python Sitemap Parser Downloads Grew 6.4x in Two Years but Were Outnumbered 637 to 1 by Web-to-Text Tools in 2026

Summary

Picture a landscaping company that adds a new service page for drainage work. A person finds it through the menu. A machine is more likely to find it through the XML sitemap, the file that lists every page a site wants discovered.

Developers who build crawlers for search engines, SEO audits and AI data pipelines can read sitemaps with a dedicated parser package, with a feature inside a larger framework, or with a few lines of their own code. We tracked downloads of the dedicated Python sitemap parsers on PyPI.

Downloads grew 6.4x in two years to 160,161 in the Q3 2026 sample days. That is real growth, but dedicated sitemap parsers remain a small niche: web-to-text tools were downloaded 637 times as often in the same days.

What we measured

We queried the public PyPI download log in Google BigQuery (bigquery-public-data.pypi.file_downloads), which records one row for every file downloaded from the Python Package Index. To keep the query affordable we sampled the first seven days of every month from January 2022 through September 2026, 399 days in total, and summed downloads by month, package, country, CI flag, installer and weekday versus weekend into one working table. A quarter in this study therefore means 21 sampled days (days 1 to 7 of each of its three months), not a full quarter. We removed downloads made by mirroring and proxy tools (bandersnatch, Nexus, Artifactory, devpi), which copy packages in bulk rather than install them. To control for the growth of PyPI itself we also pulled total daily download counts for the whole index from the table's partition metadata for the same sampled days.

We tracked three packages whose main job is parsing XML sitemaps: ultimate-sitemap-parser, pysitemap, sitemap-parser. We also checked the package name usp, which had no downloads. Larger tools such as Scrapy, advertools and trafilatura include their own sitemap handling and are not counted here, so these numbers understate how often sitemaps are read by code.

Sitemap parser downloads dipped, then climbed

Downloads per quarter across the 21 sampled days (days 1 to 7 of each month).

Downloads drifted down from 40,255 in Q1 2022 to 5,384 in Q4 2023, then rose through 2025 and 2026. Q3 2026 was the highest quarter in the series.

Most sitemap parser downloads now come from automated pipelines

Installer, CI and timing signals for the group.

Weekend downloads ran at only 26.6% of the weekday pace in Q3 2026, far below the 65.5% for PyPI overall. That pattern fits test pipelines triggered by developers' weekday commits. By IP location, United States accounted for 92.4% of downloads across 74 country codes.

A niche next to web-to-text tools

Sampled Q3 2026 downloads of sitemap parsers compared with the 14 web-to-text packages in our related study.

Many AI pipelines start from a search result or a single URL rather than a full site crawl, and many frameworks parse sitemaps internally. Both may help explain why dedicated sitemap parsers are downloaded so much less often than page-to-text converters.

What this means

Your XML sitemap is still how many machines discover the full list of pages on your site, including search engines and the crawlers that feed AI tools. A sitemap that lists redirected, deleted or blocked pages wastes their time, and one that misses new service pages leaves those pages to be found by chance. Have it update automatically and list only the pages you want found.

Pair a clean sitemap with clear page text so that the pages machines find are easy for AI to summarize. Sitemap and page text are the two halves of basic LLM optimization, and a free AI visibility audit checks both.

Limits

A download is not a user. One developer, one Docker build or one CI job can download the same package many times, and a single busy pipeline can move a package's numbers sharply from month to month.

Figures cover the first seven days of each month only (21 days per quarter), so they are sample totals, not full-month or full-quarter totals. Growth rates compare like-for-like sample periods.

PyPI as a whole grew from 12.1 billion downloads in the Q3 2022 sample days to 115.0 billion in the Q3 2026 sample days (9.5x), so part of every package's growth is the index growing. We report share of all PyPI downloads where it matters.

PyPI-wide downloads in the September 2026 sample week were 38.1% lower than in the August 2026 sample week (28.7 billion vs 46.4 billion), so September figures for individual packages should be read with that drop in mind.

The CI flag is only populated in this dataset from March 2024, and it only catches environments that announce themselves as CI. Automated downloads that do not set a CI variable are counted as non-CI.

Country codes come from the downloading IP address. Cloud servers sit mostly in the United States, so country splits describe where machines run, not where developers live.

Dedicated parser downloads understate sitemap use, because frameworks and many custom crawlers read sitemaps without these packages.

The group is small and one package makes up nearly all downloads, so a single project's CI setup can move the totals.

Frequently asked questions

Related studies

• Downloads of the tools that read websites for AIAI Agent Framework Downloads Topped 108M in One Week
• Downloads of the tools that read websites for AIMCP Downloads Now Exceed 10 Agent Frameworks Combined
• Downloads of the tools that read websites for AIWeb-to-Text Tool Downloads Grew 71x Since 2022
• Downloads of the tools that read websites for AIThree AI Providers Hold 89.9% of Model SDK Downloads