← The Atlas of Alternative DataChapter II · WEB
Web & Pricing Data
Web and pricing data is information collected from public websites at scale: product prices, assortment, stock status, and site traffic, captured daily and structured for analysis.
The primer
Web data is collected by crawling public websites at scale: product pages, price points, stock status, and the structure of an online catalogue. Specialist firms run the infrastructure that fetches, parses, and normalises these pages into clean panels of prices and assortment. Investors use it to track pricing power, promotional intensity, and out-of-stock rates across competitors. The main considerations are coverage breadth, the legality and robustness of collection, and how cleanly the data maps to companies and brands.
The register
Every web & pricing data provider on file. Verified means the site is live, on its own brand, and editorially checked — never paid placement. Listings are informational, not investment advice.
| Provider | Geography | Since | Delivery | Price band |
|---|---|---|---|---|
| AberdeenVerifiedCoverageWeb traffic data mapped to company IP addresses to understand what topics employees are researching. | US | — | — | — |
| Amass InsightsVerifiedCoverageAlternative data aggregator and analytics company that specializes in Web Data. Founded in 2015; 5 employees. | US | — | — | — |
| ApifyVerifiedSampleCoverageWeb scraping and automation platform producing structured datasets from public websites. | Global | 2015 | API | < $50k |
| ARCVerifiedCoverageLarge database of air travel ticketing data that provides insights into aviation, travel marketing, and hotel industries. Industry benchmark for airline pricing | US | — | — | — |
| BayStreet ResearchVerifiedCoverageResearch on U.S. and European smartphone, tablet, and wearable markets. Has a database of mobile device sell-through data with rolling 6-month forecasts, and re | US | — | — | — |
| Bright DataVerifiedSampleCoverageWeb data collection infrastructure and ready-made datasets scraped from public web pages at scale. | Global | 2014 | API, S3 | $50–150k |
| BuiltWithVerifiedCoverageTechnographic data tracking adoption of web technologies across the internet, used to monitor usage trends for public technology vendors. | Australia | 2007 | — | — |
| Common CrawlVerifiedSampleCoverageFree petabyte-scale archive of crawled web pages, refreshed monthly. | Global | 2011 | Bulk | Free |
| Cruise AnalyticsVerifiedCoverageWeekly data on cruise prices and occupancy rates Founded in 2018; 2 employees. | US | — | — | — |
| Dataprovider.comVerifiedCoverageWeb data by sector and geography (e.g. data on websites for hardware stores in NYC area), frequency of website changes, and website build quality. Founded in 20 | Netherlands | — | — | — |
| DataPulseVerifiedCoverageWeb traffic data focused on identifying total traffic related to a single company across multiple domain names. Founded in 2016; 37 employees. | US | — | — | — |
| DataWeaveVerifiedCoverageCompetitive pricing, assortment, and digital-shelf analytics collected across retail websites. | Global | 2011 | API, Dashboard | $50–150k |
| DiffbotVerifiedCoverageKnowledge-graph and web-extraction APIs built from crawling the public web. | US | 2008 | API | $50–150k |
| Hatched AnalyticsVerifiedCoverageHatched Analytics is a specialist operator in the alternative data space, focused on delivering insight on sought-after companies not available in traditional d | Ireland | — | — | — |
| Import.ioVerifiedCoverageWeb data extraction platform turning public web pages into structured datasets. | US | 2012 | API | $50–150k |
| Intelligence NodeVerifiedCoverageRetail pricing, assortment, and digital-shelf analytics from web data. | Global | 2012 | API, Dashboard | $50–150k |
| Internet ArchiveVerifiedSampleCoverageOpen archive of web pages, media, and historical site snapshots (Wayback Machine). | Global | 1996 | API, Bulk | Free |
| iSpot.tvVerifiedCoverageTV and streaming advertising measurement, including impressions and estimated advertiser spend captured from tens of millions of smart TVs. | US | 2012 | — | — |
| ListEdTechVerifiedCoverageTechnology-adoption data for higher-education institutions, covering systems such as student information and ERP platforms with history since 2014. | Canada | 2014 | — | — |
| MarketcheckVerifiedCoverageAutomotive inventory and listings data covering tens of thousands of US dealers, delivered through APIs and feeds with daily updates. | US | 2006 | API | — |
| MIDiA ResearchVerifiedCoverageEntertainment-sector data and research covering music streaming, video, gaming, and media technology, built from proprietary consumer surveys and tracking. | UK | 2014 | — | — |
| MozendaVerifiedCoverageWeb scraping software that integrates with databases and BI toolkits. Founded in 2007; 36 employees. | US | — | — | — |
| OxylabsVerifiedCoverageWeb data collection infrastructure and ready-made scraper APIs. | Lithuania | 2015 | API | $50–150k |
| Real Estate DataVerifiedCoveragePublic real estate data including listings, price changes, contracts, and sales. | US | — | — | — |
| Rook ResearchVerifiedCoverageWeb data focused on the tech stack beneath the front-facing content, e.g. third party APIs, network-level analysis, and more. | US | — | — | — |
| RVIAVerifiedCoverageRecreational vehicle data and trends, including industry forecasts, ownership trends, and pricing. Founded in 1978; 68 employees. | US | — | — | — |
| ScrapeHeroVerifiedCoverageCustom web-scraping and ready datasets across retail, travel, and more. | US | 2015 | API, S3 | < $50k |
| SequentumVerifiedCoverageWeb scraping software and solutions. Founded in 2014; 35 employees. | US | — | — | — |
| SimilarwebVerifiedSampleCoverageWeb and app traffic, engagement, and digital market-share estimates across millions of sites. | Global | 2007 | API, Dashboard | $50–150k |
| Standard Media IndexVerifiedCoverageAd spend data sourced directly from booking and invoice systems of media holding partners. Data is aggregated monthly. Founded in 2009; 35 employees. | US | — | — | — |
| T.H. CapitalVerifiedCoverageChina focused web data firm. Founded in 2011 by a former Bernstein analyst; 12 employees. | China | — | — | — |
| Webz.ioVerifiedCoverageWeb data feeds covering news, blogs, forums, and the dark web. | Israel | 2016 | API, Feed | $50–150k |
| YipitDataVerifiedCoverageAnalyst-ready research products built from web, transaction, and app data across consumer and internet sectors. | US | 2011 | Report, Feed, API | $150k+ |
| ZyteVerifiedSampleCoverageWeb scraping infrastructure and managed data extraction, formerly Scrapinghub. | Ireland | 2010 | API | < $50k |
Elsewhere in the atlas
Previous chapter: Card & Transactions. Next chapter: News & Sentiment. All 20 categories are defined in the glossary; the full register is on the front page, and the market counts are in the Atlas Briefing. This chapter is also published as Markdown and JSON for agents (how).