Web Crawler

Crawl websites segment by segment and extract structured JSON data

As of June 2026, Web Crawler has 12 users and a 5.00/5 rating from 1 reviews in the Developer Tools category.

Usersup 300.0 percent+300.0%
12
12
Ratingno change0%
5.00
1 reviews
Reviewsno change0%
1
Version
1.0.0
Manifest V3

History

9 snapshots

Tracking since Apr 1, 2026.

14.888.52.119999999999999Apr 1, 2026Jun 11, 2026
View as table
DateUsersRatingReviewsVersion
Apr 1, 202631.0.0
Apr 11, 202641.0.0
Apr 28, 202665.0011.0.0
May 5, 202675.0011.0.0
May 16, 202665.0011.0.0
May 22, 2026125.0011.0.0
May 29, 2026145.0011.0.0
Jun 5, 202695.0011.0.0
Jun 11, 2026105.0011.0.0
Now125.0011.0.0

Permissions & access

Permissions
storage
Host access
None declared

Screenshots

Web Crawler screenshot 1

About

Web Crawler — Extract Website Data as JSON

Crawl any website segment by segment and extract structured data in clean JSON format. Perfect for developers, SEO analysts, researchers, and data enthusiasts who need to quickly gather and analyze website content.

🔍 What It Does Web Crawler visits every page on a website, extracts key data from each segment, and delivers it all as organized JSON — stored automatically in MongoDB for easy access.

📦 Data Extracted Per Page • Page title & meta tags (description, keywords, Open Graph) • All headings (H1–H6) • Paragraph text content • Images with alt text • Internal & external links • Script and stylesheet references • HTTP status codes

⚡ Key Features • Segment-by-segment crawling with real-time progress tracking • Auto-fill current tab URL with one click • Configurable max pages limit (1–200) • Export results as downloadable JSON file • Copy JSON to clipboard instantly • Crawl history with status tracking • Beautiful dark-mode interface • Data stored in MongoDB for persistence and querying

🛠️ How It Works

Enter a URL or auto-fill from your current tab
Click "Start Crawl" and watch the progress bar
View structured JSON results with page, link, and image counts
Export or copy the data for your projects
⚙️ Requirements This extension requires a backend server (Node.js + Express) and MongoDB. Setup instructions are available on our GitHub repository.

Built with Node.js, Express.js, Cheerio, and MongoDB.

Technical

Version
1.0.0
Manifest
V3
Size
4.26MiB
Min Chrome
88
Languages
1
Featured
No

Metadata

ID
haennclepgpfehgefoclaofhdnnchnhe
Developer ID
uc4581e223363434e4e18f5655e706d69
Developer Email
[email protected]
Created
Mar 17, 2026
Last Updated (Store)
Mar 17, 2026
Last Scraped
Jun 11, 2026
Website
Support URL
Privacy Policy

Similar extensions

Alternatives to Web Crawler, ranked by description similarity.

Data sourced from the Chrome Web Store · last verified Jun 11, 2026.