IntelliScrape

A Manifest V3 browser extension for smart page detection, configurable scraping profiles, previews, and CSV/JSON export.

---

What it does

• Smart setup - Detects the active page type and suggests a matching profile (including auto-detected repeating cards).
• Reusable profiles - Save row selectors, fields, extraction mode (text, HTML, attribute), and per-field fallbacks.
• Live preview - Run the scraper from the popup and preview rows before exporting.
• CSV/JSON export - Copy JSON, export rows as CSV, or export the full scrape result as JSON.
• Q&A enrichment - The Q&A list profile can fetch question detail pages to add answer data.
• Privacy-friendly - Runs only when you open the popup; profiles stay in browser.storage.local / chrome.storage.local.

---

Browser Support

This extension supports Chrome and Firefox (Manifest V3 support required).

---

Tech Stack

Category	Technology
Platform
UI
Logic
Extension APIs
Permissions

---

Getting Started

Clone

1. Clone the repo:

git clone <your-repo-url>

Chrome

1. Open chrome://extensions.
2. Enable Developer mode.
3. Click Load unpacked.
4. Select this project folder.
5. Open any normal website page.
6. Click the extension icon, use Smart setup, then click Run scraper.

Firefox

1. Open about:debugging#/runtime/this-firefox.
2. Click Load Temporary Add-on.
3. Select manifest.json from this project folder.
4. Open any normal website page.
5. Click the extension icon, use Smart setup, then click Run scraper.
6. After changes, click Reload on the add-on entry in about:debugging.

---

Project Structure

IntelliScrape/
├── icons/
│   ├── 16.png
│   ├── 32.png
│   ├── 48.png
│   ├── 64.png
│   └── 128.png
├── manifest.json        # Manifest V3 config (Chrome + Firefox)
├── intelliscrape.html   # Popup UI markup
├── intelliscrape.css    # Popup styling
├── intelliscrape.js     # Profiles, detection, scraping, export logic
└── README.md

---

Built-In Profiles

• Starter profile
• Q&A site - list pages
• Q&A site - question page
• Products - listing cards
• Products - detail page
• Articles - listing pages
• Articles - detail page
• Jobs - listing pages
• Search results
• Tables - rows
• Events - listing pages
• Real estate - listings
• Forum/Q&A - question lists
• Images - gallery/assets
• Documentation - page outline
• Links - visible anchors
• Auto-detected repeating cards

---

Icons

The manifest uses:

• icons/16.png
• icons/32.png
• icons/48.png
• icons/64.png
• icons/128.png

Keep these filenames if you replace the artwork.

---

License

MIT. See LICENSE.

---

Scrape only pages you are allowed to access, and respect each website's terms.