Skip to content

ShiwamKumar2208/VerySimpleWebScrapy

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

9 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

⚡ StaticWeb

A fast, multi-threaded CLI web scraper with a beautiful terminal UI. https://pypi.org/project/staticweb/

🚀 Installation

pip install staticweb

⚡ Quick Start

sw https://example.com --link

🔧 Features

  • 🔗 Extract links (--link)
  • 📄 Extract paragraphs (--para)
  • 🧾 Extract full page text (--all)
  • 🏷 Extract custom tags (--tag h1)
  • 📦 JSON output (--json)
  • 💾 Save results (--save output.txt)
  • ⚡ Multi-threading (--threads)
  • 🎨 Rich UI (progress bar, tables, colors)

🧪 Examples

sw https://example.com --para
sw https://example.com --tag h1
sw https://example.com --link --json
sw https://example.com https://google.com --threads 5

🧠 Dev Mode

sw --codeofit

View full source code directly in terminal.

📁 Project Idea

This tool is designed to feel like:

curl + grep + scrapy (but simpler and cleaner)

⚠️ Disclaimer

Use responsibly. Always respect:

  • robots.txt
  • website terms of service

⭐ Contribute

PRs welcome. Ideas welcome. Make it better.

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors

Languages