Skip to content

xenosnikos/opensea-scraper

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

2 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

opensea-scraper

It is challenging to scrape data from Opensea without having restrictions to the site since the requests go through Cloudflare. But it's possible to imitiate the requests after obtaining the header of the request by intercepting the network activity. The key point of the trick is here: sending the imitated request through the browser by using the page.evaluate function instead of sending on the node client, otherwise, the CORS won't be fulfilled and the requests will be blocked by the Cloudflare mechanism.

Install

npm install

Usage

Define the collection name in the .env file and run the script. The process will be logged and the output will be dumped to output.json file.

npm run collect

About

Opensea collection item scraper based on puppeteer (cloudflare bypass)

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors

Languages

  • JavaScript 100.0%