-
Notifications
You must be signed in to change notification settings - Fork 2
Expand file tree
/
Copy pathHackersfiles.txt
More file actions
2392 lines (1940 loc) · 68.3 KB
/
Hackersfiles.txt
File metadata and controls
2392 lines (1940 loc) · 68.3 KB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824
825
826
827
828
829
830
831
832
833
834
835
836
837
838
839
840
841
842
843
844
845
846
847
848
849
850
851
852
853
854
855
856
857
858
859
860
861
862
863
864
865
866
867
868
869
870
871
872
873
874
875
876
877
878
879
880
881
882
883
884
885
886
887
888
889
890
891
892
893
894
895
896
897
898
899
900
901
902
903
904
905
906
907
908
909
910
911
912
913
914
915
916
917
918
919
920
921
922
923
924
925
926
927
928
929
930
931
932
933
934
935
936
937
938
939
940
941
942
943
944
945
946
947
948
949
950
951
952
953
954
955
956
957
958
959
960
961
962
963
964
965
966
967
968
969
970
971
972
973
974
975
976
977
978
979
980
981
982
983
984
985
986
987
988
989
990
991
992
993
994
995
996
997
998
999
1000
:::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
:::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
###HEADLESS Browsers:
Headful
Headless Client
Splash
Headless
Firefox Headless
Headless Chrome
Headless Linux
Headless
Headless Chromium
Browserless
Browser-Use
HeadlessChrome
Headless Edge
Headless Chromium
HeadlessChrome/Linux
HeadlessChrome/Ubuntu
Firefox Headless
Headless|Headless
Linux|Headful
Headful|Linux
Headful
selenium:headless:chromium
selenium:headful :chromium
selenium:headless:firefox
selenium:headful :firefox
playwright:headless:chromium
playwright:headful :chromium
playwright:headless:firefox
playwright:headful :firefox
Litium Headless
Puppeteer headless
Stealth Headless
headless Pi
#MOST USED HEADLESS BROWSERS:
PlaywrightPython
Selenium Stealth
Splash/Lua
HtmlUnit/Java
Chromedp /Golang
Cypress /JavaScript
Nimble Browser
Cypress
chromedp
browserless
gologin
#OS:
Parrot OS
BackBox
Dracos Linux
DemonLinux
CAINE
FreeBSD
OpenBSD
Solaris
IRIX
Samurai Web Testing Framework
SamuraiWTF
Network Security Toolkit
NST
BlackArch
#TOR:
Tor2Web
TOR browser
tor
TOR Exit Nodes
ssh
ssh-tunnel
ike
ipsec-esp
OnionLinks
OnionLand
#OTHERS (HACKERS DELIGHT)
Ghost Browser
Nstbrowser
Crt.sh
Shodan
searchcode.com
GreyNoise
ZoomEye
Censys
Hunter
MSIE
Nyxt
SimpleBrowser
GNOME Web
Basilisk
Flow browser
I2P
Windows NT
UCBrowser
UR Browser
Utopia
#DARK WEB: (use by hackers):
Ahmia
Torch
Haystack
Wade X
Stagehand
lightpanda
Zombie.js
Freenet
Tails OS
Not Evil
DarkSearch
DeepSearch
OTHER HEADLESS:
AngleSharp
Awesomium
benv
Browserjet
BrowserKit
browser-launcher
browser.rb
CasperJS
casperJS
cdp4j
C++, .NET
Chrome PHP
Chromeless
Chrome-remote-interface cyrus
Chromium drivers
Chromium Embedded
Headless CMS
Chromy
DalekJS
DamonJS
Erik
Geb G
Ghostbuster
ghost.py
Grope
grope
Guillotine
Headless Edge
Headless Firefox
HeadlessBrowser
Horseman
HtmlUnit
Jabba-Webkit
Jasmine-Headless-Webkit
Jaunt
jBrowserDriver
Jedi-crawler
jedi-crawler
Litium headless
Lotte
MechanicalSoup
mechanize
Nightmare
Node.js
PhantomJS
PhantomJsCloud
PhantomJS drivers
Phantompy
Playwright
Playwright-dotnet
Playwright-go
Playwright-python
Puppeteer
Puppeteer Sharp
Python-Webkit
RoboBrowser
Selenium
SlimerJS
SpecterJS
Splash Browser
Splinter
Spynner
SST
stanislaw
Surf
trifleJS
twill
WatiN
Watir
Watir-WebDriver
Webloop
Wendigo
wkhtmltopdf
WKZombie
WKZombie D
X-RAY
.Net
Zombie.js
-------------------
## HEADLESS Browsers:
Headful|Headless Client|Headless|Headless Chromium|HeadlessChrome|Headless Edge|Headless Chromium|HeadlessChrome/Linux|HeadlessChrome/Ubuntu|Browserless|Browser-Use|
Firefox Headless|Headless Linux|Headless|Headless|Headful|Linux|Headful|Litium Headless|Puppeteer headless|Stealth Headless|Headless CMS|headless Pi|
selenium:headless:chromium|selenium:headful :chromium|selenium:headless:firefox|selenium:headful :firefox|playwright:headless:chromium|playwright:headful :chromium|playwright:headless:firefox|
playwright:headful :firefox|PlaywrightPython|Selenium Stealth|Splash/Lua|HtmlUnit/Java|Chromedp /Golang|Cypress /JavaScript|
Nimble Browser|Cypress|chromedp|browserless|gologin|Parrot OS|BackBox|Dracos Linux|DemonLinux|CAINE|
FreeBSD|OpenBSD|Solaris|IRIX|Samurai Web Testing Framework|SamuraiWTF|Network Security Toolkit|NST|BlackArch|Tor2Web|TOR browser|tor|TOR Exit Nodes|ssh|ssh-tunnel|
ike|ipsec-esp|OnionLinks|OnionLand|Ghost Browser|Nstbrowser|Crt.sh|Shodan|searchcode.com|GreyNois|eZoomEye|Censys|Hunter|
MSIE|Nyxt|SimpleBrowser|GNOME Web|Basilisk|Flow browser|I2P|Windows NT|UCBrowser|UR Browser|Utopia|Ahmia|
Torch|Haystack|Wade X|Stagehand|lightpanda|Zombie.js|Freenet|Tails OS|Not Evil|DarkSearch|DeepSearch|AngleSharp|Awesomium|
benv|Browserjet|BrowserKit|browser-launcher|browser.rb|
CasperJS|casperJS |cdp4j| Chrome PHP|Chromeless|Chrome-remote-interface cyrus|Chromium drivers|Chromium Embedded|Chromy|C++, .NET|
DalekJS|DamonJS|Erik|Geb G|Ghostbuster|ghost.py|Grope|grope|Guillotine|Headless Edge|Headless Firefox|HeadlessBrowser|Horseman|HtmlUnit|
Jabba-Webkit|Jasmine-Headless-Webkit|Jaunt|jBrowserDriver|Jedi-crawler|jedi-crawler|Litium headless|Lotte|MechanicalSoup|mechanize|Nightmare|Node.js|
PhantomJS|PhantomJS drivers|phantompy|Playwright|Playwright-dotnet|Playwright-go|Playwright-pythonPuppeteer|Puppeteer Sharp|Python-Webkit|RoboBrowser|
Selenium|SlimerJS|SpecterJS|Splash Browser|Splinter|Spynner|SST|stanislaw|Surf|Splash|trifleJS|twill|PhantomJsCloud|
WatiN|Watir|Watir-WebDriver|Webloop|Wendigo|wkhtmltopdf|WKZombie|WKZombie D|X-RAY|.Net|Zombie.js
##HTACCESS: (ADDED: in htacces2)
<IfModule mod_rewrite.c>
RewriteCond %{HTTP_USER_AGENT} Headful|Headless [NC,OR]
RewriteCond %{HTTP_USER_AGENT} HeadlessChrome|HeadlessBrowser [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Headless\ Edge|Headless\ Firefox|Headless\ Chrome [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Headless\ Chromium|Browserless|Browser-Use [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Firefox\ Headless|Headless\ Linux [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Litium\ Headless|Puppeteer|Stealth\ Headless [NC,OR]
RewriteCond %{HTTP_USER_AGENT} selenium|playwright|PlaywrightPython [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Splash|HtmlUnit|chromedp|Cypress [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Nimble\ Browser|gologin|backbox|dracos [NC,OR]
RewriteCond %{HTTP_USER_AGENT} CAINE|FreeBSD|OpenBSD|Solaris|IRIX [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Samurai|NST|BlackArch|Tor2Web|tor [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ssh-tunnel|Ghost\ Browser|Nstbrowser [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Shodan|searchcode|GreyNois|eZoomEye|Censys|Hunter [NC,OR]
RewriteCond %{HTTP_USER_AGENT} MSIE|Nyxt|SimpleBrowser|GNOME\ Web|Basilisk [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Flow\ browser|I2P|UCBrowser|UR\ Browser|Utopia [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Torch|Haystack|Wade|Stagehand|lightpanda|Zombie [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Freenet|Tails\ OS|DarkSearch|DeepSearch|AngleSharp [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Awesomium|benv|Browserjet|BrowserKit|CasperJS [NC,OR]
RewriteCond %{HTTP_USER_AGENT} cdp4j|Chrome\ PHP|Chromeless|Chrome-remote|Chromy [NC,OR]
RewriteCond %{HTTP_USER_AGENT} DalekJS|DamonJS|Erik|Geb|Ghostbuster|ghost\.py [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Grope|Guillotine|Horseman|HtmlUnit|Jabba-Webkit [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Jasmine|Jaunt|jBrowserDriver|Jedi|Lotte [NC,OR]
RewriteCond %{HTTP_USER_AGENT} MechanicalSoup|mechanize|Nightmare|PhantomJS|phantompy [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Playwright|Puppeteer|Python-Webkit|RoboBrowser [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Selenium|SlimerJS|SpecterJS|Splinter|Spynner|SST [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Surf|trifleJS|twill|WatiN|Watir|Webloop [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Wendigo|wkhtmltopdf|WKZombie|X-RAY
RewriteRule ^ - [F]
</IfModule>
::::::::::::::::::::::::::::::::::::::::::::::::::::
....................................................
#HACKING TOOLS:
Metasploit
Kali Linux
Parrot Security OS
BlackArch Linux
BackBox Linux
Arch Linux
ZAP
OSV-Scanner
sqlmap
#Scrapers bypassing:
Objective C
Scala
Kotlin
Javascript
SSL Scanner
#CYBERCRIME: (WP)
WPXStrike
hydra
Octopus Scanner
Angry IP Scanner
Gitpaste-12
Imgur
Burp Suite
Wireshark
Reverse Shell
#PW CRACKERS:
Hashcat
# Bypass:
/wp-json/oembed/1.0/proxy - SSRF
php shell
Tcpdump
Snort
Hydra
QualysGuard
GFI LanGuard
Acunetix
Xenotix XSS Exploit Framework
SpiderFoot
Wapiti
Nmap
Wireshark
Angry IP Scanner
Zenmap
Masscan
Tenable Nessus
OpenVASVT
OPENVASVT::SOAP
OpenVAS
OWASP ZAP
Netcat
Superscan
Aircrack-ng
Hping
Unicornscan
Burp Suite
Homemade Scripts
Nikto
Gobuster
Dirsearch
FeroxBuster
Nessus
Nexpose
Arch Linux
StormCrawler
GoSpider
-------------------
#HACKING TOOLS
Metasploit|Kali Linux|Parrot Security OS|BlackArch Linux|BackBox Linux|Arch Linux|ZAP|OSV-Scanner|sqlmap|Objective C|Scala|Kotlin|Javascript|SSL Scanner|WPXStrike|
hydra|Octopus Scanner|Angry IP Scanner|Gitpaste-12|Imgur|Burp Suite|Wireshark|Reverse Shell|Hashcat|/wp-json/oembed/1.0/proxy - SSRF|php shell|
Tcpdump|Snort|Metasploit|Hydra|QualysGuard|GFI LanGuard|Acunetix|Xenotix XSS Exploit Framework|SpiderFoot|Wapiti|Nmap|Wireshark|Angry IP Scanner|
Zenmap|Masscan|Tenable Nessus|OpenVASVT|OPENVASVT::SOAP|OpenVAS|OWASP ZAP|Netcat|Superscan|Aircrack-ng|Hping|Unicornscan|Burp Suite|Homemade Scripts|Nikto|
Gobuster|Dirsearch|FeroxBuster|Nessus|Nexpose|Arch Linux|StormCrawler|GoSpider
##HTACCESS:
<IfModule mod_rewrite.c>RewriteCond %{HTTP_USER_AGENT} "(Metasploit|Kali Linux|Parrot Security OS|BlackArch Linux|BackBox Linux|Arch Linux|ZAP|OSV-Scanner|sqlmap|Objective C|Scala|Kotlin|Javascript|SSL Scanner|WPXStrike|hydra|Octopus Scanner|Angry IP Scanner|Gitpaste-12|Imgur|Burp Suite|Wireshark|Reverse Shell|Hashcat|php shell|Tcpdump|Snort|QualysGuard|GFI LanGuard|Acunetix|Xenotix XSS Exploit Framework|SpiderFoot|Wapiti|Nmap|Zenmap|Masscan|Tenable Nessus|OpenVAS|OWASP ZAP|Netcat|Superscan|Aircrack-ng|Hping|Unicornscan|Homemade Scripts|Nikto|Gobuster|Dirsearch|FeroxBuster|Nessus|Nexpose|StormCrawler|GoSpider)" [NC]RewriteRule ^ - [F,L]</IfModule>
<IfModule mod_rewrite.c>RewriteCond %{REQUEST_URI} /wp-json/oembed/1.0/proxy [NC]RewriteRule ^ - [F,L]</IfModule>
::::::::::::::::::::::::::::::::::::::::::::::::::::
....................................................
#PAIN IN THE ASS-SCRAPERS/Ai-HACKERS:
Cypress
Cyberfox
chrome|py
gocolly
colly
OpenWave
SimpleBrowser
Splash
SlimerJS
SSL/TLS Scan
PhantomJS
RV
Trident/4.0
TrileFejs
X11|Fedora
x11u; linux
X11 Linux
X11; Ubuntu
X11; Ubuntu|Linux
ZombieJS
WOW64|rv:48.0
WhatWeb
Wappalyzer Scan
WordPress Security Scan
##NON SORTED:
Knoppix x64
retire.js
Greenbone CE 22.04.14
data-requests
TypeScript
Empty TypeScript
Standby TypeScript
Bun
Apache Nutch
ALittle Client
litserve
TLS Fingerprinting
Request Header Fingerprint
JavaScript fingerprint
React|
Angular
Vue.js
Graphql
Zig
Knoppix x64
retire.js
............................
#PAIN IN THE ASS-SCRAPERS/Ai-HACKERS
Cypress|Cyberfox|chrome|py|gocolly|colly|Go Colly|OpenWav|eSimpleBrowser|Splash|SlimerJS|SSL/TLS Scan|PhantomJS|RV|
Trident/4.0|TrileFejs|X11|Fedora|x11u; linux|X11 Linux|X11; Ubuntu|X11; Ubuntu|Linux|ZombieJS|WOW64|rv:48.0|WhatWeb|Wappalyzer Scan|WordPress Security Scan|
Knoppix x64|retire.js|Greenbone CE 22.04.14|data-requests|TypeScript|Empty TypeScript|Standby TypeScript|Bun|Apache Nutch|ALittle Client|
litserve|TLS Fingerprinting|Request Header Fingerprint|JavaScript fingerprint|React| Angular|Vue.js|Graphql|Zig|Knoppix x64|retire.js
###HTACCESS:
<IfModule mod_rewrite.c>RewriteCond %{HTTP_USER_AGENT} "(Cypress|Cyberfox|chrome|py|gocolly|colly|Go Colly|OpenWav|eSimpleBrowser|Splash|SlimerJS|SSL/TLS Scan|PhantomJS|RV|Trident/4.0|TrileFejs|X11|Fedora|x11u; linux|X11 Linux|X11; Ubuntu|X11; Ubuntu|Linux|ZombieJS|WOW64|rv:48.0|WhatWeb|Wappalyzer Scan|WordPress Security Scan|
Knoppix x64|retire.js|Greenbone CE 22.04.14|data-requests|TypeScript|Empty TypeScript|Standby TypeScript|Bun|Apache Nutch|ALittle Client|litserve|TLS Fingerprinting|Request Header Fingerprint|JavaScript fingerprint|React| Angular|Vue.js|Graphql|Zig|Knoppix x64|retire.js)" [NC]RewriteRule ^ - [F,L]</IfModule>
::::::::::::::::::::::::::::::::::::::::::::::::::::
....................................................
##SCRAPING TOOLS:
ASM
C#
C
C++
C#
COBOL
Elixir
Go
Java
JavaScript
Kotlin
Lua
Perl
Python
Ruby
Rust
Pip3
CreepJS
SeleniumBase
PowerShell
Cloudscraper
R Selenium
Imperva
Incapsula
Undetected ChromeDriver
Selenium Stealth
Hrequests
Geziyor
Roach PHP
Curl_cffi
Botright
Scrapy Splash
Superagent
Fetch
Watir
Haskell
MechanicalSoup
Jsoup
Nodriver
Node Fetch
OkHttp
AutoScraper
Httpx
Urllib Headers
Curl
Curl Impersonate
Dart
ChromeDriver
Python Lxml
Panther PHP
Goutte PHP
Pyppeteer
Splash
Cheerio
Metasploit
Botasaurus
BBScan
Fetch API
Zig/Javascript
node js
Ruby
cURL
Rust
R
Nutch
LangGraph.js
Grobid
HTTP Toolkit
Golang Scraper
Go Web Scraping
Request-Promise-Native
Unirest
Puppeteer
Osmosis
okhttp
cpp-httplib
Curlpp
Boost.Asio
Selenium
libcurl
Poco
got-scraping
PowerShell
.NET SDK
.NET
Scraper API
HTML
AngleSharp
go-get
Go HTTP
go-away
Raw HTML Scraper
Proxies/API
RESTful API
#PYTHON scrapers:
webscraper.py
scraper.py
#SCRAPER:
Scraper Api
Proxy Scraper
Web Scraper
Image Scraper
Content Crawler
Axios Proxy
Curl Proxy
Python Requests Proxy
Data Scraper
Proxyscrape
Java Web Scraper
Scraper
Scraper /
JS Web Scraper
Python Curl
Instant Data Scraper
#TEST if....
Playwright Test
test.php
#HTML SCRAPING:
HTML Scraper
python-boilerpipe
Boilerpipe's ArticleExtractor
HTMLFetcher
getText
Go HTTP
go-away
..................
##SCRAPING TOOLS:
ASM|C#C|C++|C#|COBOL|Elixir|Go|Java|JavaScript|Kotlin|Lua|Perl|Python|Ruby| Rust|Pip3|CreepJS |SeleniumBase|
PowerShell|Cloudscraper|R Selenium|Imperva|Incapsula|Undetected ChromeDriver|Selenium Stealth|Hrequests|Geziyor|Roach PHP|Curl_cffi|Botright|Scrapy Splash|Superagent|
Fetch|Watir|Haskell|MechanicalSoup|Jsoup|Nodriver|Node Fetch|OkHttp|AutoScraper|Httpx|Urllib Headers|Curl|Curl Impersonate|Dart|ChromeDriver|Python Lxml|
Panther PHP|Goutte PHP|Pyppeteer||Splash|Cheerio|Metasploit|Botasaurus|BBScan|Fetch API|Zig/Javascript|node js|Ruby|cURL|Rust|R|Nutch|LangGraph.js|Grobid|HTTP Toolkit|Golang Scraper|Go Web Scraping|
Request-Promise-Native|Unirest|Puppeteer|Osmosis|okhttp|cpp-httplib|Curlpp|Boost.Asio|Selenium|libcurl|Poco|got-scraping|PowerShell|.NET SDK|.NET|Scraper API|HTML|AngleSharp|
go-get|Go HTTP|go-away|Raw HTML Scraper|Proxies/API|RESTful API|webscraper.py|scraper.py|Scraper Api|Proxy Scraper|Web Scraper|Image Scraper|Content Crawler|Axios Proxy|Curl Proxy|
Python Requests Proxy|Data Scraper|Proxyscrape|Java Web Scraper|Scraper Scraper /|JS Web Scraper|Python Curl|Instant Data Scraper|Playwright Test|test.php|HTML Scraper|
Scraper|python-boilerpipe|Boilerpipe's ArticleExtractor|HTMLFetcher|getText
##HTACCESS:
<IfModule mod_rewrite.c>RewriteCond %{HTTP_USER_AGENT} "(ASM|C#C|C++|C#|COBOL|Elixir|Go|Java|JavaScript|Kotlin|Lua|Perl|Python|Ruby| Rust|Pip3|CreepJS |SeleniumBase|PowerShell|Cloudscraper|R Selenium|Imperva|Incapsula|Undetected ChromeDriver|Selenium Stealth|Hrequests|Geziyor|Roach PHP|Curl_cffi|Botright|Scrapy Splash|Superagent|
Fetch|Watir|Haskell|MechanicalSoup|Jsoup|Nodriver|Node Fetch|OkHttp|AutoScraper|Httpx|Urllib Headers|Curl|Curl Impersonate|Dart|ChromeDriver|Python Lxml|Panther PHP|Goutte PHP|Pyppeteer||Splash|Cheerio|Metasploit|Botasaurus|BBScan|Fetch API|Zig/Javascript|node js|Ruby|cURL|Rust|R|Nutch|LangGraph.js|Grobid|HTTP Toolkit|Golang Scraper|Go Web Scraping|
Request-Promise-Native|Unirest|Puppeteer|Osmosis|okhttp|cpp-httplib|Curlpp|Boost.Asio|Selenium|libcurl|Poco|got-scraping|PowerShell|.NET SDK|.NET|Scraper API|HTML|AngleSharpgo-get|Go HTTP|go-away|Raw HTML Scraper|Proxies/API|RESTful API|webscraper.py|scraper.py|Scraper Api|Proxy Scraper|Web Scraper|Image Scraper|Content Crawler|Axios Proxy|Curl Proxy|
Python Requests Proxy|Data Scraper|Proxyscrape|Java Web Scraper|Scraper Scraper /|JS Web Scraper|Python Curl|Instant Data Scraper|Playwright Test|test.php|HTML Scraper|Scraper|python-boilerpipe|Boilerpipe's ArticleExtractor|HTMLFetcher|getText)" [NC]RewriteRule ^ - [F,L]</IfModule>
::::::::::::::::::::::::::::::::::::::::::::::::::::
....................................................
#OTHERS HACKING:
4D_HTTP_Client
android-async-http
axios
andyhttp
Aplix
akka-http
attohttpc
CakePHP
Cowblog
DAP/NetHTTP
Dispatch
fasthttp
FireEyeHttpScan
Gree_HTTP_Loader
hyp_http_request
HTTPConnect
http generic
Httparty
HTTPing
http-ping
http.rb/
HTTPREAD
Java-http-client
Jodd HTTP
raynette_httprequest
java/
kurl
Laminas_Http_Client
libsoup
lua-resty-http
nghttp2
mio_httpc
Miro-HttpClient
php/
phpscraper
PHX HTTP
PHX HTTP Client
restful
rpm-bot
RxnetHttp
scalaj-http
SP-Http-Client
Stilo OMHTTP
tiehttp
Valve/Steam
WP-URLDetails
# Other CRAP:
Incogniton
Dataskrapa
Dolphin
d3coder
Open port check tool
Proxy SwitchyOmega
Undetectable
lazys3
Webscreenshot
EyeWitness
Nuclei
SQLNinja
# Login (web):
GoLogin
MoreLogin
MultiLogin
#Fingerprinting:
JA3 Fingerprint
HTTP/2 fingerprint
PHP cURL
HackBar
Wappalyzer
Site Spider, Mark II
Cache killer
Open port check tool
Request maker
Proxy SwitchyOmega
Note anywhere
d3coder
Tamper Data
Data Scraper
Invicti
WebInspect
Netsparker
Intruder
John the Ripper
LiveAction
Zenmap
Crt.sh
GreyNoise
ZoomEye
Censys
Hunter
DIRB
Metasploitable 2
meterpreter
#Connection with your site:
Java's HttpUrlConnection
Node.js /Blocked by Perrishpress - my own with AI:
https://scrapeops.io/nodejs-web-scraping-playbook/nodejs-fake-user-agents/
URL: https://github.com/particle-iot/node-simplecrawler
User-agent: Node/simplecrawler
# https://www.zenrows.com/blog/gospider
How to Use GoSpider for Web Crawling
# https://www.zenrows.com/blog/pyspider
How to Use Pyspider for Web Crawling?
https://www.zenrows.com/blog/stormcrawler
StormCrawler
StormCrawler
GoSpider
#Other tools:
TLS /
JA3
JA3S
JA3 Realism
JA3 Fingerprinting
JARM
.....................
#OTHERS HACKING:
4D_HTTP_Client|android-async-http|axios|andyhttp|Aplix|akka-http|attohttpc|CakePHP|Cowblog|DAP/NetHTTP|Dispatch|fasthttp|FireEyeHttpScan|Gree_HTTP_Loader|
hyp_http_request|HTTPConnect|http generic|Httparty|HTTPing|http-ping|http.rb/|HTTPREAD|Java-http-client|Jodd HTTP|raynette_httprequest|java/|
kurl|Laminas_Http_Client|libsoup|lua-resty-http|nghttp2|mio_httpc|Miro-HttpClient|php/|phpscraper|PHX HTTP|PHX HTTP Client|restful|rpm-bot|
TLS /| JA3|JA3S|JA3 Realism|JA3 Fingerprinting|JARM|StormCrawler|GoSpider|Node/simplecrawler|
RxnetHttp|scalaj-http|SP-Http-Client|Stilo OMHTTP|tiehttp|Valve/Steam|WP-URLDetails|Incogniton|Dataskrapa|Dolphin|d3coder|Open port check tool|
Proxy SwitchyOmega| Undetectable|lazys3|Webscreenshot|EyeWitness|Nuclei|SQLNinja|GoLogin|MoreLogin|MultiLogin|JA3 Fingerprint|HTTP/2 fingerprint|PHP cURL|
HackBar|Wappalyzer|Cache killer|Open port check tool|Request maker|Proxy SwitchyOmega|Note anywhere|d3coder|Tamper Data|Data Scraper|Invicti|WebInspect|
Netsparker|Intruder|John the Ripper|LiveAction|Zenmap|Crt.sh|GreyNoise|ZoomEye|Censys|Hunter|DIRB|Metasploitable 2|meterpreter|Java's HttpUrlConnection
##HTACCESS:
<IfModule mod_rewrite.c>RewriteCond %{HTTP_USER_AGENT} "(4D_HTTP_Client|android-async-http|axios|andyhttp|Aplix|akka-http|attohttpc|CakePHP|Cowblog|DAP/NetHTTP|Dispatch|fasthttp|FireEyeHttpScan|Gree_HTTP_Loader|hyp_http_request|HTTPConnect|http generic|Httparty|HTTPing|http-ping|http.rb/|HTTPREAD|Java-http-client|Jodd HTTP|raynette_httprequest|java/|
kurl|Laminas_Http_Client|libsoup|lua-resty-http|nghttp2|mio_httpc|Miro-HttpClient|php/|phpscraper|PHX HTTP|PHX HTTP Client|restful|rpm-bot|TLS /| JA3|JA3S|JA3 Realism|JA3 Fingerprinting|JARM|StormCrawler|GoSpider|Node/simplecrawler|
RxnetHttp|scalaj-http|SP-Http-Client|Stilo OMHTTP|tiehttp|Valve/Steam|WP-URLDetails|Incogniton|Dataskrapa|Dolphin|d3coder|Open port check tool|Proxy SwitchyOmega| Undetectable|lazys3|Webscreenshot|EyeWitness|Nuclei|SQLNinja|GoLogin|MoreLogin|MultiLogin|JA3 Fingerprint|HTTP/2 fingerprint|PHP cURL|
HackBar|Wappalyzer|Cache killer|Open port check tool|Request maker|Proxy SwitchyOmega|Note anywhere|d3coder|Tamper Data|Data Scraper|Invicti|WebInspect|Netsparker|Intruder|John the Ripper|LiveAction|Zenmap|Crt.sh|GreyNoise|ZoomEye|Censys|Hunter|DIRB|Metasploitable 2|meterpreter|Java's HttpUrlConnection)" [NC]RewriteRule ^ - [F,L]</IfModule>
:::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
.............................................................
#UNDTECTIBLE
Chromedriver|undetected\chromedriver|Chrome\Undetectable|Edge\Undetectable|Undetectable\Browser|undetectable-fingerprint-browser|Firefox/User-Agent Switcher|File Viewer|NET CLR|PhantomJsCloud|Quark|MALNJS|RV:10 UBrowser|SM-J111F
Firefox/User-Agent Switcher
##HTACCESS:
<IfModule mod_rewrite.c>RewriteCond %{HTTP_USER_AGENT} "(Chromedriver|undetected\chromedriver|Chrome\Undetectable|Edge\Undetectable|Undetectable\Browser|undetectable-fingerprint-browser|Firefox/User-Agent Switcher|File Viewer|NET CLR|PhantomJsCloud|Quark|MALNJS|RV:10 UBrowser|SM-J111FFirefox/User-Agent Switcher)" [NC]RewriteRule ^ - [F,L]</IfModule>
:::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
.............................................................
#PROXY BLOCKING:
AI proxy|API Proxy|HTTP Proxies|forward proxy|Server proxies|residential proxies|reverse proxy|proxy request|http-proxy|IPv4 Proxies|IPv6 Proxies|Mobile Proxies|Virgin proxies|Proxy Servers|sproxies|Static ISP Proxies
|ISP Proxies|proxy|VPN/Proxy|Proxies|Virgin proxies|Proxy Servers|SeaMonkey|sproxies|Static ISP Proxies|ISP Proxies|proxy|VPN|Proxies
##HTACCESS:
<IfModule mod_rewrite.c>RewriteCond %{HTTP_USER_AGENT} "(AI proxy|API Proxy|HTTP Proxies|forward proxy|Server proxies|residential proxies|reverse proxy|proxy request|http-proxy|IPv4 Proxies|IPv6 Proxies|Mobile Proxies|Virgin proxies|Proxy Servers|sproxies|Static ISP Proxies
|ISP Proxies|proxy|VPN/Proxy|Proxies|Virgin proxies|Proxy Servers|SeaMonkey|sproxies|Static ISP Proxies|ISP Proxies|proxy|VPN|Proxies)" [NC]RewriteRule ^ - [F,L]</IfModule>
:::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
.............................................................
#DANGEROUS PORT SCANNERS
Noxious
Nuisible
вредоносный Host
#others:
Advanced IP Scanner
Angry IP Scanner
ACK Scan
Null scan
FIN scan
NetCat
TCP SYN Scans
TCP Connect Scan
UDP Scanning
Xmas scan
##HTACCESS:
<IfModule mod_rewrite.c>RewriteCond %{HTTP_USER_AGENT} "(Noxious|Nuisible|вредоносный Host|Advanced IP Scanner|Angry IP Scanner|ACK Scan|Null scan|FIN scan|NetCat|TCP SYN Scans|TCP Connect Scan|UDP Scanning|Xmas scan)" [NC]RewriteRule ^ - [F,L]</IfModule>
:::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
.............................................................
#OTHER SCRAPING:
GoogleAppsScript|dirbuster|gobuster|ffuf|dirsearch|nmap|zmap|angry.ip|ipscan|nucleinikto|nessus|openvas|acunetix|wpscanNmap XML Parser|laravel|PHP\ Scraper|PHP\ web\ crawler
##HTACCESS:
<IfModule mod_rewrite.c>RewriteCond %{HTTP_USER_AGENT} "(GoogleAppsScript|dirbuster|gobuster|ffuf|dirsearch|nmap|zmap|angry.ip|ipscan|nucleinikto|nessus|openvas|acunetix|wpscanNmap XML Parser|laravel|PHP\ Scraper|PHP\ web\ crawler)" [NC]RewriteRule ^ - [F,L]</IfModule>
:::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
.............................................................
###SCRIPSS TO USE FOR BLOCKING:: #####
# Common way:
<IfModule mod_rewrite.c>
RewriteCond%{HTTP_USER_AGENT}( )[NC,OR]
RewriteCond%{HTTP_USER_AGENT}( )[NC,OR]
RewriteCond%{HTTP_USER_AGENT}( )[NC,OR]
RewriteCond%{HTTP_USER_AGENT}( )[NC,OR]
RewriteCond%{HTTP_USER_AGENT}( )[NC]
RewriteRule (.*) - [F,L]</IfModule>
#Alternative:
<IfModule mod_rewrite.c>
RewriteCond%{HTTP_USER_AGENT}"(PLACE THE RAW FILE HERE)"[NC]
RewriteRule "^.*$" - [F]</IfModule>
##IUSE THIS:
<IfModule mod_rewrite.c>RewriteCond %{HTTP_USER_AGENT} "( MY LIST HERE)" [NC]RewriteRule ^ - [F,L]</IfModule>
:::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
.............................................................
#ALTERNATIVE TO USE:
============================================================================
<IfModule mod_setenvif.c>
# Block generic headless browser identifiers
SetEnvIf User-Agent "^Headless" BLOCK_HEADLESS
SetEnvIf User-Agent "^Headful" BLOCK_HEADLESS
SetEnvIf User-Agent "^Headless Chromium" BLOCK_HEADLESS
SetEnvIf User-Agent "^HeadlessChrome" BLOCK_HEADLESS
SetEnvIf User-Agent "^Firefox Headless" BLOCK_HEADLESS
SetEnvIf User-Agent "^Headless Linux" BLOCK_HEADLESS
# Block Selenium-based browsers (automation framework)
SetEnvIf User-Agent "selenium:headless:chromium" BLOCK_SELENIUM
SetEnvIf User-Agent "selenium:headful:chromium" BLOCK_SELENIUM
SetEnvIf User-Agent "selenium:headless:firefox" BLOCK_SELENIUM
SetEnvIf User-Agent "selenium:headful:firefox" BLOCK_SELENIUM
# Block Playwright-based browsers (automation framework)
SetEnvIf User-Agent "playwright:headless:chromium" BLOCK_PLAYWRIGHT
SetEnvIf User-Agent "playwright:headful:chromium" BLOCK_PLAYWRIGHT
SetEnvIf User-Agent "playwright:headless:firefox" BLOCK_PLAYWRIGHT
SetEnvIf User-Agent "playwright:headful:firefox" BLOCK_PLAYWRIGHT
SetEnvIf User-Agent "PlaywrightPython" BLOCK_PLAYWRIGHT
# Block Selenium Stealth and similar anti-detection tools
SetEnvIf User-Agent "Selenium Stealth" BLOCK_STEALTH
# Block Splash Lua browser (JavaScript rendering scraper)
SetEnvIf User-Agent "Splash/Lua" BLOCK_SPLASH
# Block HtmlUnit Java browser
SetEnvIf User-Agent "HtmlUnit/Java" BLOCK_HTMLUNIT
# Block Chromedp Go library (headless Chrome automation)
SetEnvIf User-Agent "Chromedp /Golang" BLOCK_CHROMEDP
# Block Cypress testing framework
SetEnvIf User-Agent "Cypress /JavaScript" BLOCK_CYPRESS
SetEnvIf User-Agent "^Cypress$" BLOCK_CYPRESS
# Block Nimble Browser
SetEnvIf User-Agent "Nimble Browser" BLOCK_NIMBLE
# Block CasperJS (headless PhantomJS wrapper)
SetEnvIf User-Agent "CasperJS" BLOCK_CASPER
SetEnvIf User-Agent "casperJS" BLOCK_CASPER
# Block cdp4j (Chrome DevTools Protocol Java library)
SetEnvIf User-Agent "cdp4j" BLOCK_CDP4J
# Block Chrome PHP
SetEnvIf User-Agent "Chrome PHP" BLOCK_CHROME_PHP
# Block Chromeless
SetEnvIf User-Agent "Chromeless" BLOCK_CHROMELESS
# Block Chrome Remote Interface
SetEnvIf User-Agent "Chrome-remote-interface" BLOCK_CHROME_REMOTE
# Block various Chromium variants
SetEnvIf User-Agent "Chromium drivers" BLOCK_CHROMIUM
SetEnvIf User-Agent "Chromium Embedded" BLOCK_CHROMIUM
# Block Ghost.py
SetEnvIf User-Agent "ghost.py" BLOCK_GHOST
# Block Horseman (Node.js headless browser)
SetEnvIf User-Agent "Horseman" BLOCK_HORSEMAN
# Block Jabba-Webkit
SetEnvIf User-Agent "Jabba-Webkit" BLOCK_JABBA
# Block Jasmine-Headless-Webkit
SetEnvIf User-Agent "Jasmine-Headless-Webkit" BLOCK_JASMINE
# Block Jaunt
SetEnvIf User-Agent "Jaunt" BLOCK_JAUNT
# Block jBrowserDriver
SetEnvIf User-Agent "jBrowserDriver" BLOCK_JBROWSER
# Block Litium headless
SetEnvIf User-Agent "Litium headless" BLOCK_LITIUM
# Block MechanicalSoup
SetEnvIf User-Agent "MechanicalSoup" BLOCK_MECHANICALSOUP
# Block Nightmare
SetEnvIf User-Agent "Nightmare" BLOCK_NIGHTMARE
# Block PhantomJS and variants
SetEnvIf User-Agent "PhantomJS" BLOCK_PHANTOM
SetEnvIf User-Agent "PhantomJS drivers" BLOCK_PHANTOM
SetEnvIf User-Agent "phantompy" BLOCK_PHANTOM
SetEnvIf User-Agent "PhantomJsCloud" BLOCK_PHANTOM
# Block Puppeteer variants
SetEnvIf User-Agent "Puppeteer" BLOCK_PUPPETEER
SetEnvIf User-Agent "Puppeteer Sharp" BLOCK_PUPPETEER
# Block SlimerJS (Gecko-based headless browser)
SetEnvIf User-Agent "SlimerJS" BLOCK_SLIMER
# Block SpecterJS
SetEnvIf User-Agent "SpecterJS" BLOCK_SPECTER
# Block Splash Browser
SetEnvIf User-Agent "Splash Browser" BLOCK_SPLASH_BROWSER
SetEnvIf User-Agent "^Splash$" BLOCK_SPLASH_BROWSER
# Block Splinter
SetEnvIf User-Agent "Splinter" BLOCK_SPLINTER
# Block Spynner
SetEnvIf User-Agent "Spynner" BLOCK_SPYNNER
# Block SST (Simple State Tester)
SetEnvIf User-Agent "SST" BLOCK_SST
# Block trifleJS
SetEnvIf User-Agent "trifleJS" BLOCK_TRIFLE
# Block Twill
SetEnvIf User-Agent "twill" BLOCK_TWILL
# Block WATIR variants
SetEnvIf User-Agent "WatiN" BLOCK_WATIN
SetEnvIf User-Agent "Watir" BLOCK_WATIR
SetEnvIf User-Agent "Watir-WebDriver" BLOCK_WATIR
# Block Webloop
SetEnvIf User-Agent "Webloop" BLOCK_WEBLOOP
# Block Wendigo
SetEnvIf User-Agent "Wendigo" BLOCK_WENDIGO
# Block wkhtmltopdf (PDF generator often used for scraping)
SetEnvIf User-Agent "wkhtmltopdf" BLOCK_WKHTMLTOPDF
# Block WKZombie
SetEnvIf User-Agent "WKZombie" BLOCK_WKZOMBIE
# Block X-RAY
SetEnvIf User-Agent "X-RAY" BLOCK_XRAY
# Block Zombie.js
SetEnvIf User-Agent "Zombie.js" BLOCK_ZOMBIE
# Block benv (browser environment)
SetEnvIf User-Agent "benv" BLOCK_BENV
# Block Browserjet
SetEnvIf User-Agent "Browserjet" BLOCK_BROWSERJET
# Block BrowserKit
SetEnvIf User-Agent "BrowserKit" BLOCK_BROWSERKIT
# Block browser-launcher
SetEnvIf User-Agent "browser-launcher" BLOCK_BROWSER_LAUNCHER
# Block browser.rb
SetEnvIf User-Agent "browser.rb" BLOCK_BROWSER_RB
# Block DalekJS
SetEnvIf User-Agent "DalekJS" BLOCK_DALEK
# Block DamonJS
SetEnvIf User-Agent "DamonJS" BLOCK_DAMON
# Block Erik
SetEnvIf User-Agent "Erik" BLOCK_ERIK
# Block Geb
SetEnvIf User-Agent "Geb" BLOCK_GEB
# Block Ghostbuster
SetEnvIf User-Agent "Ghostbuster" BLOCK_GHOSTBUSTER
# Block Grope
SetEnvIf User-Agent "Grope" BLOCK_GROPE
SetEnvIf User-Agent "grope" BLOCK_GROPE
# Block Guillotine
SetEnvIf User-Agent "Guillotine" BLOCK_GUILLOTINE
# Block Headless Edge
SetEnvIf User-Agent "Headless Edge" BLOCK_HEADLESS_EDGE
# Block Headless Firefox
SetEnvIf User-Agent "Headless Firefox" BLOCK_HEADLESS_FF
SetEnvIf User-Agent "HeadlessBrowser" BLOCK_HEADLESS_BROWSER
# Block Lotte
SetEnvIf User-Agent "Lotte" BLOCK_LOTTE
# Block Miro-HttpClient
SetEnvIf User-Agent "Miro-HttpClient" BLOCK_MIRO
# Block RoboBrowser
SetEnvIf User-Agent "RoboBrowser" BLOCK_ROBOG
# Block stanislaw
SetEnvIf User-Agent "stanislaw" BLOCK_STANISLAW
# Block Surf
SetEnvIf User-Agent "Surf" BLOCK_SURF
# Block Anglesharp
SetEnvIf User-Agent "AngleSharp" BLOCK_ANGLESHARP
# Block Awesomium
SetEnvIf User-Agent "Awesomium" BLOCK_AWESOMIUM
# ============================================================================
# SECTION 3: BLOCK TOR AND ANONYMIZING TOOLS
# These rules block Tor browser, anonymizers, and privacy-evading tools
# ============================================================================
# Block Tor Browser
SetEnvIf User-Agent "TOR browser" BLOCK_TOR
SetEnvIf User-Agent "tor" BLOCK_TOR
SetEnvIf User-Agent "TOR" BLOCK_TOR
SetEnvIf User-Agent "TOR Exit Nodes" BLOCK_TOR
# Block Tor2Web and Onion links access