• We just launched and are currently in beta. Join us as we build and grow the community.

SourceWolf – A CLI Web Crawler

BenjiTM

Next-Gen Tech Pioneer
B Rep
0
0
0
Rep
0
B Vouches
0
0
0
Vouches
0
Posts
50
Likes
39
Bits
2 MONTHS
2 2 MONTHS OF SERVICE
LEVEL 1 500 XP
Modern-Yellow-Icon-Advertising-Presentation-Report.png


Hey Folks, as we know that often we add sitemap in website to index the content of websites all across the Internet and simply crawlers take the “sitemap.xml” file from the web application and give us the result. But some crawlers are used to find hidden files or directories in web applications. Almost all web application crawlers work the same way and the one we are going to talk about today works like any other.

Lets take a look 🙂 !!

Installation

To configure this tool we have to download it from github. Execute the pipe command after going to the directory and install the requirements of this tool.

git clone https://github.com/micha3lb3n/SourceWolf.git
cd SourceWolf/
pip3 install -r requirements.txt123git clone
https://github.com/micha3lb3n/SourceWolf.gitcd SourceWolf/pip3 install-rrequirements.txt

1-28.png


Ready 🙂 Nowwe can use this tool by using the following command.

python3 sourcewolf.py1python3 sourcewolf.py

2-29.png

Usage

Now first of all we add only URL parameters to our search and we get the following response from this tool which shows that URL is can be access.

python3 sourcewolf.py --url http://192.168.1.7/wp-admin1python3 sourcewolf.py--url http://192.168.1.7/wp-admin

3-29.png

Bruteforce

Only through this technique we can obtain sensitive information, files and directory in web application such as robots.txt. The use of this tool is quite specific as you can see below that we add the FUZZ keyword after the URL which is required for fuzzing against a web application.

python3 sourcewolf.py -b http://192.168.1.7/FUZZ1python3 sourcewolf.py-b

4-28.png


The results will come with all response code because we have not added any extra parameters to the query.

5-25.png

Verbose

Verbose mode exists to visualize additional details as well as it give us the details of what the tool is doing.

python3 sourcewolf.py -b http://192.168.1.7/FUZZ -v1python3 sourcewolf.py-b
http://192.168.1.7/FUZZ -v

6-25.png

Wordlist

Most of the time we uses our own custom list to find the hidden files in web application and if you are find this feature in this tool then you see below.

python3 sourcewolf.py -b http://192.168.1.7/FUZZ -w wordlist.txt1python3 sourcewolf.py-b
http://192.168.1.7/FUZZ -w wordlist.txt

7-22.png

Output

The Ouput option is not only available to save results, it also gives us additional features after complete the crawling.

python3 sourcewolf.py -b http://192.168.1.7/FUZZ -o ok1python3 sourcewolf.py-b
http://192.168.1.7/FUZZ -o ok

8-19.png


Below you can see that it also give us the juicy stuff from the source code.

9-19.png


As you can see it has successfully captured social media and JavaScript variables.

10-18.png


After going to the output directory, we can see the result as you can see below.

11-17.png
About the AuthorShubham Goyal Certified Ethical Hacker, information security analyst, penetration tester and researcher. Can be Contact on Linkedin.
 

431,395

312,441

312,450

Top