Web Reconnaissance
Challenge Gallery
Quick Reference
| Command | What It Does |
|---|---|
curl https://example.com |
Fetch page content |
curl -I https://example.com |
Fetch headers only |
curl -v https://example.com |
Verbose (full request/response) |
curl -A "Googlebot" https://example.com |
Spoof User-Agent |
curl -b "session=abc" https://example.com |
Send a cookie |
curl -o page.html https://example.com |
Save to file |
curl -s https://example.com/robots.txt |
Fetch robots.txt (silent) |
wget -r https://example.com |
Mirror a website recursively |
gobuster dir -u https://example.com -w wordlist.txt |
Directory brute-force |
HTTP Status Codes
| Code | Meaning | Recon Value |
|---|---|---|
| 200 | OK | Resource exists and is accessible |
| 301 | Moved Permanently | Redirect — follow it to find the new location |
| 302 | Found (Temporary Redirect) | Often used for login redirects |
| 403 | Forbidden | Resource exists but access is denied — worth probing further |
| 404 | Not Found | Resource does not exist |
| 500 | Internal Server Error | Server-side bug — may reveal stack traces |
| 502 | Bad Gateway | Reverse proxy cannot reach the backend |
| 503 | Service Unavailable | Server overloaded or in maintenance |
Key Files to Check
| Path | Why |
|---|---|
/robots.txt |
Lists paths hidden from search engines |
/sitemap.xml |
Complete map of all intended public pages |
/.git/ |
Exposed Git repo — download with git-dumper |
/.env |
Environment variables (DB creds, API keys) |
/wp-login.php |
WordPress login — reveals CMS |
/server-status |
Apache status page (if enabled) |
/phpinfo.php |
Full PHP configuration dump |