Robots - KnightCTF 2022
To solve this challenge, follow these steps:
- Open the .pcap file in Wireshark.
- Search for the string "robots.txt".
- Follow the corresponding TCP stream.
- In the TCP stream, look for the "Disallow" directive, which will indicate a specific path.