| Current Forum: Homework 5 - Parts 1 and 2 |
| Date: Fri Nov 16 2001 9:18 am |
| Author: Ghosh, Debmallo S. <dsghosh@cmu.edu> |
| Subject: ftp: and https: URLs? |
|
|
| From my tests, it appears that our spider cannot read ftp: or https: URLs, and of course it cannot follow mailto: links. Does this mean that we should only add http: URLs to our queue? I have already implemented it this way, and now I'm looking for justification. :-) |
|