I also have problem when specifying a port number in an URL?
If I enclose the URL with quotes:
start_url: "http://irsun30:2000/phpTools/test.html"
htdig -i -vvv answer is:
1:0:"http://irsun30:2000/phpTools/test.html"
New server: irsun30, 2000
Retrieval command for http://irsun30:2000/robots.txt:
GET /robots.txt HTTP/1.0
User-Agent: htdig/3.1.4 ([EMAIL PROTECTED])
Host: irsun30
Header line: HTTP/1.1 404 Not Found
Header line: Date: Tue, 08 Feb 2000 17:59:40
GMT
Header line: Server: Apache/1.3.6 (Unix) PHP/3.0.12
Header line: Connection: close
Header line: Content-Type: text/html
Header line:
returnStatus = 1
pushed
pick: irsun30, # servers = 1
0:0:0:"http://irsun30:2000/phpTools/test.html":
Retrieval command for "http://irsun30:2000/phpTools/test.html": GET /phpTools/test.html"
HTTP/1.0
User-Agent: htdig/3.1.4 ([EMAIL PROTECTED])
Host: irsun30
Header line: HTTP/1.1 404 Not Found
Header line: Date: Tue, 08 Feb 2000 17:59:40
GMT
Header line: Server: Apache/1.3.6 (Unix) PHP/3.0.12
Header line: Connection: close
Header line: Content-Type: text/html
Header line:
returnStatus = 1
not found
pick: irsun30, # servers = 1
If I do not use quotes, my start-url is
start-url: http://irsun30:2000/phpTools/test.html
part of the htdig -i -vvv answer is
1:1:1:http://irsun30:2000/phpTools/general/NewLib.php3:
Retrieval command for http://irsun30:2000/phpTools/general/NewLib.php3:
GET /phpTools/general/NewLib.php3 HTTP/1.0
User-Agent: htdig/3.1.4 ([EMAIL PROTECTED])
Referer: http://irsun30:2000/phpTools/test.html
Host: irsun30
Header line: HTTP/1.1 302 Found
Header line: Date: Tue, 08 Feb 2000 17:49:06
GMT
Header line: Server: Apache/1.3.6 (Unix) PHP/3.0.12
Header line: Status: 302 Moved Temporarily
Header line: Location: http://irsun30/phpTools/general/NewLib.php3?Example_Session=7f46269014da2c57f6bbde04328fced5
Header line: Set-Cookie: Example_Session=7f46269014da2c57f6bbde04328fced5;
path=/
Header line: Connection: close
Header line: Content-Type: text/html
Header line:
returnStatus = 3
redirect
redirect: http://irsun30/phpTools/general/NewLib.php3?Example_Session=7f46269014da2c57f6bbde04328fced5
Rejected: URL not in the limits!pick: irsun30, # servers = 1
I do not know what to do?
