* Dani?l Mantione <[EMAIL PROTECTED]> [070220 16:29]: > Hi! > > Unfortunately I your program is causing harm on our web server > (www.freepascal.org). This is going on for three months now, putting our > web server under heavy load:
This is not my program that is causing a problem, it is a user that is causing a problem. If it was wget that was used to get the page, would you claim that wget is buggy? > I would like to ask you two things: > * Is there anything on my web server I can do to stop your program making > requests? You cannot really stop the program, it is not under my or your control. What you can do is try to get to the user of the program who misuses the program. The simple way to do it is to provide him with a changed page that says the at he misuses the program and causes a high load on your server, since it is a user that is interested in yuor project he is more than likely to amend his ways. If he wanted to DoS you there are better tools for that. You can use Apache rules to rewrite the page results for this IP range (since iti s a dynamic IP a single IP is not sufficient) and for a few days give the user a different page with the message to change his setup. I recommend changing this redirected page every 15 minutes with a random string so that the websec program will notice the change and send the user a message every 15 minutes about the page change. I had an overzealous user in the past who did check faster than once a minute and this tactic worked (after a while). > * Can future versions support robots.txt? No. This program is not intended as a robot, it does not crawl unattended, it runs at very specific times set by the user in his cronjob and only for specific pages. Obviously, and as you experience, this can be misused, but so does a plain wget and wget doesn't honor robots.txt either. I'm sorry for the trouble but your complaint is misdirected. If you still need help with the apache setup I'll be willing to help to the best of my capacity, but the above explanation should be a good start. Baruch -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]
