Hi Nick

Thanks, I did not even know there was a command line fail2ban-regex testing tool ... duh.. can't believe I missed that. So much quicker than actually waiting for something to appear in logs. Thanks for the pointer.

As a heads up my original regex ^<HOST> \- \S+ \[.*] \"[\\]+.* works 100% when I ran it with the command line testing tool. I can't believe I actually managed to figure out my first regex all on my own, I guess I did actually learn something from http://regexone.com/

So this regex could be added to the existing nginx-botsearch.conf file or could be added into a separate filter. Not sure I want to be blacklisting their research IP at Berkeley though.

I got this reply this morning from Bill Marczak at Berkeley.

"
Hello Mitchell,

We're measuring a particular Internet phenomenon where servers reply to randomly generated packets. We are sending these benign packets to every public IP address on the Internet, and are not targeting your IP's specifically.

If you'd like us to exclude your network from future scans, please send us a CIDR prefix and we will blacklist it immediately.

Thanks,
-Bill"




On 2016/07/08 6:06 PM, Nick Howitt wrote:
^<HOST> \- \- .*(\\x.*){10,} 400 166 \"\-\" \"\-\"$ would work to pick up on the leading ' - - ', at least 10 "\x" and trailing ' 400 166 "-" "-"'. I am not particularly happy with it. I'm sure you can do better with the date and and the sequence of "\x"'s

Have you seen how to test a regex with fail2ban-regex?

Nick

On 08/07/2016 15:14, Mitchell Krog wrote:
169.229.3.91 - - [06/Jul/2016:10:26:00 +0200] "\xF1)1\xB0\x0E\xD6\xCEOSb`\xE3E\x90\xE1A\xB3\x7F\x8C\x0B\x02\xBF\x05RN\xD0\x87\x8F%=\x83(\x16\x9A\xDF5\x1D\xC8\x81<\x80l\xC6\xD8\xCD9\xA0\xE9\xDF~\xCEC\xFB\xF0\xCB\xB5\xD2\x85I\xAAVT\x98F" 400 166 "-" "-"



------------------------------------------------------------------------------
Attend Shape: An AT&T Tech Expo July 15-16. Meet us at AT&T Park in San
Francisco, CA to explore cutting-edge tech and listen to tech luminaries
present their vision of the future. This family event has something for
everyone, including kids. Get more information and register today.
http://sdm.link/attshape
_______________________________________________
Fail2ban-users mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/fail2ban-users

Reply via email to