Comments on 2019-06-25 Bots rule the web

@wion pointed me to Blocking robots on your web page – the list of 1800 bad bots which is a regular expression to match user agents and block them from your .htaccess file.

One the one hand, wow! So much block! On the other hand, reading the comments it is obvious that there will be the occasional false positive in that list, and that make me wary, and weary.

– Alex Schroeder 2019-06-26 06:45 UTC


Please make sure you contribute only your own work, or work licensed under the GNU Free Documentation License. Note: in order to facilitate peer review and fight vandalism, we will store your IP number for a number of days. See Privacy Policy for more information. See Info for text formatting rules. You can edit this page if you need to fix typos. You can subscribe to updates by email without leaving a comment.

To save this page you must answer this question:

Please say HELLO.