 Matt Baer
|
d9bfef1071
|
Add Friendica as bot
|
2018-08-10 16:46:02 -04:00 |
|
|
Matt Baer
|
7182ec7db1
|
Add hackney as bot
|
2018-08-08 16:03:14 -04:00 |
|
|
Matt Baer
|
582ab04ab5
|
Move explicit bot UA string tests to prefix tests
Also look for python-requests/*
|
2018-08-04 17:28:29 +02:00 |
|
|
Matt Baer
|
25bf5066c6
|
Remove http.rb version numbers from bots test
|
2018-07-04 16:50:43 -04:00 |
|
 Matt Baer
|
5c3827dc76
|
Mark empty User-Agent strings as bots
|
2017-09-28 17:20:32 -04:00 |
|
|
Matt Baer
|
e082f1e402
|
Mark PHP clients as bots
|
2017-09-28 17:19:51 -04:00 |
|
|
Matt Baer
|
47655b3e66
|
Mark Mastodon clients as bot
|
2017-09-23 14:04:00 -04:00 |
|
 Matt Baer
|
ba5dc7067e
|
Add recent bots
|
2016-06-25 11:20:58 -04:00 |
|
|
Matt Baer
|
da1d3d898c
|
Add spiders, scrapers, indexers; update bots
|
2015-08-17 15:21:43 -04:00 |
|
|
Matt Baer
|
a4eeea7469
|
Add new Mail.RU_Bot, OpsBot, Wotbox
|
2015-07-29 15:09:57 -04:00 |
|
|
Matt Baer
|
cf23d08df8
|
Add new TelegramBot and Domain Re-Animator Bot
|
2015-07-17 10:41:44 -04:00 |
|
|
Matt Baer
|
5ad0664e7e
|
Add woriobot and zitebot
|
2015-07-07 20:02:39 -04:00 |
|
|
Matt Baer
|
b9838662f8
|
Merge branch 'master' of https://github.com/writeas/web-core
|
2015-07-07 19:57:56 -04:00 |
|
|
Matt Baer
|
d01e265587
|
Add bots documentation
|
2015-07-07 02:35:17 -04:00 |
|
|
Matt Baer
|
5ce4115c4f
|
Add more crawlers, bots, and voltron to bots map
|
2015-07-01 17:08:43 -04:00 |
|
|
Matt Baer
|
d2454e8900
|
Add bots component
Include generation script for extracting bots from server logs
|
2015-06-28 18:22:40 -04:00 |
|