{"id":220,"date":"2018-09-26T16:11:56","date_gmt":"2018-09-26T16:11:56","guid":{"rendered":"https:\/\/www.endurantdevs.com\/blog\/?p=220"},"modified":"2018-09-26T16:16:05","modified_gmt":"2018-09-26T16:16:05","slug":"small-update-about-botstat-seo","status":"publish","type":"post","link":"https:\/\/www.endurantdev.com\/blog\/small-update-about-botstat-seo\/","title":{"rendered":"Small update about BotStat SEO"},"content":{"rendered":"

There was a time when we needed to detect Google’s crawl rate faster than webmaster tools allowed to check. I was telling about the small re-incarnation of the\u00a0BotStat<\/a>\u00a0idea using Python. The initial post was\u00a0here<\/a>. Right now it works for Nginx and Apache with detecting your access logs formats automatically (could be set manually through a command line or config file if we fail).<\/p>\n

For instance, having this run by cron may give you a fresh report every morning when you come to your office. We tested it on a few WordPress instances of our friends’ blogs also.<\/p>\n

It is good when you get results raw (in CSV). However, there is always a chance to use Excel with graphs if you’re managing your resource actively and need to compare data. So, we just released the updated version where you can get a report as excel file with some graphs in common colors.<\/p>\n

Also, filters from the “Data” sheet influence on charts. We’re working on multi-line graphs for Bot stats, so, for now, it is better to set filtering to one bot\/one domain \ud83d\ude42<\/p>\n

<\/div>\n

There are simple three graphs from webmaster tools: Pages per day, KBytes per day and Average response time in milliseconds.<\/p>\n

<\/div>\n
<\/div>\n
<\/div>\n

However, additionally to this, it was always interesting how much time does Google or other search engine bot spend on your website entirely on a daily basis:<\/p>\n

<\/div>\n

Comparing trends of this few charts may give you some info \ud83d\ude42<\/p>\n

You can always check it out from Github:\u00a0https:\/\/github.com\/EndurantDevs\/botstat-seo<\/a><\/p>\n

Or install BotStat tool using pip:<\/p>\n

pip install<\/span> botstat\r\n<\/pre>\n
Good luck with\u00a0your site SEO!<\/p>\n","protected":false},"excerpt":{"rendered":"
There was a time when we needed to detect Google’s crawl rate faster than webmaster tools allowed to check. I was telling about the small re-incarnation of the\u00a0BotStat\u00a0idea using Python. The initial post was\u00a0here. Right now it works for Nginx and Apache with detecting your access logs formats automatically (could…<\/p>\n","protected":false},"author":1,"featured_media":223,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[2,3],"tags":[32,24,25],"class_list":["post-220","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-business","category-product","tag-botstat","tag-python","tag-seo"],"amp_enabled":true,"_links":{"self":[{"href":"https:\/\/www.endurantdev.com\/blog\/wp-json\/wp\/v2\/posts\/220","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.endurantdev.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.endurantdev.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.endurantdev.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.endurantdev.com\/blog\/wp-json\/wp\/v2\/comments?post=220"}],"version-history":[{"count":2,"href":"https:\/\/www.endurantdev.com\/blog\/wp-json\/wp\/v2\/posts\/220\/revisions"}],"predecessor-version":[{"id":222,"href":"https:\/\/www.endurantdev.com\/blog\/wp-json\/wp\/v2\/posts\/220\/revisions\/222"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.endurantdev.com\/blog\/wp-json\/wp\/v2\/media\/223"}],"wp:attachment":[{"href":"https:\/\/www.endurantdev.com\/blog\/wp-json\/wp\/v2\/media?parent=220"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.endurantdev.com\/blog\/wp-json\/wp\/v2\/categories?post=220"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.endurantdev.com\/blog\/wp-json\/wp\/v2\/tags?post=220"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}