Changes for version v0.1.2 - 2018-11-06

  • Enhancements
    • Added rules for Embedly, Exabot, LinkedIn, Mojeek, Naver/Yeti, Pinterest, Sogou spiders.
  • Documentation
    • Fixed typo.
    • Added note about limitations.
  • Other
    • Sorted robots.

Modules

validate IP addresses are associated with known robots