Back to All

2016-05-24

May 24th, 2016 by Jerome Choo
  • Crawlbot now supports custom headers while crawling; Bulk Processing jobs now support custom headers for all URLs.
  • Fixed an issue in Crawlbot where internal JSON objects were sometimes being returned in JSON data downloads.
  • Various improvements to date-parsing and normalization in the Article API.
  • Improvements to "Replacement" and "Ignore" filters in Custom APIs and manual rules.