With minimal configuration settings for a request (typically – list of URLs) with this demo you’re able to make a single synchronous request to process them. Depending on the settings, processing will include:

  • crawling and scraping
  • only crawling
  • only scraping (raw content of a webpage needs to be provided instead of the URL)
This kind of API includes a possibility to make request for crawling of set of URLs with many options like filtering, website scan depth limit, multi-document and all types of scraping (News, RSS and Template). Request can be done with HTTP gateway using POST or GET methods according to API definition:
API documentation

Results can be received in several pre-defined format templates. For example, JSON, TEXT, HTML, XML, CSV, SQL format are available, and any kind of custom textual structure format can be defined using macro names of a tags.

© 2015-2016 TagsReaper. All rights reserved.