31 Oct

NewHub architecture for developers and clients

Developers` API provides full access to the configuration, deployment, monitoring and management processes and data.

Applied API – full-featured multi-thread multi-host REST http-based protocol to perform crawling and scraping batch requests.

Web administration management console: support of users` accounts, roles, permissions, crawling and scraping, results collect, aggregation, archiving and configurable custom post-processing, statistical reports, e-mail notifications, triggering and another utility tools.

Helper tools and libraries: applied utilities to convert, prepare, parse, format, data used in sequential tasks chains as input and output objects.

Share this