Data augmentation to improve credit scoring system & bureau information
Scraping Pros is the leading provider of comprehensive web data extraction solutions helping clients succeed.
About the customer
Efforts to keep information up-to-date should be maximized, focusing on quickly adapting scrapers to various website changes and crashes. This process means a significant saving of time and money.
- A comprehensive end-to-end ingest-extraction system was designed to manage the huge need for data.
- The Scraping Pros monitoring system was adopted and customized to meet the SLA requirements.
- An extraction prioritization model was designed and implemented according to a freshness ranking.
- During the production start-up of the system, +200K daily records are extracted and ingested from the +20 selected sources of the project.
- The monitoring system allows for the follow-up of downloads and processing of data registers and effectively detects the discharges and falls of the sources.
- Main achievement: It has been possible to effectively detect the drops and falls of the sources from the monitoring system developed ad-hoc by Scraping Pros.