Required Data Science & Analytics,Data Mining & Management freelancer for Web Scrape Application needed job
Posted at - Feb 21, 2021
Toogit Instant Connect Enabled
We are looking to create an application that retrieves pricing and quantities from a vendor's server for many thousands of products. The vendor has a site but the UI is geared towards user experience and is too slow and dynamic to be scraped in an efficient and stable manner. The site interacts with a server via an API which is not documented and must be reconstructed by studying the calls that the site makes to the server as the user steps through the site. The pricing and quantity information should be written to our database in a specified format and must run as a parallelized application so that the extraction takes a reasonable amount of time.
We are looking for a candidate with solid experience in creating stand-alone applications which mimic websites thereby circumventing the UI entirely. All coding is to be done in C#/.NET. Experience in parallel application design is critical
About the recuiterMember since Sep 27, 2017 Felix from Maharashtra, India