Web scraper to collect data from multiple sources

I am researching real estate in many counties around the country. Each county provides a list of property identifiers matching certain criteria in an XLS or CSV format. For a given county, I would like to read the file into a database, and then supplement each record with data scraped from multiple sources. We will start with two sources: the county assessor office and the treasurer.

Although the first deliverable will be for a single county, this should be extensible to accommodate:
* Multiple different database layouts (each county may have overlapping or different datums per property)
* Allow me to modify or supplement the code to capture additional fields and/or build processing logic
* Some way to invalidate records and re-run the scraper
* Additional sources in the future

I am an ex-coder so I dont need a UI. I will need some instruction to get up to speed on how you have designed and implemented the tool.

Strongly prefer the solution to be based on Google Cloud.
About the recuiter
Member since May 20, 2018
L Ben
from Heilongjiang, China

---

---

Looking for help? Checkout our video tutorial
How to search and apply for jobs

How to apply? Do you have more questions about the Job?
See frequently asked questions