AWS Lamba Developer needed to write a website scraper for content behind a login screen

What were looking for:

An experienced full stack developer to write a Python or Node.js function in AWS that will perform a recursive scrape of data on a website that requires a username and password. We need someone to work on specific project requirements. The project will use Python or Node.js, HTML POST, GET, Amazon DynamoBD, XSLT, Amazon code version control

We need the following deliverables:
- AWS Lambda Function can log in to a website given a URL, username, and password (1 week)
- The function can do a recursive pull of records from the website and store the raw HTML of each page in the AWS DynamoDB database (1 week)
- The function will perform XSLT style parsing to pull specific key-value pairs from raw HTML.

To complete all the deliverables, the right developer will have experience in the following:
- AWS, Python or Node.js, HTTP POST/GET, Lamdba, DynamoDB, version control
About the recuiter
Member since Sep 7, 2017
Pedro Pereira
from Parana, Brazil

---

---

Looking for help? Checkout our video tutorial
How to search and apply for jobs

How to apply? Do you have more questions about the Job?
See frequently asked questions