Looking for an experienced Web Scraping, Data Mining and Automation specialist. This is a very well defined and streamlined task that involves triggering multiple scripts form within excel, with each script performing a web scraping operation and returning the data/findings to excel.
The job involves web scraping 4 websites for different pieces of data and integration with excel.
Each step below needs to be run from within Excel, executed as an excel macro maybe?
Inputs:
Websites A, B, C, D
Dates from(D1) and to(D2)
Step (1)
- Go to website A
- Bypass captcha and move to next/search page
- Perform a search between D1 and D2, and selecting an additional choice from a multiple choice item.
- Results will be displayed as a table.
- For each row, if one of the fields equals X, press on a link to open the details
- Extract some information from the page, say into columns C1, C2, C3 ... C10
- We need a pdf from that same page, download pdf and upload to Google Drive (credentials will be provided).
- Populate excel sheet with C1 (with hyperlink to pdf), C2, C3, ... C10
Step (1) BONUS - If you are able to do this, Im willing to pay a higher price.
Extract two fields from pdf - by performing OCR - and store as C11 and C12
Step (2)
- Go to website B
- For each row obtained in Step (1), use two columns - say C3 and C4 - to search for information on website B.
- Extract info found on page into some columns C11 ... C15
- Make C11 a hyperlink to the result page, if possible.
- If not possible, get a pdf of the page obtained and upload to Google Drive, then make C11 a hyperlink to that file. (Printable version of the page is available on website B after performing the search).
Step (3)
- Go to website C
- For each row obtained in Step (1), use two columns - say C12 and C13 - to search for information on website C.
- Extract info found on page into some columns C16 ... C20
- Make C16 a hyperlink to a public website providing input of C16 value.
Step (4)
- For each row obtained in Step (1), use column C20 as input to perform an API call to a publicly available service (simple API call).
- Store result in column C21
Step (5)
- For each row, perform a simple mathematical operation between a couple of columns in that row and store as an additional column, C22
Step (6)
- Filter sheet based on C22 value.
Step (7)
- Go to website D, enter credentials (provided).
- For each row, perform a search on the website, get information and store in excel sheet C23 ... CN
Done
Total of 7 buttons/macros in excel sheet ... Each step performs a function. You will need to sign an NDA.","employmentType":["FULL_TIME","PART_TIME","CONTRACTOR","TEMPORARY","PER_DIEM"],"jobLocationType":"TELECOMMUTE","hiringOrganization":{"@type":"Organization","name":"Toogit","sameAs":"https://www.toogit.com/","logo":"https://www.toogit.com/images/toogit_logo_initial.png"},"identifier":{"@type":"PropertyValue","name":"Toogit","value":289462},"skills":["software development","Website Development"],"applicantLocationRequirements":[{"@type":"Country","name":"IN"},{"@type":"Country","name":"Canada"},{"@type":"Country","name":"USA"},{"@type":"Country","name":"Germany"},{"@type":"Country","name":"Pakistan"},{"@type":"Country","name":"Philippines"},{"@type":"Country","name":"Indonesia"},{"@type":"Country","name":"Sri Lanka"},{"@type":"Country","name":"Nigeria"},{"@type":"Country","name":"China"},{"@type":"Country","name":"Russia"},{"@type":"Country","name":"Bangladesh"}],"validThrough":"2024-10-17T05:19:35+05:30","url":"https://www.toogit.com/freelance-jobs/Mjg5NDYy"}
Remote Web Development Job In IT And Programming
Find more Web Development remote jobs posted recently Worldwide
Work from Anywhere
40 hrs / weekFixed Type
Remote Job$95.81
Cost Looking for help? Checkout our video tutorial
How to search and apply for jobs
How to apply? Do you have more questions about the Job?
See frequently asked questions
I need an easy to use travel blog. We need to categorize by continents, then subtitles on those for country visits..... all 195. We travel full time, so its better to have too many than not enough listed. Weve been to half of them already. I wan...read more
I am looking for an IT specialist to serve as an expert witness in a custody case trial. The scope of the job entails analyzing the IPv6 on two different e-mails and confirming whether or not both emails came from the same device and/or wifi connect...read more
Small service company providing data storage and managed services needs to become SOC2 (Type 1&2) compliant within the next 6-9 months. Will also need annual maintenance proposal for subsequent years. Please provide a proposal for all aspects of the...read more
Pro PowerApps Engineer needed:
This is a short description of the project.
Overview
There is a process of collecting office seat count from office managers from numerous office locations around the US. The manual process was that Facilit...read more