Remote Data Mining And Management Job In Data Science And Analytics

Web Scraping (ScreamingFrog) Expert Needed

Find more Data Mining And Management remote jobs posted recently Worldwide

We are looking for a web scraping expert to help configure Screaming Frog to scrape SKU data along with its normal SEO related data (title, meta description, h1, etc.). We need help defining the custom data extraction settings in Screaming Frog which use either XPath, CSS Path or Regex.

The ecommerce platform we are scraping is IBM WebSphere.

It appears that the html defining the SKU includes numbers that are unique per url, meaning that there is not a common pattern to look for.

For example:
The html looks like this for product page A:

SKU:
8373652-83765


But for product page B it looks like this:

SKU:
4283766-65243


So the id is different in both cases. It would have been simpler to scrape if it was just product_SKU in all cases.

Please provide a bid for providing a solution that we can put into screaming frog to extract the SKU.

Also, please tell me about your ability to scrape large ecommerce sites for SEO information (title, description, h1, etc.). We have several ecommerce clients with very large sites and will need help with this.
About the recuiter
Member since Mar 14, 2020
Shon Olanso
from Naryn, Kyrgyzstan

Skills & Expertise Required

Web Scraping 

Open for hiringApply before - May 21, 2024

Work from Anywhere

40 hrs / week

Fixed Type

Remote Job

$71.96

Cost

Offer to work on this project closes in 2 days!
Are you interested in this Opportunity?

Looking for help? Checkout our video tutorial
How to search and apply for jobs

How to apply? Do you have more questions about the Job?
See frequently asked questions

Similar Projects

Scrape website

Scrape data from the website as guided and save in CSV file.

Datamining From Specific Public Website

Need to have a Scarper created to pull information from BBB website. Will be given list of companies and their city/state. Just need the Contact Information associated with each company.

Backend developer needed to build a custom data scraper & parser service & API

The goal of this project is to scrape, sanitize, and organize the California State Bar Association data set. Specifically, to crawl a website for all attorneys. Data is classified by a variety of status parameters, and we are only interested in a spe...read more

Web scrapping for Real Estate

Create a database with data from individual property entries - each apartment, detached, land, building, farm, garage, office - up to a max of 34 fields - scrapping 8 real estate websites.
The tool will identify the new property listing, date it,...read more

Need PHP Scrapper

Scrapper was working and has been working I suspect the site it scrapes has been changed