Remote Data Mining And Management Job In Data Science And Analytics

FETCHING INFO FROM INSTAGRAM ACCOUNT FASTER THAN API

Find more Data Mining And Management remote jobs posted recently Worldwide

CONTEXT

For an analysis we aim to run on 3.5 Millions instagram account, we are looking for someone able to develop a code that will run on our AWS server able to fetch information of -100 instagram account in less than 1 second (using appropriate parallel threads and proxies)

WHAT WE AIM TO FETCH

For a given instagram account, the code should be able to do the following :
- Fetch list of followers
- Randomly select 100 followers
- For each follower get 3 info : #Posts, #Followers, #Following
In less than 1 sec

PROFILE WE ARE LOOKING FOR

We are looking for someone who has experience in efficient data scraping, is familiar with scraping instagram and has also experience of using parallel computing, Amazon Web Service, and thousands of proxies network (like luminati.io) in order to tremendously speed up data fetching
About the recuiter
Member since Mar 14, 2020
Viqar Ahmed
from Rodrigues, Mauritius

Skills & Expertise Required

AWS ECS Instagram API Python Selenium

Candidate shortlisted and hiredHiring open till - Feb 2, 2022

Work from Anywhere

40 hrs / week

Fixed Type

Remote Job

$139.02

Cost

Looking for help? Checkout our video tutorial
How to search and apply for jobs

How to apply? Do you have more questions about the Job?
See frequently asked questions

Other jobs by this client

web scraping - Fixed
server maintainance - Hourly
LabStreamingLayer expert needed for BCILAB project - Hourly
Dataset: Famous People and Companies - Fixed
Bubble.io developer needed for mature startup - Hourly
Book cover art and Map - Fixed
Salesforce Integration Consultant - Fixed
Create Data Work model on excel or any software - entry and Save and report - Fixed
ESP32 controller programming as asynchronous WEB Server, via Access Point - Fixed
Looking for an Android expert who has strong understanding in MVVM structure with Firebase - Hourly
Android Application for Passive Income - Fixed
Traditional Chinese translator and editor - Hourly
server maintainance - Hourly
Google Analytics + Data Studio Expert - Hourly
Need to shoot a short bio video in Philadelphia. - Fixed
Wordpress website malware removal - Fixed

Similar Projects

Building Custom Script For Crypto Trading Based on RSI Divergences

Need a custom trading script for Binance based on RSI divergences. The project can also be expanded to other exchanges. The script already exists, its about 80% complete.

It scans Binance and Kucoin tokens and their price and sends diverge...read more

URGENT (Populate a database with data from a excel file)

I have a database in postgresql and the excel file

I want record from excel should be inserted in the database (multiple tables)

The database format is postgresql and the final database to deliver is postgresql too.

Create S3 amazon Server

Hi,
We are looking for a developper to create a server on amazon S3 without subdomain

Converting JSON or Avro files to Parquet

I need to convert JSON, Avro or other row-based format files in S3 into Parquet columnar store formats using an AWS service like EMR or Glue.

I already have code that converts JSON to parquet using Python but the process is very manual, acco...read more

Image Detection Process

To start, the project consists of understanding our image detection and classification process. Help us understand how to mark training images and generate the required TensorFlow files for executing the model. Understand how to execute our detection...read more