Remote Data Mining And Management Job In Data Science And Analytics

FETCHING INFO FROM INSTAGRAM ACCOUNT FASTER THAN API

Find more Data Mining And Management remote jobs posted recently Worldwide

CONTEXT

For an analysis we aim to run on 3.5 Millions instagram account, we are looking for someone able to develop a code that will run on our AWS server able to fetch information of -100 instagram account in less than 1 second (using appropriate parallel threads and proxies)

WHAT WE AIM TO FETCH

For a given instagram account, the code should be able to do the following :
- Fetch list of followers
- Randomly select 100 followers
- For each follower get 3 info : #Posts, #Followers, #Following
In less than 1 sec

PROFILE WE ARE LOOKING FOR

We are looking for someone who has experience in efficient data scraping, is familiar with scraping instagram and has also experience of using parallel computing, Amazon Web Service, and thousands of proxies network (like luminati.io) in order to tremendously speed up data fetching
About the recuiter
Member since Jul 21, 2017
Varun R.
from New South Wales, Australia

Skills & Expertise Required

AWS ECS Instagram API Python Selenium 

Candidate shortlisted and hiredHiring open till - Jan 16, 2022

Work from Anywhere

40 hrs / week

Fixed Type

Remote Job

$139.04

Cost

Looking for help? Checkout our video tutorial
How to search and apply for jobs

How to apply? Do you have more questions about the Job?
See frequently asked questions

Similar Projects

Data Engineer

We are looking for a freelancer who has proven experience in Data Engineering projects.

The requirements we are looking for:
- Experience with Python
- Experience creating ETL workflows
- Experience with Big Data tools (eg: Hadoo...read more

DevOps Engineer

Hi,

We are an emotion detection software company with the following products under development.

ongoing projects:
- Fun mini app
- Interview mini app
- Interview software
- Government portal live demo

The st...read more

Dev Ops/Load Balancer

Looking for an EXPERT with experience with Nginx, Django rq, Python Django, gunicorn, celery, amzon web services. Python Django experience would definitely help.

DevOps Engineer for Big Data Platform

We are looking for a part-time (-2-3 days / week) DevOps engineer that is experienced with data platforms to become part of the team and lead our DevOps efforts.

Responsibilities:

- Build tools for the R&D
- CI/CD implementation...read more

BitMEX Exchange Websocket Connection

Requirements:
- a class which is able to connect to the BitMEX exchange through websocket (if not possible you can use the Rest-API) in order to perform buy, sell and cancel orders
- has to be written in Python

Please make me an off...read more