Data Automation and Workflow Project

We are a music venue. We have a significant list of artists (30,000+) and venues (10,000+) and events (400,000+) and we are adding new artists, venues, and events everyday.

For this project, we would like a service developed that will do 2 things:

1) When a new artist is passed into the service, the service will go through the workflow outlined below and capture the data we require

2) We need the ability for the service to run through all artists and do a one-time update for all. This will allow us to capture the data needed for the existing artists in our database.

When a new artist is passed into the service, here is the workflow we would like to run through:

Send Artist Name to LastFM API
Capture & Store MBID
Capture & Store URL
Capture & Store Large Image
Capture & Store Listeners
Capture & Store Plays
Capture & Store Similar Artist(s)
Capture & Store Tag(s)
Capture & Store Bio

Send Artist Name to Spotify
Capture & Store ID (The Spotify ID for the artist)
Capture & Store URI (The Spotify URI for the artist)
Capture & Store Followers (Information about the followers of the artist)
Capture & Store External URLs (Known external URLs for this artist)
Capture & Store Images

Send Artist Name to Facebook - Facebook API Info
Capture & Store ID
Capture & Store Link
Capture & Store Total Followers (?)

Send Artist Name to Instagram - Instagram API Info
Capture & Store ID
Capture & Store username
Capture & Store Total Followers (?)

Send Artist Name to Twitter - Twitter API Info
Capture & Store Twitter Handle / Screen Name
Capture & Store Bio
Capture & Store Total Followers (?)


We are open to suggestions for the technology stack to be utilized. We prefer Google Cloud but are open to using AWS. As part of this project, we would ask you to setup everything that is required.
We need something that will not require any maintenance as our team is not technical.
About the recuiter
Member since Mar 14, 2020
Yazid Abdillah
from South Holland, Netherlands

---

---

Looking for help? Checkout our video tutorial
How to search and apply for jobs

How to apply? Do you have more questions about the Job?
See frequently asked questions