I've been building a large-scale product
We have a lot of data pipelines to process data (Generate analytics from metadata, upload data via Pandas to BQ) from Facebook, Instagram, YouTube, and Google, and serve front-end analytics using ChartJs.
I need someone to help continue building data processing and ingestion pipelines on an on-going basis.
Here's our current stack:
--------------------------------
App Engine + Python 3.7: Auto-scaling API server.
Google BigQuery: Petabyte Scale, instant analytics. Not good for edits/deletes.
Google DataStore: Rapid read/modify database.
Firebase Authentication: Google + FB + email auth.
Firebase Storage: For large file uploads.
Google Cloud Storage: For static files.
Anaconda: Environment Manager
Redis: Cache Manager.
Google Cloud NLP: Natural language API.
About the recuiterMember since May 20, 2018 Sona Dubey
from Connecticut, United States