Remote Data Mining And Management Job In Data Science And Analytics

DATA SOURCE CONNECTORS FRAMEWORK - PYTHON - KAFKA - HDFS

Find more Data Mining And Management remote jobs posted recently Worldwide

Hello Rockstart Data Engineer,

Thats what we are looking for!

We want to develop highly optimized , scalable and resilient DATA CONNECTORS to fetch operational data on-demand basis. User shall request the data from a web application (we have developed it already) and data gets fetched from respective data source. The data transfer shall happen via REST APIs and/or streaming APIs.

The sources for Phase 1 are as follows:
1. MYSQL
2. Salesforce
3. CSV
4. Twitter
5. Video RTSP

Phase 1 budget has been shared.
Phase 2 budget (and work) shall be five times. Phase 3 budget (and work) shall be ten times.

P.S. We are more interested in developing a Data Connector Framework. You would need to code in functional way using latest techniques. We already know/tried traditional methods.

NOTE: IGNORE, if you never build data connectors. We shall NOT accept you. We are looking for been there, done that candidates ONLY. You would need to demonstrate and/or walk-through your past work, else consider yourself eliminated.

This is 1 year long project for motivated, intellectual and committed developer(s). Phase 1 should not take more than 1 week for an experienced developer/team. You are free to use your existing codes to develop our work.

Thanks.
Excited to start the project ASAP.
About the recuiter
Member since Sep 10, 2017
Zona Elder
from Stockholm, Sweden

Skills & Expertise Required

Apache Kafka Apache NiFi Apache Hadoop Kubernetes RabbitMQ 

Candidate shortlisted and hiredHiring open till - Apr 22, 2024

Work from Anywhere

40 hrs / week

Fixed Type

Remote Job

$287.84

Cost

Looking for help? Checkout our video tutorial
How to search and apply for jobs

How to apply? Do you have more questions about the Job?
See frequently asked questions

Similar Projects

Approximate synchronous Kafka copy

The task is to write a distributed approximately synchronous copy procedure for Kafka partitions. The entire applications is envisioned to be provisioned as a helm chart and the application is supposed to be os.

I will share some files with...read more

Need a Middle+ DevOps specialist to configure k8s on baremetal

We are looking for a devops specialist to configure kubernetes on baremetal and other tasks.

AWS Infrastructure Setup for Microservices projects

Create custom VPC,
Private and Public subnets, NACL,
Nat Gateway, Internet gateway, Route tables.
Create RDS Single AZ setup
Create multiple S3 buckets and
use KMS to encrypt data at rest.

Kubernetes experts

A Kubernetes task to that involves using a cloud platform to manage the cluster

Create an IPv6 only kubernetes cluster

We give you 3 IPv6 only VMs. You have access to 4 /64 networks that can be routed to any of the three VMs.

Your job is to ...

* create an IPv6 only kubernetes cluster
* ensure that pods are reachable
* ensure that service IP...read more