Data Engineer - IBM Cloud - Watson Studio - Big Data Programmer and Analytics

Are you up for a Challenge like nothing else youve ever done!

But First....

Take note that this Solution MUST be built using IBM Cloud Services and Watson Studio. So ONLY apply if this is your playground!

If so...

I need a BIG Data Application that will:

1. Receive 1000s of data files from millions of phones running a Mobile App.
2. Each data file will contain one or many Nodes.
3. A Node consists of: 2 x Phone IDs(IMEA), Geolocation(47.345888, 8.500094), DateTimeStamp(YYYY-MM-DD:HH:MM:SS), Duration(HH:MM:SS), Proximity(CM) and a Health Score(1-5).

More about NODES...
1. Nodes love to connect to other Nodes, the more connections the better. However, a Node can only connect to another Node if One of the Phone IDs in the 1st Node matches a Phone ID in the 2nd Node.
2. Each Node has a Status. Either Active or Expired. Nodes are only Active for the first 21 days of existence (DateTimeStamp + 21 Days). Then their Status changes to Expired.

PAIRED Nodes
A Paired Note exists where the 2 Phones IMEA in the Node are using the App. The App on both Phones would have sent the Data file to the Server and the DateTimeStamp in each Node will be very similar, if not identical. The Geolocation, Proximity and Duration will be merged and the Node will have 2 Health Scores, one for each Phone. The Nodes are then Merged into one Node.

UNPAIRED Nodes
Unpaired Nodes occur where only one of the 2 Phone IMEAs in the Node are using the App. Thus there will only be a Health Score for one of the Phones, i.e. the one using the App. The other Phones Health Score will be blank.

PATHWAY
A Pathway is created between 2 Nodes and supports a single directional Flow.

For example:
a) From Node 1 to Node 2
OR
b) From Node 2 to Node 1,

But not in both directions!

FLOW
A Flow between Nodes moves in the direction of Time. From the Oldest to the Newest.
Flows love Pathways and seek as many Pathways as possible.

Daily IMEA SCORE
Each Phone (IMEA) has a Daily IMEA Score.
The Daily IMEA Score is calculated based on a formula that evaluates the Daily Node Health Score, Proximity and Duration of each Node created during that day.
As the Daily Node Score changes, the value is transmitted back to the App.

I think thats enough for now!

If you think you have the skills to be able to design a program that can dynamically track millions of NODES as they dynamically seek to build PATHWAYS for variables to FLOW through, so the Daily NODE SCORE can be updated, convince me.

Oh, by the way. This has to Go-Live by end of 2020.

Looking forward to hearing from you.
About the recuiter
Member since Mar 14, 2020
Mughaffir Yunus
from Noord-Holland, Netherlands

---

---

Offer to work on this project closes in 60 days!
Are you interested in this Opportunity?

Looking for help? Checkout our video tutorial
How to search and apply for jobs

How to apply? Do you have more questions about the Job?
See frequently asked questions