Remote Data Mining And Management Job In Data Science And Analytics

Combining Multiple Sensor Data CSVs into a single CSV

Find more Data Mining And Management remote jobs posted recently Worldwide

OVERVIEW
I have a collection of sensor data from 40 sites in a CSV format. There is one folder for each site. In each folder, there are many CSVs.

The project is to combine each of the CSVs for a site into a single CSV with all sensor data for that site.

This should be relatively trivial to do in Python, though it will require creating a single, comprehensive list of all timestamps, ordering them, and then correctly populating sensor values correctly in each row based on those timestamps. If you can provide python source code that does this, that would be appreciated.

SOURCE CSVs
Each CSV contains three headers per row: point, ts, val

point: The UUID for that sensor
ts: The timestamp when the value was recorded by that sensor
val: The value recorded by the sensor

OUTPUT CSVS
The CSV filename format should be buildingname_first-reading-date_last-reading-date_sensor-count.
I will share one csv file with shortlisted candidates.
The CSV header format should be ts,point1,point2,point3.

DELIVERABLES
A successful output of the project will be:
- A zip file with 40 CSVs
- Each CSVs formatted as buildingname_first-ts_last-ts_sensor-count
Complete data will be provided to the winning candidate.
About the recuiter
Member since May 20, 2018
Technotra Softw
from California, United States

Skills & Expertise Required

Python Python Numpy Pandas Data Science 

Candidate shortlisted and hiredHiring open till - May 3, 2024

Work from Anywhere

40 hrs / week

Fixed Type

Remote Job

$71.85

Cost

Looking for help? Checkout our video tutorial
How to search and apply for jobs

How to apply? Do you have more questions about the Job?
See frequently asked questions

Similar Projects

Python+NLTK Scraping Work

I have a scraping work that needs to be completed in Python and need to use NLTK library.

I need someone who can start right away and complete fast.

Need Commercial Retail Real Estate Articles

Deliverable:
(i) Commercial real estate articles and/or papers on challenges facing retail properties (multi-tenant or single tenant) owners, both operationally and financially
(ii) Commercial real estate articles and/or papers on what trigge...read more

AWS Cloud server IT with Python/API/PostgreSQL knowledge

I am a founder of a Startup and I have no IT background.
For the needs of my startup activities I am looking for an AWS Cloud server manager to perform the following tasks 4 hours a day for 7 days:
- Understand my project requirements and adv...read more

Easy Web Scraping (product entries, longterm)

Dear Freelancer,

we need time to time scrape some data (to .csv), from various sources, sometimes behind CloudFlare or other similar anti-scraping tools.

This job is longterm cooperation..

Thank you for offers!

Machine learning

Looking for some one who has experience in machine and deep learning models and can work quickly.