Objectives:
1. Query data (all dimensions and metrics) out of GA through Reporting API and stream it to Google BigQuery.
2. Create table schemas in Bigquery
3. Join all the GA data into one big table in Bigquery
4. Automate this ELT job to run periodically
Details:
There are about 500 metrics and dimensions in GA. It is possible to query a maximum of 10 metrics + 7 dimensions at a time from GA. This means that queries need to be run many times and later duplicated data needs to be deleted.
The data can be transferred using python scripts and Google App Engine, Google App Scripts or any way you prefer.
Background info:
We want to get GA hit-level raw data into Bigquery to create a customer journey. We have implemented following custom dimensions:
a) ClientID
b) SessionID
c) Timestamp
d) UserID
About the recuiterMember since Mar 14, 2020 Support Archiz
from Odisha, India