Updated at July 2018
I have been running my personal quantified self project for almost one year. My first focus is to gather all possible data. After that, I would like to integrate them all in a single database. Then, I can focus on important metrics, build an alarm, build a screenshot of my life data and have a deeper analysis. I also have a plan to build my dashboard of life to monitor the metrics. Therefore, I am building my own personal data pipeline from A to Z: data preparation, data integration, data visualization and data analysis.
What are the data that I collect?
I wonder how can I get other data like e-mail and mobile phone usage/activity.
I should integrate all the data in a single database and create a robust data ingestion scripts which will be executed periodically. The scripts will feed the data into a single database with a proper structure. The database does not only contain my quantified self data but it also contains other data which are unrelated with my data.
The tools that I use for data integration are:
Where are the data sitting?