Today is going to be a bit of a shorter post. Seems that I have caught one of the bugs going around, so I'm not feeling myself. But that's not going to stop me from posting an article. Today, even though I feel under the weather, I was thinking about what Data Engineering projects I'd like to tackle first. Building up my portfolio has become a priority for me, so I can start picking up some freelance work. Today, I settled on a couple projects to dive into.
The first one has to do with migraines. You heard that right, migraines. I have suffered with migraines since I was 16 years old. With research, diet, and a daily preventative, I have been able to keep most migraines at bay. The ones that hit me the most these days are due to barometric pressure shifts. That one atmospheric condition triggers a migraine fairly consistently. So I figured it might be cool to investigate data related to migraines.
I am still searching for the right data set to use, but the high-level process to do this is as follows:
- Acquire the raw data, either as some pre-compiled data sets or using public APIs to pull the data
- Determine the right type of data storage I want to use for this data
- Transform the data so that I can get it into the right format to load it
- Load the data
- Run some analytics on it to see if I can correlate geographic location and barometric pressure readings to the amount of migraines reported
Now, this all depends on me being able to find and gain access to the right data. This is where I plan to use AI to help me find the data I need. If this one doesn't work out, I have other ideas too. But this is the one I want to start with. It's a complex series of steps and the end result will be relevant to me, as a migraine sufferer. It's funny how a project like this can get a nerd like me excited.
Have you ever thought about using the skills you have for your career to solve personal challenges or answer personal questions? I'd love to hear about it.
—Daniel