USGS Earthquake Data - Data engineering to analyze Earthquake events - ETL project using DBT, Azure ADF, Snowflake and Tableau
Table of contents
Source
USGS.GOV - https://earthquake.usgs.gov/fdsnws/event/1 The website provides daily activities of earthquake events recorded, using the API the csv file is loaded
Azure ADF
Using the Azure data factory copy activity, the data is scheduled to load every day to Snowflake CSV data is extracted using REST API and loaded to the Snowflake warehouse
Snowflake
Used as a data warehouse to store the raw data and connected to DBT for transformations the updated data is merged into the final table, Tableau uses the final table to update the dashboard.
DBT
DBT cloud is used for data transformations and data cleaning, countries data is extracted from lat and log values and added after applying the transformations the changes are merged into Snowflake. DBT is also scheduled to run every day.
Lienage graph
Tableau
Tableau dashboard with data visualizations and graphs - https://public.tableau.com/app/profile/solomon8607/viz/EarthquakeEvents/Dashboard1
Screenshots: