ohai.social

emmuzoo📊 Final product: 3 dashboards in Looker Studio with key insights on SF bike usage in 2023–2024.From messy CSVs to visual stories — loving this data journey 🚴‍♀️<a href="https://mastodon.social/tags/dezoomcamp" class="mention hashtag" rel="nofollow noopener" target="_blank">#dezoomcamp</a> <a href="https://mastodon.social/tags/DataTalksClub" class="mention hashtag" rel="nofollow noopener" target="_blank">#DataTalksClub</a> <a href="https://mastodon.social/tags/dataengineering" class="mention hashtag" rel="nofollow noopener" target="_blank">#dataengineering</a>

emmuzoo🔍 Project Goals: • Avg trip time & distance • Most common bike type • Most active user type • Peak ride hours • Most popular stationsHappy to say: mission accomplished ✅<a href="https://mastodon.social/tags/dezoomcamp" class="mention hashtag" rel="nofollow noopener" target="_blank">#dezoomcamp</a> <a href="https://mastodon.social/tags/DataTalksClub" class="mention hashtag" rel="nofollow noopener" target="_blank">#DataTalksClub</a> <a href="https://mastodon.social/tags/dataengineering" class="mention hashtag" rel="nofollow noopener" target="_blank">#dataengineering</a>

emmuzoo📦 Raw bike trip data and Bay Area counties were loaded into GCS, transformed with dbt, and stored in BigQuery.Every piece automated with Kestra flows and IaC with Terraform 💪<a href="https://mastodon.social/tags/dezoomcamp" class="mention hashtag" rel="nofollow noopener" target="_blank">#dezoomcamp</a> <a href="https://mastodon.social/tags/DataTalksClub" class="mention hashtag" rel="nofollow noopener" target="_blank">#DataTalksClub</a> <a href="https://mastodon.social/tags/dataengineering" class="mention hashtag" rel="nofollow noopener" target="_blank">#dataengineering</a>

emmuzoo⚡ E-bikes are on the rise in SF!This project revealed fascinating insights about how different users move around the city on bikes.Infrastructure: Terraform Orchestration: Kestra Transformations: dbt Warehouse: BigQuery<a href="https://mastodon.social/tags/dezoomcamp" class="mention hashtag" rel="nofollow noopener" target="_blank">#dezoomcamp</a> <a href="https://mastodon.social/tags/DataTalksClub" class="mention hashtag" rel="nofollow noopener" target="_blank">#DataTalksClub</a> <a href="https://mastodon.social/tags/dataengineering" class="mention hashtag" rel="nofollow noopener" target="_blank">#dataengineering</a>

emmuzoo👀 Curious when people ride shared bikes most often?I used Bay Wheels data to analyze hourly & weekly usage trends and visualized them with Looker Studio.GCP + dbt + Kestra = smooth orchestration 💡<a href="https://mastodon.social/tags/dezoomcamp" class="mention hashtag" rel="nofollow noopener" target="_blank">#dezoomcamp</a> <a href="https://mastodon.social/tags/DataTalksClub" class="mention hashtag" rel="nofollow noopener" target="_blank">#DataTalksClub</a> <a href="https://mastodon.social/tags/dataengineering" class="mention hashtag" rel="nofollow noopener" target="_blank">#dataengineering</a>

emmuzoo🛠️ From raw CSVs to dashboards! Built a modern data pipeline using GCS, Terraform, Kestra, and dbt to analyze shared bike usage patterns in the SF Bay Area.Found answers to key questions like trip duration, user types & popular stations.<a href="https://mastodon.social/tags/dezoomcamp" class="mention hashtag" rel="nofollow noopener" target="_blank">#dezoomcamp</a> <a href="https://mastodon.social/tags/DataTalksClub" class="mention hashtag" rel="nofollow noopener" target="_blank">#DataTalksClub</a> <a href="https://mastodon.social/tags/dataengineering" class="mention hashtag" rel="nofollow noopener" target="_blank">#dataengineering</a>

emmuzoo🚴‍♂️ Just wrapped up a data engineering project analyzing Bay Wheels bike trips in the San Francisco Bay Area using real data from 2023-2024.Used Terraform, Kestra, dbt, BigQuery & Looker Studio to build a full batch data pipeline.<a href="https://mastodon.social/tags/dezoomcamp" class="mention hashtag" rel="nofollow noopener" target="_blank">#dezoomcamp</a> <a href="https://mastodon.social/tags/DataTalksClub" class="mention hashtag" rel="nofollow noopener" target="_blank">#DataTalksClub</a> <a href="https://mastodon.social/tags/dataengineering" class="mention hashtag" rel="nofollow noopener" target="_blank">#dataengineering</a>

emmuzooMission complete! ✅ Just finished the <a href="https://mastodon.social/tags/DataEngineering" class="mention hashtag" rel="nofollow noopener" target="_blank">#DataEngineering</a> homework: identifying the longest uninterrupted streak of taxi rides in a 5-minute window using <a href="https://mastodon.social/tags/Kafka" class="mention hashtag" rel="nofollow noopener" target="_blank">#Kafka</a> and <a href="https://mastodon.social/tags/Flink" class="mention hashtag" rel="nofollow noopener" target="_blank">#Flink</a>. Feeling proud of the progress so far! 🚖<a href="https://mastodon.social/tags/DataTalksClub" class="mention hashtag" rel="nofollow noopener" target="_blank">#DataTalksClub</a> <a href="https://mastodon.social/tags/Streaming" class="mention hashtag" rel="nofollow noopener" target="_blank">#Streaming</a> <a href="https://mastodon.social/tags/Kafka" class="mention hashtag" rel="nofollow noopener" target="_blank">#Kafka</a> <a href="https://mastodon.social/tags/Flink" class="mention hashtag" rel="nofollow noopener" target="_blank">#Flink</a> <a href="https://mastodon.social/tags/PyFlink" class="mention hashtag" rel="nofollow noopener" target="_blank">#PyFlink</a> <a href="https://mastodon.social/tags/DataScience" class="mention hashtag" rel="nofollow noopener" target="_blank">#DataScience</a> <a href="https://mastodon.social/tags/TaxiNY" class="mention hashtag" rel="nofollow noopener" target="_blank">#TaxiNY</a>

emmuzooWrapping up Module 6 of <a href="https://mastodon.social/tags/DataEngineering" class="mention hashtag" rel="nofollow noopener" target="_blank">#DataEngineering</a> and diving into the homework! 📝 The task: find the longest uninterrupted streak of taxi rides in a 5-minute window using <a href="https://mastodon.social/tags/Kafka" class="mention hashtag" rel="nofollow noopener" target="_blank">#Kafka</a> and <a href="https://mastodon.social/tags/Flink" class="mention hashtag" rel="nofollow noopener" target="_blank">#Flink</a>. Challenge accepted! 🚖💨<a href="https://mastodon.social/tags/DataTalksClub" class="mention hashtag" rel="nofollow noopener" target="_blank">#DataTalksClub</a> <a href="https://mastodon.social/tags/Streaming" class="mention hashtag" rel="nofollow noopener" target="_blank">#Streaming</a> <a href="https://mastodon.social/tags/Kafka" class="mention hashtag" rel="nofollow noopener" target="_blank">#Kafka</a> <a href="https://mastodon.social/tags/Flink" class="mention hashtag" rel="nofollow noopener" target="_blank">#Flink</a> <a href="https://mastodon.social/tags/PyFlink" class="mention hashtag" rel="nofollow noopener" target="_blank">#PyFlink</a> <a href="https://mastodon.social/tags/DataScience" class="mention hashtag" rel="nofollow noopener" target="_blank">#DataScience</a>

emmuzooHalfway through Module 6 of <a href="https://mastodon.social/tags/DataEngineering" class="mention hashtag" rel="nofollow noopener" target="_blank">#DataEngineering</a>! 🖥️ Learning how to process real-time data streams with <a href="https://mastodon.social/tags/Kafka" class="mention hashtag" rel="nofollow noopener" target="_blank">#Kafka</a> and <a href="https://mastodon.social/tags/Flink" class="mention hashtag" rel="nofollow noopener" target="_blank">#Flink</a>. I’m now applying what I've learned to the Taxi NY Green dataset. Excited for what comes next! 🚖✨<a href="https://mastodon.social/tags/Streaming" class="mention hashtag" rel="nofollow noopener" target="_blank">#Streaming</a> <a href="https://mastodon.social/tags/DataTalksClub" class="mention hashtag" rel="nofollow noopener" target="_blank">#DataTalksClub</a> <a href="https://mastodon.social/tags/Kafka" class="mention hashtag" rel="nofollow noopener" target="_blank">#Kafka</a> <a href="https://mastodon.social/tags/Flink" class="mention hashtag" rel="nofollow noopener" target="_blank">#Flink</a> <a href="https://mastodon.social/tags/PyFlink" class="mention hashtag" rel="nofollow noopener" target="_blank">#PyFlink</a> <a href="https://mastodon.social/tags/DataScience" class="mention hashtag" rel="nofollow noopener" target="_blank">#DataScience</a>

emmuzooJust kicked off Module 6 of the <a href="https://mastodon.social/tags/DataEngineering" class="mention hashtag" rel="nofollow noopener" target="_blank">#DataEngineering</a> Zoomcamp by @DataTalksClub! 🎉 It's all about <a href="https://mastodon.social/tags/StreamProcessing" class="mention hashtag" rel="nofollow noopener" target="_blank">#StreamProcessing</a> with <a href="https://mastodon.social/tags/Kafka" class="mention hashtag" rel="nofollow noopener" target="_blank">#Kafka</a>, <a href="https://mastodon.social/tags/Flink" class="mention hashtag" rel="nofollow noopener" target="_blank">#Flink</a>, and <a href="https://mastodon.social/tags/PyFlink" class="mention hashtag" rel="nofollow noopener" target="_blank">#PyFlink</a>. Can't wait to get hands-on with real-time data streaming! 🖥️🚀<a href="https://mastodon.social/tags/Streaming" class="mention hashtag" rel="nofollow noopener" target="_blank">#Streaming</a> <a href="https://mastodon.social/tags/DataTalksClub" class="mention hashtag" rel="nofollow noopener" target="_blank">#DataTalksClub</a> <a href="https://mastodon.social/tags/Kafka" class="mention hashtag" rel="nofollow noopener" target="_blank">#Kafka</a> <a href="https://mastodon.social/tags/Flink" class="mention hashtag" rel="nofollow noopener" target="_blank">#Flink</a> <a href="https://mastodon.social/tags/PyFlink" class="mention hashtag" rel="nofollow noopener" target="_blank">#PyFlink</a>

emmuzoo🎉 Final Step: Successfully Built Analytical Views! The project is complete! After transforming the data, I’ve created models that serve analytical views for various queries in BigQuery. The combination of dbt and BigQuery makes data engineering a smooth ride. Grateful for all the learning in this module! <a href="https://mastodon.social/tags/dbt" class="mention hashtag" rel="nofollow noopener" target="_blank">#dbt</a> <a href="https://mastodon.social/tags/DataTalksClub" class="mention hashtag" rel="nofollow noopener" target="_blank">#DataTalksClub</a> <a href="https://mastodon.social/tags/DataEngineering" class="mention hashtag" rel="nofollow noopener" target="_blank">#DataEngineering</a> <a href="https://mastodon.social/tags/GCP" class="mention hashtag" rel="nofollow noopener" target="_blank">#GCP</a> <a href="https://mastodon.social/tags/Analytics" class="mention hashtag" rel="nofollow noopener" target="_blank">#Analytics</a>

emmuzoo🔧 Optimizing Data with dbt Models I’ve been creating dbt models for multiple queries across the Green Taxi, Yellow Taxi, and FHV datasets in BigQuery. From source tables to final reports, it's amazing to see how dbt handles dependencies, testing, and version control. Ready to run the first models! <a href="https://mastodon.social/tags/DataEngineering" class="mention hashtag" rel="nofollow noopener" target="_blank">#DataEngineering</a> <a href="https://mastodon.social/tags/dbt" class="mention hashtag" rel="nofollow noopener" target="_blank">#dbt</a> <a href="https://mastodon.social/tags/GCP" class="mention hashtag" rel="nofollow noopener" target="_blank">#GCP</a> <a href="https://mastodon.social/tags/DataTalksClub" class="mention hashtag" rel="nofollow noopener" target="_blank">#DataTalksClub</a>

emmuzoo📊 Exploring dbt for Data Transformation The journey continues! In this part of the project, I'm learning how dbt models help automate data transformation. I'm building out models in dbt for these taxi datasets to create clean, analysis-ready data in <a href="https://mastodon.social/tags/BigQuery" class="mention hashtag" rel="nofollow noopener" target="_blank">#BigQuery</a>. It’s fascinating to see how everything connects! <a href="https://mastodon.social/tags/DataEngineering" class="mention hashtag" rel="nofollow noopener" target="_blank">#DataEngineering</a> <a href="https://mastodon.social/tags/dbt" class="mention hashtag" rel="nofollow noopener" target="_blank">#dbt</a> <a href="https://mastodon.social/tags/GCP" class="mention hashtag" rel="nofollow noopener" target="_blank">#GCP</a> <a href="https://mastodon.social/tags/ETL" class="mention hashtag" rel="nofollow noopener" target="_blank">#ETL</a> <a href="https://mastodon.social/tags/DataTalksClub" class="mention hashtag" rel="nofollow noopener" target="_blank">#DataTalksClub</a>

emmuzoo🚀 Started Module 4 of <a href="https://mastodon.social/tags/DataEngineering" class="mention hashtag" rel="nofollow noopener" target="_blank">#DataEngineering</a> Zoomcamp! Just kicked off the Analytics Engineering module and I'm diving into transforming the Green Taxi, Yellow Taxi, and FHV NY Taxi datasets loaded in <a href="https://mastodon.social/tags/BigQuery" class="mention hashtag" rel="nofollow noopener" target="_blank">#BigQuery</a>. Excited to see how dbt can help create analytical views for better decision-making! <a href="https://mastodon.social/tags/dbt" class="mention hashtag" rel="nofollow noopener" target="_blank">#dbt</a> <a href="https://mastodon.social/tags/DataTalksClub" class="mention hashtag" rel="nofollow noopener" target="_blank">#DataTalksClub</a> <a href="https://mastodon.social/tags/GCP" class="mention hashtag" rel="nofollow noopener" target="_blank">#GCP</a> <a href="https://mastodon.social/tags/AnalyticsEngineering" class="mention hashtag" rel="nofollow noopener" target="_blank">#AnalyticsEngineering</a> <a href="https://mastodon.social/tags/ETL" class="mention hashtag" rel="nofollow noopener" target="_blank">#ETL</a>

vanalexThis week at the Data Engineer Zoomcamp 2025 by <a href="https://mastodon.social/tags/DataTalksClub" class="mention hashtag" rel="nofollow noopener" target="_blank">#DataTalksClub</a> , we're diving into Data warehouse and Big Query. Special mention to Michael Shoemaker for the insightful lessons, and to Alexey Grigorev for organizing the sessions.Let's continue this learning journey together

emmuzoo🔚 Final Results & Lessons Learned 🏆 4th (Public LB) – RMSE: 12.2324 🏅 5th (Private LB) – RMSE: 9.5624 Key takeaways: ✔ Feature engineering & selection are crucial ✔ Encoding strategies impact model performance ✔ Hyperparameter tuning makes a real difference! 🚀<a href="https://mastodon.social/tags/DataTalksClub" class="mention hashtag" rel="nofollow noopener" target="_blank">#DataTalksClub</a> <a href="https://mastodon.social/tags/zoomcamp" class="mention hashtag" rel="nofollow noopener" target="_blank">#zoomcamp</a> <a href="https://mastodon.social/tags/machinelearning" class="mention hashtag" rel="nofollow noopener" target="_blank">#machinelearning</a>

emmuzoo🔧 Hyperparameter Optimization Tuned XGBoost using Optuna, a powerful Bayesian optimization library. Finding the best hyperparameters helped lower RMSE and improve generalization! 🔥⚡ <a href="https://mastodon.social/tags/DataTalksClub" class="mention hashtag" rel="nofollow noopener" target="_blank">#DataTalksClub</a> <a href="https://mastodon.social/tags/zoomcamp" class="mention hashtag" rel="nofollow noopener" target="_blank">#zoomcamp</a> <a href="https://mastodon.social/tags/machinelearning" class="mention hashtag" rel="nofollow noopener" target="_blank">#machinelearning</a>

emmuzoo⚙️ Model Choice: XGBoost Why? ✅ Handles missing data well ✅ Great with tabular data ✅ Efficient and highly tunable XGBoost was the perfect choice for this structured dataset! 📈💡 <a href="https://mastodon.social/tags/DataTalksClub" class="mention hashtag" rel="nofollow noopener" target="_blank">#DataTalksClub</a> <a href="https://mastodon.social/tags/zoomcamp" class="mention hashtag" rel="nofollow noopener" target="_blank">#zoomcamp</a> <a href="https://mastodon.social/tags/machinelearning" class="mention hashtag" rel="nofollow noopener" target="_blank">#machinelearning</a>

emmuzoo🛠️ Preprocessing For high-cardinality categorical features, I used Target Encoding. For low-cardinality categorical features, I applied Ordinal Encoding. Missing values? Used SimpleImputer (most_frequent) to fill them efficiently. 🚀 <a href="https://mastodon.social/tags/DataTalksClub" class="mention hashtag" rel="nofollow noopener" target="_blank">#DataTalksClub</a> <a href="https://mastodon.social/tags/zoomcamp" class="mention hashtag" rel="nofollow noopener" target="_blank">#zoomcamp</a> <a href="https://mastodon.social/tags/machinelearning" class="mention hashtag" rel="nofollow noopener" target="_blank">#machinelearning</a>

Recent searches

Search options

Administered by:

Server stats:

#datatalksclub