Episode 284
| February 04, 2025
| 59 minutes
The Four-Letter Word ETL - Data Movement
Once you have your data stored in OneLake, you'll be ready to start transforming it to improve it's usability, accuracy, and efficiency.
In this episode of the podcast, Belinda Allen takes us on a delightful journey through Data Flows, Power Query, Azure Data Factory (Pipelines), and discusses the merits of shortcuts. We also learn about a handy way to manually upload a table if you have some static data you need to update.
There are many tools and techniques that can be used for data ingestion and transformations. And while some of these options we discuss will be up to individual preference, there are pros and cons to each. One of the blessings and curses of Fabric is that there are many ways of achieving the same result, so what you choose may depend on the nature of the data you have and your goals, but might also be dictated by personal experience.
We hope you enjoyed this conversation with Belinda on ingesting and transforming data in Microsoft Fabric.
If you have questions or comments, please send them our way. We would love to answer your questions on a future episode. Leave us a comment and some love ❤️ on LinkedIn, X, Facebook, or Instagram. Thank you for listening!
Our Guest
Belinda Allen
Belinda Allen is a Microsoft Most Valuable Professional (MVP) for the Data Platform (Power BI.) She is also a Microsoft Certified Trainer (MCT), Speaker, and the Co-Author of 2 books on Business Intelligence and Microsoft Dynamics GP. Belinda focuses on Microsoft Fabric, but is still working with the Microsoft Power Platform, happily wearing the title #CitizenDeveloper.
Being the Director of Enablement for iLink Digital, Belinda daily focuses on her personal mission statement, “To Improve the Lives and Success of my customers and partners.”
This is another way we can refresh our data, with pipelines. Pipelines does some very cool things. You could set a retry for a couple times. You could even get in and create your whole pipeline where you have custom rules in it. - Belinda Allen
I’m literally only having to manage that data being ingested and transformed one time; that’s really huge...so shortcuts are something that I absolutely love. - Belinda Allen
Meet the Hosts
Carlos Chacon
With more than 10 years of working with SQL Server, Carlos helps businesses ensure their SQL Server environments meet their users’ expectations. He can provide insights on performance, migrations, and disaster recovery. He is also active in the SQL Server community and regularly speaks at user group meetings and conferences. He helps support the free database monitoring tool found at databasehealth.com and provides training through SQL Trail events.
Eugene Meidinger
Eugene works as an independent BI consultant and Pluralsight author, specializing in Power BI and the Azure Data Platform. He has been working with data for over 8 years and speaks regularly at user groups and conferences. He also helps run the GroupBy online conference.
Kevin Feasel
Kevin is a Microsoft Data Platform MVP and proprietor of Catallaxy Services, LLC, where he specializes in T-SQL development, machine learning, and pulling rabbits out of hats on demand. He is the lead contributor to Curated SQL, president of the Triangle Area SQL Server Users Group, and author of the books PolyBase Revealed (Apress, 2020) and Finding Ghosts in Your Data: Anomaly Detection Techniques with Examples in Python (Apress, 2022). A resident of Durham, North Carolina, he can be found cycling the trails along the triangle whenever the weather's nice enough.
Want to Submit Some Feedback?
Did we miss something or not quite get it right? Want to be a guest or suggest a guest/topic for the podcast?