Delta Parquet for dummies?
Hi all. we are currently using a c# library to convert JSON to parquet. The JSON is highly complex, and to ensure that Power BI can easily access the data without having to do a million steps, we are expanding the records and tables to essentially flatten the resulting parquet.
As part of my initial exploration of Fabric, I understand that Delta Parquet is the way to go for these files, and that we probably need to use Spark to get there. However, I have been able to find very little information (maybe I don't know what to look for) about Delta Parquet, whether we need to use Spark, how does Power BI use these files differently from straight-up Parquet.
I'm grateful in advance for any pointers to information, videos, etc., that would be helpful for me to understand this important topic.
1
8 comments
Gyan Penrose-Kafka
2
Delta Parquet for dummies?
Learn Microsoft Fabric
skool.com/microsoft-fabric
Helping passionate analysts, data engineers, data scientists (& more) to advance their careers on the Microsoft Fabric platform.
Leaderboard (30-day)
powered by