Activity
Mon
Wed
Fri
Sun
Oct
Nov
Dec
Jan
Feb
Mar
Apr
May
Jun
Jul
Aug
Sep
What is this?
Less
More

Memberships

Learn Microsoft Fabric

Public • 4.2k • Free

Fabric Dojo 织物

Private • 96 • $29/m

40 contributions to Learn Microsoft Fabric
Great Expectations - Fabric
Hi all, I was trying to use the Great Expectation library and I am getting the below error. Can someone let me know the solution for this! Thank you.
0
3
New comment 3d ago
Great Expectations - Fabric
0 likes • 4d
what's the version of the Spark and GX?
Thanks!
I passed the DP-600 certification on Tuesday. I found the videos by @Will Needham a couple of days before the exam. Was really useful in filling in the gaps and as a review exercise before the exam. Thanks Will! Happy to help wherever possible.
8
3
New comment 4d ago
1 like • 4d
Well done.. Congrat!!
PBI expertise for DP-600
Dp600 : why is the emphasis of the exam so much on PBI. Someone not from PBI background like me, finds it difficult to answer specific PBI DAX expressions and formula questions. For that you will need to have experience working on PBI reports. How do I up skill..any suggestions please?
1
4
New comment 3d ago
1 like • 4d
I felt the same impression when I took the test exam but I realized that the title of the certificate is a "Fabric certified ANALYTIC engineer". From my view, circa 25% - 40% of the questions fill with the Power BI questions - related to DAX expression, M query, Semantic modeling, external tools (i.e. DAX Studio, and Tabluar Editor) As always, you need to study the tutorials from Microsoft Learning, Will's tutorials first and watch/follow several real Power BI end-to-end project tutorials to get familiar with the key concept of Power BI Reporting as well as languages.
Data warehouse mirroring or creating directly in Fabric
Team, we are looking for adopting Fabric very soon. I am not very sure should I use our existing Data warehouse in Azure, Data mirroring into Fabric or Create Data warehouse directly in Fabric? A little background of our company, -- Our Data warehouse in Azure has limited facts and dimension tables --Our Data guy feel if we have Data warehouse outside of Fabric, we should be able to survive F64 for a long time --Our Data guy feel continue grow in Azure might save us Computing power --If we start to build new data warehouse in Fabric, does that require a lot of new skills? does that require us to purchase F128 soon? Eager to hear your feedback with Pros and Cons. Thanks!
2
6
New comment 6d ago
2 likes • 7d
@Xiaorong Miao if you have the DW tables in Azure SQL, then, you can mirror the tables but in the long run, I still recommend using Fabric DW as data warehouse.
0 likes • 6d
@Xiaorong Miao Sounds like you have current data warehouse in Azure SQL? One more thing I didn't mention - I have seen the DB mirroring documentation to Fabric DW but not to Lakehouse. FYI.
Another noob question...
If Spark data frames are processed 'in memory' then isn't there a limit on the size of the frame relative to the cluster size and available RAM? Fine if you have a cluster of many machines but in most scenarios the cluster wont be that big, Is there some spilling to disk to handle this?
1
1
New comment 7d ago
1 like • 7d
Good question... Notebook in MS Fabric has a "starter poop" with medium size - it can auto-scale up to 48 nodes and each node has 64G memory .. probably rare chance to have memory spill case. Also, spark.shuffle.spill.compress, it shows "true", meaning it compress the data while data shuffling is happening... less chance to use disk.. https://learn.microsoft.com/en-us/fabric/data-engineering/spark-compute
1-10 of 40
Jerry Lee
4
85points to level up
@jerry-lee-5901
Data engineer.... in Los Angeles

Active 10h ago
Joined Jul 30, 2024
INFJ
Torrance, CA
powered by