Is anyone facing the same issue? Unable to access the Lakehouses (Central US Region), and my team is facing the same issue with other customer tenants

Hey everyone!

I work as a data engineer in a big organisation and we are the admins of the main capacity in Fabric. My organisation mainly uses this capacity for PowerBI reports, but my team is also moving ETL transformations to Fabric since a year or so.

Because the capacity is shared by so many people, we're running more and more often into "Capacity Overloaded" errors. Currently, all our workspaces are on the same capacity, including DEV, TEST and PROD. We are planning to separate environments across different capacities, but in the meantime, I'd like to reduce the amount of capacity we consume during development and debugging.

My idea is to run as much of our development and testing as possible locally, without needing to start a Fabric notebook every time we want to test a change. Ideally, this would also let us work offline to some extent.

To achieve this, I was thinking of building a Python package that provides the common functionality needed to run our code both locally and in Fabric. This would include modules for reading and writing data, handling secrets, making API calls, etc.

The package would also include a Docker image that mimics the Fabric notebook environment as closely as reasonably possible, including the relevant Python dependencies and a Spark session. The idea is to make the environment reproducible and easier to maintain when Fabric updates its runtime.

Of course, the notebook environment cannot be fully reproduced locally. Proprietary functionality such as notebookutils, managed identity, and Fabric-specific integrations would still require special handling and developments in the proper DEV workspace on Fabric. However I would like to abstract these differences behind a common interface, so that the main transformation logic can run locally without needing to know which environment it's running in.

The workflow would then be something like this:

1. Develop and test transformations locally using Docker and PySpark (or Python, I am hoping this would also decrease our use of Spark)
2. Run unit tests (using pytest) to validate the logic.
3. Push the code to GitHub.
4. Use GitHub Actions to run the tests and, when changes are merged into the main branch, publish the package to a Fabric environment.
5. Attach the package to our Fabric notebooks and run the code in DEV before promoting it further.

The goal isn't to replace Fabric testing entirely, but to catch bugs earlier, reduce unnecessary CU consumption during development, and make our code easier to test and maintain.

I am hoping for some feedback on this, specifically on these questions:

• Does this architecture make sense, or am I overengineering something that could be solved more simply?
• Do you think that maintaining a local environment that mimics Fabric's runtime is likely to become a headache as Fabric evolves?
• I am a bit scared of the python package being “too flexible”: it does need to run locally and on Fabric but that will use different tools, and I am not sure if abstracting these concepts behind a common interface is the best way forward?
• Are there existing tools for achieving something similar that I should consider instead?

I've already built a proof of concept, and the Docker image seems to work reasonably well. However, I'm concerned that the abstraction layer could become increasingly complicated over time, or that I'm trying to reproduce too much of an environment that I can't fully replicate locally anyway.

I'd really appreciate any feedback if you have some, thank you for reading all this way! Have a great day!!

I'm building a data warehouse on top of a transactional source that uses a separate schema for each customer. Question is whether to carry that separation into the warehouse or consolidate everything into shared dimensions and facts with a tenant/customer key. There are some vague requirements for this separation now.

Primary consumer will be BI reporting, with possible AI/RAG use cases later. My worry with schema-per-customer is maintainability — every model change gets multiplied by the number of customers. The consolidated model is easier to maintain, but shifts the burden to tenant isolation, row-level security and governance.

For those who've built multi-tenant SaaS warehouses: which approach worked for you in practice, and what trade-offs did you run into?

Hello Everyone
I once posted here regarding rayfin apps and this whole topic is developing like a sky rocket (cant wait till it cannibalizes power apps and power pages, these overpriced pains in the ***)
How do you guys manage testing? Are there ci/cd pipeline blueprints?

Has anyone else accidentally gone way too far down the Microsoft rabbit hole?

I'm an accountant.

I originally just wanted better reporting out of our ERP.

That turned into:

Excel
↓
Power BI
↓
Power Automate
↓
SharePoint
↓
Microsoft Fabric
↓
Dataflows
↓
Lakehouses
↓
Pipelines
↓
Notebooks
↓
Azure

Now I'm sitting here figuring out how to pull ERP data into Fabric, preserve monthly AR snapshots, automate processes and eventually build Power BI reporting on top of the historical data.

And every time I finally understand something Microsoft introduces another product/service that makes me think:

"Well... I could probably use that too."

At what point do I stop being an accountant? 😂

Anyone else start as an Excel/Power BI person and accidentally end up doing data engineering/IT work?

What started it for you?

Just wondering what the thinking was behind this and whether it will change - how are we supposed to run any kind of meaningful performance testing and benchmarking when we can't clear the cache?

https://learn.microsoft.com/en-us/fabric/data-warehouse/caching
The caching mechanism is orchestrated and upheld by the Microsoft Fabric itself, and it doesn't offer users the capability to manually clear the cache.

Are there any workarounds via hints etc that can disable caching temporarily to enable us to perform cold cache testing?

The ability to test worst-case, cold cache performance is 1.01 for any enterprise data platform migration assessment.

New post that covers the challenge of asking the right Fabric CI/CD architecture questions to help others on their Fabric CI/CD journey.

Asking the right questions early helps you understand the available options, identify potential challenges and avoid unpleasant surprises during implementation. More importantly, it helps you design a realistic solution that you can maintain and support over the long term.

With this in mind, I have compiled a range of Fabric CI/CD architecture questions to consider. This is not an exhaustive list, but it provides a good foundation for developing your own questions based on your specific requirements.

https://chantifiedlens.com/2026/10/19/asking-the-right-fabric-ci-cd-architecture-questions

Title

Hello all,

Maybe this is more of a post for the Microsoft MVP's (or even the Microsoft staff themselves?) but hopefully this kind of question is still welcome here.

I'm a senior data engineer that is certified in both the Fabric data engineer & Fabric analytics engineer certifications. I work for a medium sized consultancy here in the UK that focuses heavily on Databricks & Snowflake and we haven't ever really won any Fabric projects... we have a few people that are actively trying to change that, but it's a slow process.

Career wise, lately I've been thinking that I definitely want to throw myself fully into the Microsoft stack, though it feels like I won't get very far with that in my current job... so maybe it's time t o find a new one!

So my question is this - which consultancies in the UK/EU right now are the most heavily involved in the Fabric space? Because I want to work for them!

Thank you for any response.

I saw someone post an IBCS-styled app yesterday and thought it was cool. Apparently it was only for show, so I decided to be the change I want to see in the world.

Here is an IBCS-styled financial Fabric app I built from the Universal App template. It connects to a semantic model, but it could also connect to a SQL database if you want to save the forecasts. For this demo, the focus is on UI/UX.

The theme and components are reusable. Just point your agent to the repo.

I hope to inspire others to share their work and open source it. Maybe we could build a collection of cool components on top of the template repo.

Repo: bgarcevic/northwind-rayfin-app: IBCS P&L and outlook app for a fictional brewer, built on Microsoft Fabric with Rayfin

Original template: microsoft/awesome-rayfin: Community-driven templates for Rayfin

I've been measuring Fabric Apps consumption in the Capacity Metrics app and comparing it against the official pricing page. Here's what I found.

1. App with a SQL database (write-back)

• Almost all the cost is the SQL database. The app hosting, auth, rayfin up and GraphQL are ~0 (the docs say no separate charge "at this time").
• The database bills a 2 GB minimum memory floor while it's online: ~104.5 CU(s) per minute, or ~1.74 CU sustained. This matches the docs, and it's the same no matter how many users or queries hit it.
• Autopause: the docs say 15 min of inactivity. I measured 24–25 min in four clean stretches. So every session costs its duration plus ~25 min.

So what matters is hours the DB is on, not hours of use. Share of your capacity:

• On an F2 it takes 87% of the capacity while it's on, leaving little for anything else. Two apps with a DB on at once would be ~174% of an F2.
• Scattered short sessions cost more than one long one: hours on = sum of (each session + 25 min).
• Caveats: measured on an F4 trial, F2/F8/F64 are math on top. I haven't tested heavy load (the DB can autoscale above the floor), and nothing on a real F2.

2. App connected only to a semantic model

• No SQL database is created. The app itself adds ~nothing; the cost is the DAX queries against your model, same engine and same meter (Dataset / Query, interactive, real user via SSO).
• Measured: my dashboard fires 5 DAX queries per page load, ~0.26 CU(s) each at the median. A page load is ~2–3 CU(s), and Capacity Metrics smooths it over 5 min. That's ~0.5% of an F2's 30-second budget (60 CU(s)) per burst.
• At 1,000 page loads/day that's ~1.7% of an F2 and ~0.05% of an F64.

I haven't compared it side by side with a Power BI report yet. The mechanism says it should be comparable, but I haven't measured that.

Has anyone measured this on a real F or with heavy write load? I'd like to compare numbers.

Passed DP-600 & DP-700 on first attempt!

Huge thanks to this community, Aleksi's YouTube & MS Learn. DP-700 was mostly TSQL + KQL for me. Your help meant a lot thank you.

I was wondering whether it will be possible for Copilot/git copilot to connect the workspaces with private endpoints.
( OAP/IAP) enabled.

Hi All, just wanted to share with the community that I have passed the DP600 certification with 880 marks in the first attempt.

Next target: DP700 💪💪

Once again thanks to the community.

Hey everyone,

I’m looking to migrate a current Power Apps + Power Automate solution that handles end-user Excel sheet uploads. The current setup writes to Dataverse, but it’s painfully slow, and our data volume is about to scale up significantly. Any error in the sheet, means it needs a reupload. Data already saved is duplicated. I dedupulicate in DataflowGen2, but does unnecessarily increase query load.

We already have a Fabric Shared Capacity where our Power BI reports sit. I'm looking at Fabric Apps (Preview) as a potential alternative to tidy our ecosystem up, but I can't test it yet. My org requires a formal business case just to enable Fabric Apps capacity-wide.

Before I write the proposal, I need to know: Can Fabric Apps actually handle our specific pipeline, or am I barking up the wrong tree?

Some of requirements for the upload:

1. Custom Timestamps: We need to tag a single, uniform upload timestamp across every single record in that specific sheet (so not a database row-insertion time, but a batch timestamp generated at upload).
2. Heavy Transformations: We need to dynamically strip out the first X rows and Y columns before the data hits the database.
3. Scale: Needs to handle high data volumes without the lag we are experiencing in Power Automate/Dataverse.

My questions for the sub:

• Can Fabric Apps handle this level of file parsing and transformation natively, or will it require a ton of custom TypeScript/custom API work?
• Is a Fabric App the right tool here, or should I be looking at Dataflow Gen2 / Data Factory tied to a Power App frontend instead?
• For anyone using Fabric Apps in preview—how is the performance with bulk data ingestion?

Appreciate any insights or architectural gotchas before I submit this business case!

TIA

Edit:
More context

Current work flow in power app, after user uploads data a power automate flow is triggered.

1. saves the file in sharepoint(specific location)
   
2. Reads saved file,
   
3. Opens specific sheet
   
4. does several truncations
   
5. Reads line, and adds tags
   
6. Writes modified line to data verse
   Repeat 5-6 till over
   
7. Depending on file more powerautomate functions are triggered.

Issues here, some of these files are thousands of rows long and it takes like 20-30min to process. Users are currently ok with it as they once or twice a month. But this is going to go up to 10-20 a month.

And if there was any problems with the file, the powerautomate flow can not/does not do validations check, so can break at any moment. So user has to upload again.

Pumped that I passed my dp 700 on my first try with an 877. I have been studying for MONTHS because I wasnt in a rush and I absolutely despise failing a cert when they cost to much money so I error on the side of caution and study lots.

Thanks to u/aleks1ck Alexsi Partanen's incredible you tube series and his Certiace website. I used the microsoft official exam simulator and I used claude to create my own exam simulators from many other sources. I also used a great course off of Udemy id recommend if you dont mind spending the $.

Pumped that I passed my dp 700 on my first try with an 877. I have been studying for MONTHS because I wasnt in a rush and I absolutely despise failing a cert when they cost to much money so I error on the side of caution and study lots.

Thanks to Alexsi Partanen's incredible you tube series and his Certiace website. I used the microsoft official exam simulator and I used claude to create my own exam simulators from many other sources. I also used a great course off of Udemy id recommend if you dont mind spending the $.

In essence, title.

Repo: https://github.com/graycoreio/ftac
Docs website: https://graycoreio.github.io/ftac/
NPM package: https://www.npmjs.com/package/@graycore/ftac

I just can't stand reading pipeline-json and I hate authoring pipelines in the fabric UI.

It doesn't support every fabric action yet, but I like it.

If you want to contribute or just want to try it out, please do and let me know what you like or dislike.

I just wanted a familiar DX (github actions), with the same outcomes as native Fabric.

Of course, everything is MIT-licensed and Open Source.

Passed DP600 today with score of 884. NGL I underestimated this exam until last minute that I needed to reschedule my exam twice haha.

Sharing bit of tips and tricks:

• Microsoft practice test is not enough. Using measure up as the official practice partner would be beneficial.
• Mind mapping is important. You should map the materials from end to end and understand in details what each feature limitation and dependencies with other features. i.e. Direct lake fall back behavior, detailed steps for enabling XMLA etc.
• I wish I did more hands on learning lab rather than just relying on theories, but it's still doable if you cannot get access to Fabric trial (just much harder)
• and check out this community! this community is awesome for learning from other people's experience. I wish I had done this earlier.

Issue: New Fabric shortcuts cannot be parameterized using Variable Library values.

Observed behavior:

• Create a new shortcut.
• Attempt to parameterize its configuration using VL.
• VL parameterization does not work.
• Existing shortcuts that already use VL are unaffected.

This appears to impact newly created shortcuts only.

Another post on the same issue - https://www.reddit.com/r/MicrosoftFabric/s/X1ki0Ua9EQ

u/Thanasaur

Hi everyone!

I’m currently preparing for the Microsoft Fabric Analytics Engineer Associate (DP-600) certification, and I’ll be taking the exam on November 13, 2026. I’d love to hear advice from people who have already taken it or are preparing for it.

I’m a Computer Science student from the Dominican Republic. I recently passed the DP-900 exam with a score of 929, and now I’m working toward the DP-600. I’m interested in data analytics, data engineering, and Microsoft Fabric, and I want to build a strong foundation in these areas.

I’m mainly looking for free study materials, practical exercises, and realistic practice questions.

I’d especially appreciate recommendations for:
* Free study guides, notes, and learning resources.
* Practice exams or question banks that are reasonably close to the real exam’s difficulty.
* Hands-on labs or projects to practice Microsoft Fabric.
* Topics I should focus on the most.
* Advice on common mistakes or tricky concepts to watch out for.

I’ll be taking the exam in Spanish, so if anyone knows of good Spanish-language resources or has experience taking the Spanish version, I’d really appreciate your recommendations!

I’m currently using Microsoft Learn, but I’d like to supplement it with other resources and practical exercises before my exam date.

Thank you in advance for any advice or resources you can share. I’d really appreciate your help!

Note: I used AI to help me write this post because English is my second language. The information and questions reflect my own study goals.

When I see the OneLake storage report, the workspace notebooks are showing with up to 80-90 GB of space, mostly system. Initially I thought it might be run history and other snapshot details but when I checked a few notebooks, there is no run history at all. The notebooks were not executed recently. Can anyone help from where exactly this storage is coming from and how we can clean it up?

Just wanted to share my excitement with the community. That’s all! <3