TIL · · 2 min read
Added a Lakehouse Column. Broke DirectLake. Here's the Fix.
A DirectLake semantic model can break after a lakehouse schema change if the model metadata is out of sync with the source table.
TIL
Short notes on things I discover — tools, tricks, ideas worth remembering. Think of it as a public notebook.
A DirectLake semantic model can break after a lakehouse schema change if the model metadata is out of sync with the source table.
How to pass a shared run_date across Fabric pipeline stages and support historical backfilling with a two-pipeline pattern.
Never call `spark.stop()` in Databricks workflows. Explicitly call `sys.exit()`.
How treating your LLM Tools like humans can help you build personal AI copilots.
Mypy only narrows Union[T, None] when it sees an explicit check for None or an assertion. This behaviour leads to type errors that may seem unintuitive to solve.