Advancing Spark - External Tables with Unity Catalog

A very common pattern is for companies to have many different lakes, whether as part of a mesh, or the simple realities of large companies. But with Unity Catalog expecting a single lake for each metastore, how do we manage access to other cloud stores? In this video, Simon looks at the setup of storage credentials and managed identities, followed by the creation of external, unmanaged tables. The primary steps for external tables can be found here: https://docs.microsoft.com/en-us/azur... The managed identity setup steps can be found here: https://docs.microsoft.com/en-gb/azur... As always, if you're setting up a Lakehouse and need a helping hand, get in touch with Advancing Analytics