AzureStorage.DataLake
The files of an Azure Data Lake Storage Gen2 container or folder, listed as Folder.Files lists a folder's.
Group: Files and documents. Power Query M has it too: a query that uses it is written as in Power BI.
Syntax
AzureStorage.DataLake(endpoint as text, optional options as nullable record) as table| Parameter | Type | Description |
|---|---|---|
endpoint | text | The address: https://<account>.dfs.core.windows.net/<container>[/<folder>], or the account's alone for its containers. |
options | nullable record optional | HierarchicalNavigation (true: one level at a time, folders included); BlockSize, RequestSize and ConcurrentRequests are accepted and change nothing. |
Returns
table. The eight columns of Folder.Files (Content, Name, Folder Path ...), a row per file below the address.
Remarks
- Name is the file's name and Folder Path its folder's address ending in /, as
Folder.Fileshas them. - With HierarchicalNavigation = true the table holds the top level's files and folders, and a folder's Content is its own listing.
- Data Lake Storage has no anonymous sign-in: Organizational account, Account key or Shared access signature, kept for the account, a container or a folder.
- An option Power BI doesn't know is an error, as there.
Compared with Power Query
A folder of more than 5,000 paths is refused with a message: name a folder below it. Power BI reads it whole.
Examples
A folder's Parquet files in one table
let
Files = AzureStorage.DataLake("https://norwayanalytics.dfs.core.windows.net/lake/sales/2026"),
ParquetFiles = Table.SelectRows(Files, each [Extension] = ".parquet")
in
Table.Combine(List.Transform(ParquetFiles[Content], Parquet.Document))Result: not shown here: it needs an Azure Data Lake Storage account and a sign-in.
An option it doesn't take
AzureStorage.DataLake("https://norwayanalytics.dfs.core.windows.net/exports", [Timeout = 30])Result: an error.
[Reason = "DataSource.Error", Message = "AzureStorage.DataLake: This function doesn't support the query option 'Timeout' with value '30'.", Detail = null]Related functions
AzureStorage.DataLakeContents, AzureStorage.Blobs, Folder.Files, Parquet.Document.