Support for DefaultAzureCredential with pl.read/scan_delta() #20808
Labels
A-io-cloud
Area: reading/writing to cloud storage
A-io-delta
Area: reading/writing Delta tables
enhancement
New feature or an improvement of an existing feature
python
Related to Python Polars
With the latest Polars version 1.20.0, it should be possible to read tables from Azure directly using
DefaultAzureCredential
under the hood.However, I encountered an issue when trying to use
pl.read/scan_delta()
. These functions seem to still require me to explicitly providestorage_options={"bearer_token": "<token>"}
for authentication.Here are the details of my setup:
DefaultAzureCredential
support not yet implemented for this type of storage?Steps to Reproduce:
pl.read/scan_delta()
on an Azure storage account using a path that starts with"abfs://..."
.DefaultAzureCredential
is configured and available in the environment.storage_options
manually.Expected Behavior:
DefaultAzureCredential
should handle authentication seamlessly, as described for other storage types in the documentation.Observed Behavior:
Authentication fails unless
storage_options
are explicitly provided with a bearer token.Environment Details:
abfs://
Additional Context:
If this feature isn’t supported yet for
"abfs://..."
, it would be great to have clarity on whether it’s planned or if there are workarounds.The text was updated successfully, but these errors were encountered: