Comments (7)
I'm open to the idea, but I'd like to get feedback from @martindurant. When we settled on abfs as the protocol, it was based on the fact that abfs:// is the defined protocol for AzureBlobFileSystem, as described here.
from adlfs.
I just saw that this discussion started in fsspec. I'm OK with it. As a side-note, I've also started to see the "az://" show up in at least one other place as well.
from adlfs.
You can, of course, have both protocols.
from adlfs.
Yeah I was thinking of making it akin to gcs
and gs
. I imagine replacing abfs
with az
would probably lead too many breaking changes for users.
I'm thinking of seeing the following in fsspec.registry.known_implementations
:
'abfs': {'class': 'adlfs.AzureBlobFileSystem', 'err': 'Install adlfs to access Azure Datalake Gen2 and Azure Blob Storage'},
'az': {'class': 'adlfs.AzureBlobFileSystem', 'err': 'Install adlfs to access Azure Datalake Gen2 and Azure Blob Storage'}
from adlfs.
OK, so go ahead!
I think the protocol attribute of the implementation class in this repo should also change to a tuple of the possible strings, ("az", "abfs")
at the same time
from adlfs.
@raybellwaves -- I'm good with this. Are you planning to submit a PR?
from adlfs.
Closed via #111
from adlfs.
Related Issues (20)
- `'AzureBlobFile' object has no attribute 'forced'` in `__del__` on bad file mode
- AzureBlobFileSystem to support CertificateCredential HOT 2
- Support for storage accounts in the URL (Azure Data Lake Storage Gen2 URI support) HOT 2
- Support DataLakeServiceClient for Azure Gen 2 Storage HOT 5
- Maybe fsspec can't working well in Azure CN
- Question: wasb[s] protocol support
- Encryption-in-transit support
- Specifying one ffspec url to one azure blob in duckdb read_parquet causes an ls scan of the entire container
- Cannot read parquet from Azure when archive file exists
- `AzureBlobFileSystem.ls(path)` returns inconsistent results HOT 2
- DefaultAzureCredential() not being used with anon=False keyword passed in storage_options HOT 2
- New release? HOT 1
- Concurrent reads/writes cause BlobNotFound
- TypeError: unsupported operand type(s) for -: 'NoneType' and 'int' HOT 6
- Support for MS Fabric OneLake
- support az cli config ~/.azure/config HOT 1
- UserWarning: Failed to fetch container properties for CONTAINER_NAME. Assume it exists already HOT 1
- "sdk_moniker" key error HOT 9
- Avoid private APIs from azure.storage HOT 2
- InternalServerError while writing large json data.
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from adlfs.