GithubHelp home page GithubHelp logo

Comments (5)

belldandyxtq avatar belldandyxtq commented on June 3, 2024

It seems other APIs do not have this issue as they accept the UNIX-like path as well as the scheme, and 'boo' will be treated as a UNIX-like path.

from pfio.

kuenishi avatar kuenishi commented on June 3, 2024

Reopen as #88 is just a workaround. Discussion should be continued here.

from pfio.

belldandyxtq avatar belldandyxtq commented on June 3, 2024

The argument of create_handler(scheme) is kind of misleading, as other functions and methods take URI as arguments. That said, more intuitive improvement would be to let it accept full or partial URI and make .root member configurable and effective.

I think this was the actual behavior before #86 with #87 fix.

Also we have to support choosing HDFS-cluster at each handler, which is currently not available.

This would involves two ToDos:

  1. Switching between HDFS-cluster would involve switching the connection. Or we can maintains connections to all the available clusters in hdfs.xml.
  2. Differentiating the cluster-name from directories

from pfio.

belldandyxtq avatar belldandyxtq commented on June 3, 2024

@kuenishi What do you think about this

from pfio.

kuenishi avatar kuenishi commented on June 3, 2024

My suggestion is to change argument of create_handler from just a scheme to full URI that indicates some directory in some cluster, or in local filesystem. This change involves a lot of code change like you suggested, and maybe to support creating handlers like chdir-like style. Not only about full URI but relative URI or pathnames are to be in discussion scope.

from pfio.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.