logicalclocks / hopsworks-api Goto Github PK
View Code? Open in Web Editor NEWPython SDK to interact with the Hopsworks API
License: Apache License 2.0
Python SDK to interact with the Hopsworks API
License: Apache License 2.0
Trying to install the library on 3.10 fails with the following error:
❯ pip install hopsworks
Collecting hopsworks
Using cached hopsworks-3.0.4.tar.gz (35 kB)
Preparing metadata (setup.py) ... done
Using cached hopsworks-3.0.3.tar.gz (35 kB)
Preparing metadata (setup.py) ... done
Using cached hopsworks-3.0.2.tar.gz (34 kB)
Preparing metadata (setup.py) ... done
Using cached hopsworks-3.0.1.tar.gz (34 kB)
Preparing metadata (setup.py) ... done
ERROR: Cannot install hopsworks==3.0.1, hopsworks==3.0.2, hopsworks==3.0.3 and hopsworks==3.0.4 because these package versions have conflicting dependencies.
The conflict is caused by:
hopsworks 3.0.4 depends on hsfs[python]<3.1.0 and >=3.0.0
hopsworks 3.0.3 depends on hsfs[python]<3.1.0 and >=3.0.0
hopsworks 3.0.2 depends on hsfs[python]<3.1.0 and >=3.0.0
hopsworks 3.0.1 depends on hsfs[python]<3.1.0 and >=3.0.0
To fix this you could try to:
1. loosen the range of package versions you've specified
2. remove package versions to allow pip attempt to solve the dependency conflict
ERROR: ResolutionImpossible: for help visit https://pip.pypa.io/en/latest/topics/dependency-resolution/#dealing-with-dependency-conflicts
Should be app.hopsworks.ai
Move convert_json_schema_to_avro and parse_avro_msg to this library.
If the API Key is incorrectly printed as a secret in (for example huggingface.co) and contains a "[API-Key]\n", newline at the end you the resulting stacktrace will contain the plain API Key. The http
I have redacted my API key, but this error is only there when the API Key contains a \n at the end. If I remove the \n from the end of my API key, the error disappears.
It should just connect to the current project.
We need to bump the version used for mkdocs, material and black to fix this issue: mkdocs/mkdocs#2799
Right now there is no documentation for the API so we can skip trying to build it.
Support the secrets REST API
In colab we get this error: /usr/local/lib/python3.7/dist-packages/psycopg2/init.py:144: UserWarning: The psycopg2 wheel package will be renamed from release 2.8; in order to keep installing from binary please use "pip install psycopg2-binary" instead. For details see: http://initd.org/psycopg/docs/install.html#binary-install-from-pypi.
""") We should suppress it.
Support setting project name, api_key_value and api_key_file in login function arguments.
Support multiple projects. Prompt for user to select project to use.
The library needs to get the certificates in .pem format and return a configuration for connecting to kafka from an external environment.
In the first iteration we will support project management, datasets, jobs, executions and git
Had an issue when attempting to perform pip install hopswork
.
Installing collected packages: sqlalchemy Attempting uninstall: sqlalchemy Found existing installation: SQLAlchemy 2.0.31 Uninstalling SQLAlchemy-2.0.31: Successfully uninstalled SQLAlchemy-2.0.31 ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. ipython-sql 0.5.0 requires sqlalchemy>=2.0, but you have sqlalchemy 1.4.48 which is incompatible. Successfully installed sqlalchemy-1.4.48
So I attempted to upgrade sqlalchemy's version in a bid to resolve this issue, and I got another issue
Requirement already satisfied: sqlalchemy in /usr/local/lib/python3.10/dist-packages (1.4.48) Collecting sqlalchemy Downloading SQLAlchemy-2.0.31-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.1 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.1/3.1 MB 39.2 MB/s eta 0:00:00 Requirement already satisfied: typing-extensions>=4.6.0 in /usr/local/lib/python3.10/dist-packages (from sqlalchemy) (4.12.2) Requirement already satisfied: greenlet!=0.4.17 in /usr/local/lib/python3.10/dist-packages (from sqlalchemy) (3.0.3) Installing collected packages: sqlalchemy Attempting uninstall: sqlalchemy Found existing installation: SQLAlchemy 1.4.48 Uninstalling SQLAlchemy-1.4.48: Successfully uninstalled SQLAlchemy-1.4.48 ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. hsfs 3.7.6 requires sqlalchemy<=1.4.48, but you have sqlalchemy 2.0.31 which is incompatible. Successfully installed sqlalchemy-2.0.31
I kinda need more advise on what shall I do
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.