logicalclocks / hopsworks-api Goto Github PK

Trying to install the library on 3.10 fails with the following error:

❯ pip install hopsworks
Collecting hopsworks
  Using cached hopsworks-3.0.4.tar.gz (35 kB)
  Preparing metadata (setup.py) ... done
  Using cached hopsworks-3.0.3.tar.gz (35 kB)
  Preparing metadata (setup.py) ... done
  Using cached hopsworks-3.0.2.tar.gz (34 kB)
  Preparing metadata (setup.py) ... done
  Using cached hopsworks-3.0.1.tar.gz (34 kB)
  Preparing metadata (setup.py) ... done
ERROR: Cannot install hopsworks==3.0.1, hopsworks==3.0.2, hopsworks==3.0.3 and hopsworks==3.0.4 because these package versions have conflicting dependencies.

The conflict is caused by:
    hopsworks 3.0.4 depends on hsfs[python]<3.1.0 and >=3.0.0
    hopsworks 3.0.3 depends on hsfs[python]<3.1.0 and >=3.0.0
    hopsworks 3.0.2 depends on hsfs[python]<3.1.0 and >=3.0.0
    hopsworks 3.0.1 depends on hsfs[python]<3.1.0 and >=3.0.0

To fix this you could try to:
1. loosen the range of package versions you've specified
2. remove package versions to allow pip attempt to solve the dependency conflict

ERROR: ResolutionImpossible: for help visit https://pip.pypa.io/en/latest/topics/dependency-resolution/#dealing-with-dependency-conflicts

Should be app.hopsworks.ai

Move convert_json_schema_to_avro and parse_avro_msg to this library.

If the API Key is incorrectly printed as a secret in (for example huggingface.co) and contains a "[API-Key]\n", newline at the end you the resulting stacktrace will contain the plain API Key. The http

I have redacted my API key, but this error is only there when the API Key contains a \n at the end. If I remove the \n from the end of my API key, the error disappears.

It should just connect to the current project.

We need to bump the version used for mkdocs, material and black to fix this issue: mkdocs/mkdocs#2799

Right now there is no documentation for the API so we can skip trying to build it.

Support the secrets REST API

In colab we get this error: /usr/local/lib/python3.7/dist-packages/psycopg2/init.py:144: UserWarning: The psycopg2 wheel package will be renamed from release 2.8; in order to keep installing from binary please use "pip install psycopg2-binary" instead. For details see: http://initd.org/psycopg/docs/install.html#binary-install-from-pypi.
""") We should suppress it.

Support setting project name, api_key_value and api_key_file in login function arguments.

Support multiple projects. Prompt for user to select project to use.

First, connect to Hopsworks with:

Second, try to connect to saas by adding any text as API key value:

The library needs to get the certificates in .pem format and return a configuration for connecting to kafka from an external environment.

In the first iteration we will support project management, datasets, jobs, executions and git

Had an issue when attempting to perform pip install hopswork.

Installing collected packages: sqlalchemy Attempting uninstall: sqlalchemy Found existing installation: SQLAlchemy 2.0.31 Uninstalling SQLAlchemy-2.0.31: Successfully uninstalled SQLAlchemy-2.0.31 ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. ipython-sql 0.5.0 requires sqlalchemy>=2.0, but you have sqlalchemy 1.4.48 which is incompatible. Successfully installed sqlalchemy-1.4.48

So I attempted to upgrade sqlalchemy's version in a bid to resolve this issue, and I got another issue

Requirement already satisfied: sqlalchemy in /usr/local/lib/python3.10/dist-packages (1.4.48) Collecting sqlalchemy Downloading SQLAlchemy-2.0.31-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.1 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.1/3.1 MB 39.2 MB/s eta 0:00:00 Requirement already satisfied: typing-extensions>=4.6.0 in /usr/local/lib/python3.10/dist-packages (from sqlalchemy) (4.12.2) Requirement already satisfied: greenlet!=0.4.17 in /usr/local/lib/python3.10/dist-packages (from sqlalchemy) (3.0.3) Installing collected packages: sqlalchemy Attempting uninstall: sqlalchemy Found existing installation: SQLAlchemy 1.4.48 Uninstalling SQLAlchemy-1.4.48: Successfully uninstalled SQLAlchemy-1.4.48 ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. hsfs 3.7.6 requires sqlalchemy<=1.4.48, but you have sqlalchemy 2.0.31 which is incompatible. Successfully installed sqlalchemy-2.0.31

I kinda need more advise on what shall I do