wise-aifs / afs2-model Goto Github PK
View Code? Open in Web Editor NEWSDK for WISE-PaaS AFS to analytics developer.
License: Apache License 2.0
SDK for WISE-PaaS AFS to analytics developer.
License: Apache License 2.0
Since the AFS
server is already moved to v2
APIs, I think we can deprecate v1
related operations. Add deprecated warnings at this or next version, and really deprecate all v1
operations after the re-implement is done.
How about integrating Travis CI and Codecov to get a better development experience? Here is an example after integrating Travis CI and Codecov.
Once the new PR has been sent, the Travis CI will run unit tests and generate coverage report about this PR. The report will be hosted on Codecov and it also reports the coverage status to the PR. This can help us to check how the PR influence our project. Any idea?
@benchuang11046 Notice that we remove all versions of requirements(here). This might cause some issues when using run_jnb
because of mismatch version with nbconvert
. Maybe we still need to use fixed version of all modules in both jupyter_api_default_requirements.txt and jupyter_app_default_requirements.txt. What's your thought?
v2.2 has some new documents to user, about RESTful API parameters and stauts code.
Including API are following
To verify the module work with different versions of python, I want to integrate tox
into tests. Also wants to add some lint support in tox
.
Refactor _create()
with *args
and **kwargs
to make it easier maintenance.
The name afs is already registered package name in pypi.
If the project goes on pypi, it will be renamed.
afs2-model
is scheduled to on pypi.org 4/29
The reason is WISE-PaaS private pypi server will be shutdown the same day.
Due to many users are develop the old usage on WISE-PaaS, and they will have some checkpoints soon.
The next version 2.1.13
will be just fix the package name, and the usage is the same as before.
I thank @chenjr0719 to give a advanced AFS SDK, and I have already fixed the package name and usage case. It will be appeared in version 2.2
. And I will prepared more friendly docs to our users.
The bottleneck of uploading is about 500-600MB on private cloud.(Maybe less on public cloud)
Currently, the uploading model file is going to api-afs and written to blob.
It may cause timeout when transferring the big file.
I want to add a function to update model to blob directly.
# training...
# produce model...
...
# afs2-model DO NOT upload
afs2_model.upload_model(...)
# Model file on blob is models/{instance_id}/{model_respository_id}/{model_id}
# User should input their blob_credential
# Check existed file on the blob and update the big model to the blob directly
# Notify api-afs this operation success/failed
afs2_model.update_model_to_blob(blob_credential, model_file)
There will have v2 AFS API, so SDK have to support v2.
First, we support models.upload_model and the depending method.
I will write the unit test.
Including API are following
How can I know the run jupyter file command line in AFS?
Maybe AFS SDK can support it?
How can I Know Models number in AFS?
So, Can you give me the list AFS Models api?
As title, the Codecov
does not show currently.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.