GithubHelp home page GithubHelp logo

Comments (5)

hanxiao avatar hanxiao commented on May 17, 2024 2

thanks again ❤️ for trying GNES and giving feedback at the early stage. I'd like to introduce you the new GNES Flow API (available since v0.0.46), enables a pythonic and intuitive way for building workflow in GNES. As an example, an indexing workflow can be simply defined as:

flow = (Flow(check_version=False, ctrl_with_ipc=True)
        .add_preprocessor(name='prep', yaml_path='yaml/prep.yml', replicas=3)
        .add_encoder(yaml_path='yaml/incep.yml', replicas=6)
        .add_indexer(name='vec_idx', yaml_path='yaml/vec.yml')
        .add_indexer(name='doc_idx', yaml_path='yaml/doc.yml', recv_from='prep')
        .add_router(name='sync', yaml_path='BaseReduceRouter', num_part=2, recv_from=['vec_idx', 'doc_idx']))

# then use it for indexing
with flow(backend='process') as fl:
    fl.index(bytes_gen=read_flowers(), batch_size=64)

🔰 You can find some resources here to help you getting started quickly:

🙇 Give it a try and we welcome your feedback and contribution.

from gnes.

ilham-bintang avatar ilham-bintang commented on May 17, 2024 1

Okay I will migrate my yml specs to pythonic gnes Flow new classes. Thank you gnes team!!

from gnes.

hanxiao avatar hanxiao commented on May 17, 2024

this usually happens when https_proxy or http_proxy set.
unset them and try again.

unset http_proxy && unset https_proxy

or in python

os.unsetenv('http_proxy')
os.unsetenv('https_proxy')

from gnes.

ilham-bintang avatar ilham-bintang commented on May 17, 2024

this usually happens when https_proxy or http_proxy set.
unset them and try again.

unset http_proxy && unset https_proxy

or in python

os.unsetenv('http_proxy')
os.unsetenv('https_proxy')

Actually I has been unset the https_proxy and unset http_proxy before run the client image. Here my client-query.sh:

unset https_proxy && unset http_proxy && docker run -it --rm --network host -v ${PWD}/data:/data/ nullphantom/faq-gnes:client --mode query --txt_file /data/questions.csv --prompt

from gnes.

ilham-bintang avatar ilham-bintang commented on May 17, 2024

This issue raised because there is another process on grpc port: 8800
try to kill all process and rerun

from gnes.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.