Comments (5)
thanks again ❤️ for trying GNES and giving feedback at the early stage. I'd like to introduce you the new GNES Flow API (available since v0.0.46
), enables a pythonic and intuitive way for building workflow in GNES. As an example, an indexing workflow can be simply defined as:
flow = (Flow(check_version=False, ctrl_with_ipc=True)
.add_preprocessor(name='prep', yaml_path='yaml/prep.yml', replicas=3)
.add_encoder(yaml_path='yaml/incep.yml', replicas=6)
.add_indexer(name='vec_idx', yaml_path='yaml/vec.yml')
.add_indexer(name='doc_idx', yaml_path='yaml/doc.yml', recv_from='prep')
.add_router(name='sync', yaml_path='BaseReduceRouter', num_part=2, recv_from=['vec_idx', 'doc_idx']))
# then use it for indexing
with flow(backend='process') as fl:
fl.index(bytes_gen=read_flowers(), batch_size=64)
🔰 You can find some resources here to help you getting started quickly:
- Image search demo using GNES Flow, Jupyter Notebook
- GNES Flow module documentation
- Getting started in GNES readme
🙇 Give it a try and we welcome your feedback and contribution.
from gnes.
Okay I will migrate my yml specs to pythonic gnes Flow new classes. Thank you gnes team!!
from gnes.
this usually happens when https_proxy
or http_proxy
set.
unset them and try again.
unset http_proxy && unset https_proxy
or in python
os.unsetenv('http_proxy')
os.unsetenv('https_proxy')
from gnes.
this usually happens when
https_proxy
orhttp_proxy
set.
unset them and try again.unset http_proxy && unset https_proxyor in python
os.unsetenv('http_proxy') os.unsetenv('https_proxy')
Actually I has been unset the https_proxy and unset http_proxy before run the client image. Here my client-query.sh
:
unset https_proxy && unset http_proxy && docker run -it --rm --network host -v ${PWD}/data:/data/ nullphantom/faq-gnes:client --mode query --txt_file /data/questions.csv --prompt
from gnes.
This issue raised because there is another process on grpc port: 8800
try to kill all process and rerun
from gnes.
Related Issues (20)
- Error while running examples on README HOT 3
- 🥮🌕Low maintenance during Mid-Autumn festival
- error while installing using pip HOT 2
- 🥟🥡🏖️ Low maintenance during public holidays Oct 1-7
- refactoring the core module by using c++ or golang HOT 1
- Waiting on channel to be ready HOT 6
- How to access gRPCFrontend?? HOT 1
- Scalability Benchmarking and combining text and image HOT 1
- Add a notice when indexing flow text is only accept Bytes. Not str HOT 2
- Add the HTTP Client to the flow
- How to use GNES for text classification? HOT 2
- Modify data records after indexed
- error when using bert in flow
- Poem search example without Docker
- Is this still maintained HOT 2
- Can you support sharding?
- semantic poem demo issues HOT 2
- I want to read the code, and understand the thought, which part should I read first? HOT 1
- Clarify storage and distribution APIs HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from gnes.