Comments (4)
zakheav
commented on May 3, 2024
- 采样是训练过程中进行的，这样比提前采样好的优点在于整体花费时间的降低（相当于流水线）。
- 这600个worker是训练的tf运行的机器，5台是euler服务运行的机器。
from euler.
thtb
commented on May 3, 2024
- 采样是训练过程中进行的，这样比提前采样好的优点在于整体花费时间的降低（相当于流水线）。
- 这600个worker是训练的tf运行的机器，5台是euler服务运行的机器。
再请教下，每个worker需要50G内存，为什么需要这么大的内存
from euler.
zakheav
commented on May 3, 2024
这里只是docker启动分配了50g内存，并不是实际上用了那么多。
from euler.
thtb
commented on May 3, 2024
每个worker需要存局部还是全部的参数，内存使用是怎样的
from euler.
Related Issues (20)
- ThreadLocalRandom() 随机数分布问题 - sample_neighbor_layerwise OP
- 找不到ppi_data.py
- samle_node样遇到 euler service cpu 100% 一直没有结果卡死问题
- pip install euler_gl python版本冲突导致失败 HOT 1
- pip install成功，site-packages下没有源码
- 关于节点权重
- install Grpc error
- 记 euler2 分布式例子run_ppi.sh 失败的原因
- 请问多ps 多euler的情况下有infer的例子可以借鉴吗
- euler目前支持导入预训练的embedding向量吗？ HOT 1
- from euler.tools import json2dat相关
- euler2的graphsage怎么设置use_id=true
- 如何使用Euler做分布式的Embedding训练
- euler1 使用ppi数据集 无监督graphsage训练 loss突然特别特别大
- 子图采样的时候为什么将每一层的源节点拼接？ HOT 1
- Euler1 邻居采样去重
- ValueError: inputs must be a list of at least oneTensor/IndexedSlices with the same dtype and shape
- sample_edge的输出shape是[count,3]吗？
- relation_cov code not understand
- 采样策略是入度还是出度
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from euler.