Comments (9)
Because secret sort is non-trivial. I'm also confused about it now, sort algorithm couldn't be parallelized. :(
try bitonic sort which is highly parallelable
from spu.
Hi @BeStrongok,
jnp.median
in this example requires secret sort, which is not supported by SPU right now.
But you can expect this feature in the upcoming releases.
Best
from spu.
Hi @BeStrongok,
jnp.median
in this example requires secret sort, which is not supported by SPU right now.But you can expect this feature in the upcoming releases.
Best
Thanks, looking for this feature!
from spu.
Because secret sort is non-trivial. I'm also confused about it now, sort algorithm couldn't be parallelized. :(
from spu.
Because secret sort is non-trivial. I'm also confused about it now, sort algorithm couldn't be parallelized. :(
Yes, it is non-trivial and hard to optimize, but yes, we are working on it. :D
Stay tuned
from spu.
Because secret sort is non-trivial. I'm also confused about it now, sort algorithm couldn't be parallelized. :(
try bitonic sort which is highly parallelable
Nice suggestion, trying...
from spu.
Actually, current spu should be able to implement data structure like, top-k heap.
Then median can be done using top-(N/2) heap.
from spu.
Actually, current spu should be able to implement data structure like, top-k heap. Then median can be done using top-(N/2) heap.
This really depends on how JAX implement median.
Right now they are using quantile(..., 0.5) to compute median, and quantile is using sort with a crazy comparator when input is floating point to handle nonfinite values and negative zero, which we don't really care.
During the compilation pipeline, when we have the semi-optimized IR, it is definitely possible to discover and rewrite this pattern with some efforts.
This kind of specific pattern rewrite is obviously not a unicorn, but still hacky...We are trying to see if this can be solved in a more elegant way.
from spu.
Fixed with #107
from spu.
Related Issues (20)
- [Bug]: 运行llama的toturial出错 HOT 19
- spu通信部分能否替换为python HOT 16
- Implementation question of cheetah protocol in SPU. HOT 10
- Need help about running task in WAN setting. HOT 2
- [Feature]: BumbleBee Code HOT 5
- spu编译问题 HOT 6
- [Bug]: 运行一段时间之后无法连接上端口模拟进程server HOT 13
- [Bug]: pip install spu 之后无法运行端口server
- [Bug]: 关于Max和Min,现在是希望返回输入值中的一个,而不是那一个的近似值,我们该怎么解决 HOT 7
- [Bug]: 执行ABY隐私计算时,在launch节点之后,bazel 运行示例无法执行ppd.init(conf["nodes"], conf["devices"]) HOT 4
- [Bug]: 使用static_argnums无法传入参数 HOT 1
- spu bazel编译问题 HOT 5
- [Bug]: 无法重现LLama的example HOT 14
- [Feature]: Discussions about the concept of SPU compiler. HOT 2
- [Bug]: puma example: Fail to listen 127.0.0.1:61930 HOT 2
- [Bug]: stuck when running puma HOT 7
- [Feature]: SPU或者secretflow有办法直接导入密文吗?比如已经share好了的bool共享或者算数共享 HOT 12
- semi2k方案,水平场景下多方计算方差、标准差误差较大,是否有提高精度的方法 HOT 20
- 如何通过日志看两方加法发送的数据 HOT 12
- [Bug]: spu返回结果时不能聚合,报错说KeyError: ObjRef(c2d95221-44ca-49f4-9297-3baa13058179 at node:4) HOT 6
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from spu.