Comments (2)
[Old comment I've been meaning to post:]
You can sort of fake this in pftool, using e.g. "-C 1 -S 128M", to get it to assign sub-ranges. But those subranges will potentially get assigned to workers on different hosts, so they are requesting parts of the same object from different servers, which doesn't seem to work very well.
But we can fix that by changing the host-randomization to pick the server IP as a hash of the MD inode. Now, workers on different servers ask for subranges of the same object from the same server. But, those subranges still seem to be in an arbitrary order. So, that doesn't work very well, either.
from marfs.
This is done in marfs 82182f. Not sure it if it is still useful, given our recent discoveries about network tuning, but one can turn it off by setting the new repo.max_request_size parameter to 0 (or by not providing it).
from marfs.
Related Issues (20)
- return-codes from str_2_post(), etc, should distinguish version-mismatch from other errors
- marfs_statvfs() should reflect quota-limitations HOT 1
- Installation checker HOT 1
- sync_ and close_data() failures are masked HOT 2
- clean-up: always build with DAL/MDAL HOT 1
- Multiple Simultaneous Writers HOT 6
- rename / unlink bug HOT 1
- strip out DAL/MDAL build-options HOT 1
- misconfigured RDMA auth-file gets ENODATA from fuse
- MarFS trash semantics - HOT 2
- the system calls getxattr("security.capability") on every FUSE write()! HOT 1
- marfs_rename() should do trash_truncate on the destination HOT 9
- Pftool Libxml Include Requires Subdir HOT 1
- GC Rewrite: Per-Namespace Trash
- Quota Tool Modification: Per-Namespace Trash
- MarFS should do more in the setup process HOT 1
- Create a single node MarFS example
- Move documentation for MarFS online HOT 1
- Line wrap in install doc doesn't work as expected HOT 1
- Change multi line commands in tutorial to be one command HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from marfs.