Comments (15)
Unfortunately I've never got the chance to play with it, so I don't really know.
However I don't see any reasons why you wouldn't give it a try :).
@Ulexus will definitely answer your question but as far as I know he is currently on Holidays so you might have to wait a bit :).
from ceph-container.
Correct me if I'm wrong but as I understand this issue,
In some earlier docker versions --volumes-from also worked from containers with network nfs shares etc. But then it was removed (mount namespaces added or modified) and --volumes-from some-other-container
containing remote mounts no longer worked.
Therefore rbd-volume will never work while docker has this limitation. A pity that! Because of the direction docker seems to be taking in this regard, I think rbd-volume should now be removed as it's never going to work and it appears unlikely it ever will. Instead they are coming up with an alternative method (storage drivers?) but these haven't yet implemented for ceph I think.
Which leaves only the rbd device mounted from the host or from the container directly. On CoreOS mounting on the host is difficult so here is my best alternative which you may find useful - rbdmap (Full credit to Laurent Barbe for the initial implementation and details of how it works).
from ceph-container.
Thanks to a number of patches from @dmitryint (rbd-related PRs), it works in special cases, but I wouldn't design a system around it.
At best, it is a stop-gap hack to work around lack of RBD support for Docker volumes. I looked at implementing that a year or so ago, and at that time, I didn't see a good place to hook in RBD support to the volume code. I'm hoping with the new storage driver, that will change... but up to this point, I believe that only affects the container root, not volumes.
For now, it is (as @hookenz just said), best to mount the RBD volumes to the host and bind-mount them into the container, which is what I do.
from ceph-container.
Hmm, that docker rbd-volume fix @dmitryint came up with looks interesting! I'll have to experiment with that. But, am I wrong in thinking that shouldn't work actually?
from ceph-container.
As I'm combing through my vacation email, I see a reference to this on the docker-dev list:
https://github.com/calavera/dkvolume
Docker has volume plugins, now. Yay! That's definitely the way to go for rbd-volume
, not the current implementation.
from ceph-container.
@Ulexus - If I get some time over the next week I'll write a volume plugin for RBD.
from ceph-container.
Checkout this docker-volume-ceph-rbd I have just discovered :-)
from ceph-container.
@h0tbird - Sweet! Does it work!?
from ceph-container.
Of course, this is all well and good, but on CoreOS you're kindof stuck with the stable (not experimental branch) of docker. Which means these efforts can't be used by most people yet. Still, it's an exciting development. Looking forward to seeing this in the mainstream.
from ceph-container.
@hookenz I don't know if it works I guess we have to try it ;-)
Thank you all for the info! I think I have enough to close the issue now.
from ceph-container.
A note: Docker version 1.8.0 was just release with official support for volume plugins.
from ceph-container.
So far on the radar:
- https://github.com/contiv/volplugin
- https://github.com/yp-engineering/rbd-docker-plugin
- https://github.com/AcalephStorage/docker-volume-ceph-rbd
from ceph-container.
I'm planning on testing this soon.
from ceph-container.
@leseb great! I have already started to test one.
Check this issue I have just opened: yp-engineering/rbd-docker-plugin#1
from ceph-container.
@h0tbird just looked at the various repositories, setting up all these things is not as easy as I thought it'd be :). It looks like someone has started an interesting initiative here: contiv-experimental/volplugin#10
from ceph-container.
Related Issues (20)
- /opt/ceph-container/bin/osd_disk_prepare.sh: line 46: ceph-disk: command not found HOT 7
- Need fix for CVE-2022-21797 HOT 4
- Bootstrap process hangs up for hours HOT 2
- not found /var/lib/ceph/osd/ceph-2//keyring HOT 2
- dnf update in ceph v18 container image is failing HOT 2
- RocksDBStore - cannot set permissions: Operation not permitted HOT 2
- /usr/bin/ceph: stderr Error EIO: Module 'cephadm' has experienced an error and cannot handle commands: ContainerInspectInfo HOT 2
- add ceph-mgr-callhome to IBM downstream container HOT 2
- cephadm has failed ContainerInspectInfo HOT 2
- populate_kvstore error HOT 1
- rename and repurpose this repository HOT 19
- reef builds don't work HOT 12
- Question about osd directory HOT 2
- docker-compose setup dose not run as expected mds and osd HOT 3
- With new quay.io/ceph/ceph:v16 image, ceph-csi meet segfault error HOT 2
- ceph/demo container does not expose mon port 3300 HOT 2
- Instructions for getting the zabbix template to work with rook-ceph HOT 2
- smartctl could not scrape metrics from HPE Smart Array in HBA mode HOT 2
- support VERSION=8 for contrib/compose-rhcs.sh
- Include cephfs-shell HOT 7
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from ceph-container.