PDSH is truncating very long lines about pdsh

[GoogleCodeExporter]

Oh, that doesn't sound good. I'll try to work on this issue this weekend.

Thanks,
mark

Original comment by [email protected] on 3 Sep 2011 at 12:45

• Changed state: Accepted

[GoogleCodeExporter]

Can you give more details about how pdsh is trimming the output? I tried some 
very simple tests with long lines of output, a single long line of output, etc 
and
have not been able to reproduce this issue.

If your data isn't sensitive it might help a lot to attach the output of 
grep STRING /var/log/server.log* | grep VISUAL, or perhaps at first an example 
of
an original line of output, and one that has been mangled by pdsh.

Thanks!

Original comment by [email protected] on 3 Sep 2011 at 3:58

[GoogleCodeExporter]

Sorry, I _was_ able to reproduce this issue.

Currently, pdsh truncates lines at 8K.
I'm working on a fix.

Original comment by [email protected] on 4 Sep 2011 at 1:20

[GoogleCodeExporter]

Could you try the two attached patches? Together they should allow lines up to 
128K.

Original comment by [email protected] on 7 Sep 2011 at 3:50

Attachments:

• 0001-Increase-output-cbuf-max-size-to-128K.patch
• 0002-Use-a-dynamic-buffer-for-output-to-avoid-truncation.patch

[GoogleCodeExporter]

Yes, patches fixed the issue.

Thank you very much,
Nejat

Original comment by [email protected] on 7 Sep 2011 at 6:52

[GoogleCodeExporter]

Thanks for reporting the issue. This will be fixed in pdsh-2.27

Original comment by [email protected] on 7 Sep 2011 at 7:37

• Changed state: Fixed

[GoogleCodeExporter]

This issue was updated by revision 8117d3ac974c.


Add a test that reproduces the user observation that pdsh is truncating
very long lines. Lines of length > 8191 characters are probably required
to reproduce this behavior, which appears to be due to a static buffer
used in pdsh output routines, along with a maximum circular buffer size
of 8192 characters. Both issues will need to be resolved before this
test passes.

Original comment by [email protected] on 8 Sep 2011 at 4:37

[GoogleCodeExporter]

This issue was closed by revision c37f0b533b93.

Original comment by [email protected] on 8 Sep 2011 at 4:37