GithubHelp home page GithubHelp logo

nlmills / xdd Goto Github PK

View Code? Open in Web Editor NEW

This project forked from bws/xdd

1.0 4.0 1.0 41 MB

XDD - The eXtreme dd toolset

License: GNU General Public License v2.0

Shell 12.78% Python 10.67% Makefile 1.07% C 63.80% C++ 6.41% CSS 0.16% XSLT 0.59% M4 4.51%

xdd's Introduction

Build Instructions for XDD release
--
Supported OS:  Linux, AIX, OSX

On supported OS:
> ./configure
> make
> make install

By default, XDD and supporting scripts are installed in /usr/bin and /usr/lib, 
in order to change the installation path, use --prefix=<new path> during the 
configure step.  By default, the following features are enabled: XFS support,
NUMA support, and Infiniband support.  If you do not need these features, or
cannot install the relevant support libraries, you can disable each of these
features individually during configure with the following flags, respectively:
--disable-xfs, --disable-numa, and --disable-ib.

Build instructions for XDD repository code
--
If you are using the git repository version of XDD (i.e. you are a
prospective XDD developer), you will need to add one more step during the 
software build process.  We also suggest enabling debug mode.

On supported OS:
> autoconf
> ./configure --enable-debug
> make
> make install

XFS pre-allocation support
--
File preallocation on end-to-end transfers currently only works for the XFS
file system.  This is mainly because the posix_fallocate call is supported
inconsistently in Linux, and so we are making the direct fctl call in the
case of XFS file systems.  We attempt to enable preallocate on XFS if we can
find the correct headers in the default places.  But if the headers are not
easily locatable then we do not enable XFS preallocation support.  The
configure script controls xfs preallocation with with an explicit enable/disable
flag.  To guarantee that XFS preallocation is enable, use the following:

> ./configure --enable-xfs

To disable XFS preallocation, use the following instead:

> ./configure --disable-xfs

The defaults have been tested on Fedora 12, Scientific Linux, and Suse only.

Qdepth/Thread count advisory
--
In XDD, the number of threads is often governed by the queue depth option
or the thread count option.  The number of threads than may be created is
system dependent.  For example, on my laptop I can only create 916 threads
before the system returns a "resource busy or unavailable" error.  Its
not just a simple memory limitation necessarily either (i.e. reducing the
pthread stack size doesn't automatically increase the number of threads you
can create).  In general, the number of threads that can be initialized
by XDD is limited by the system rather than XDD.  This is mainly interesting
when using fork-thread type access patterns.

xdd's People

Contributors

tmruwart avatar nlmills avatar bws avatar jli439 avatar

Stargazers

 avatar

Watchers

James Cloos avatar  avatar David Carver avatar  avatar

Forkers

davidcarver

xdd's Issues

Add an option to set the username for xddmcp

Currently the xddmcp script opens an ssh session using the current user's name. However, it is desirable to allow the user to connect using a username specified on the command line.

Find what happens with multiple target passes and e2e

The old e2e code sent a special EOF packet, but XNI expects you to close the connection. Will XNI be able to close and open the connection again for every pass? If not, the protocol may have to be expanded or multiple passes disabled for remote transfers.

xddmcp password prompt is incorrect

When xddmcp prompts for a password it always uses the current username, even when a different username is given in the path spec. It should use the username given in the path spec. If no username was given then it can default to the current user.

Use XNI TCP by default for E2E transfers

Make XNI TCP the default for end-to-end transfers so that it isn't required to specify the -xni tcp option each time. Currently, if you attempt to transfer end-to-end without any -xni option you get the error

xdd: xint_e2e_target_init: could not initialize XNI for e2e target

Without this feature the transfer scripts like xddmcp are broken (they were built to use the older e2e code that has been removed).

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.