GithubHelp home page GithubHelp logo

flow123d / swrap Goto Github PK

View Code? Open in Web Editor NEW
1.0 1.0 0.0 173 KB

Complete MPI wrapping for HPC singularity applications.

License: GNU General Public License v3.0

Shell 21.61% Dockerfile 3.77% Python 74.62%

swrap's Issues

recursive jobs

Starting ned jobs running in the same container need to take care of:

  • proper bindings, have to filter SINGULARITY_BIND and exclude /tmp and other non-shared directories
    possibly take care of new agent directories etc.
  • propper passing of env variables

Errors in integration tests

  1. Now on claster charon test end with error:
    INFO: Using cached SIF image
    Host key verification failed.
    =>> PBS: job killed: walltime 1241 exceeded limit 1200

review start fo ssh-agent

Proposed start of ssh-agent for local passphrases in .bashrc:

env=~/.ssh/agent.env

agent_load_env () { test -f "$env" && . "$env" >| /dev/null ; }

agent_start () {
    (umask 077; ssh-agent >| "$env")
    . "$env" >| /dev/null ; }
  • study meaning of agent.env
  • review initialization of the ssh-agent, at least we should check that it is already running

Minimize dependency

Python implementation still depends on the Python. Moreover if we want to separate it to more modules it must probably be installed. That could make problems if pip and/or venv is not available. To this end we propose:

  1. use only standard Python packages
  2. Do not use setuptools, make main bash scripts that calls python with modified PYTHONPATH.
  3. For stable pieces of the code reimplement it in pure bash/sh.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.