GithubHelp home page GithubHelp logo

airnandez / lsst-cvmfs Goto Github PK

View Code? Open in Web Editor NEW
4.0 3.0 1.0 3.46 MB

How to configure CernVM FS to use LSST binary distribution [won't be updated - please see https://sw.lsst.eu]

Shell 100.00%
lsst cvmfs lsst-science-pipelines stack

lsst-cvmfs's People

Contributors

airnandez avatar crosset avatar

Stargazers

avatar avatar avatar avatar

Watchers

avatar avatar avatar

Forkers

crosset

lsst-cvmfs's Issues

feedback

1/ The install procedure works with Ubuntu 12.04
2/ As deb or rpm files are "curl"-ed from CERN, it might be useful to have official repositories loaded in the system to get notices of upgrades to CERN VMFS. Do these exist?

Running the demo using v12.0.rc1 fails on Ubuntu

Running the stack demo on Ubuntu using v12.0.rc1 does not work. This is the error message:

$ source /cvmfs/lsst.in2p3.fr/software/linux-x86_64/lsst-v12.0.rc1/loadLSST.bash
$ setup obs_sdss
$ ./bin/demo.sh 
Setting up: astrometry_net_data             Flavor: Linux64    Version: LOCAL:/home/ubuntu/lsst/lsst_dm_stack_demo-12.0.rc1/lsst_dm_stack_demo/astrometry_net_data
Traceback (most recent call last):
  File "/cvmfs/lsst.in2p3.fr/software/linux-x86_64/lsst-v12.0.rc1/Linux64/pipe_tasks/2016_01.0-48-g7bf2411/bin/processCcd.py", line 23, in <module>
    from lsst.pipe.tasks.processCcd import ProcessCcdTask
  File "/cvmfs/lsst.in2p3.fr/software/linux-x86_64/lsst-v12.0.rc1/Linux64/pipe_tasks/2016_01.0-48-g7bf2411/python/lsst/pipe/tasks/processCcd.py", line 22, in <module>
    from lsst.ip.isr import IsrTask
  File "/cvmfs/lsst.in2p3.fr/software/linux-x86_64/lsst-v12.0.rc1/Linux64/ip_isr/2016_01.0-16-g395f455/python/lsst/ip/isr/__init__.py", line 24, in <module>
    from .isrLib import *
  File "/cvmfs/lsst.in2p3.fr/software/linux-x86_64/lsst-v12.0.rc1/Linux64/ip_isr/2016_01.0-16-g395f455/python/lsst/ip/isr/isrLib.py", line 34, in <module>
    _isrLib = swig_import_helper()
  File "/cvmfs/lsst.in2p3.fr/software/linux-x86_64/lsst-v12.0.rc1/Linux64/ip_isr/2016_01.0-16-g395f455/python/lsst/ip/isr/isrLib.py", line 30, in swig_import_helper
    _mod = imp.load_module('_isrLib', fp, pathname, description)
  File "/cvmfs/lsst.in2p3.fr/software/linux-x86_64/lsst-v12.0.rc1/Linux64/base/2.2016.10-2-ge90c490+1/python/lsstimport.py", line 102, in imp_load_module
    module = orig_imp_load_module(name, *args)
ImportError: libssl.so.10: cannot open shared object file: No such file or directory

Note that this is a known issue and the experts are investigating how to solve it.

I'll keep this issue open until a solution or turnaround is found.

Python compatibility issue

I'm trying to help convert a workflow for use on GridPP, and attempting to use the version of EUPS that comes as part of the LSST CVMFS, but running into issues with creating a new version of Python. The version that is bundled with the GridPP VM (v2.6.6) is too old for use with this workflow, but when I run setup on the new Python install (v2.7.8), everything to do with eups (setup, unsetup, eups list, etc) fails. This seems to be due to the fact that the EUPS version on the LSST CVMFS hardcodes the use of the system version of Python (e.g. /usr/bin/python in eups_setup) instead of the newly-setup version. This causes some issues with compatibility (particularly with future and _weakref), since the system Python is now looking for libraries in places that don't exist, since setup altered the environment variables to suit the new version of Python. Do you know of a way to make sure that the two are kept separate? This isn't technically a CVMFS problem, but I would be surprised if people didn't run into this issue with using it, and I'm hoping someone has an answer.

Cheers

Unable to loadLSST.bash on Mac

I followed the instructions for installing on my Mac (10.10.5), and everything seemed successful up until the instruction to run loadLSST.bash:

$ source loadLSST.bash 
-bash: /Users/Mike/Astro/lsst/eups/bin/setups.sh: No such file or directory
-bash: setup: command not found
-bash: setup: command not found

I guess I need to install eups? This wasn't mentioned in the installation instructions anywhere as far as I saw.

Also, looking at this script, it looks like it's going to want to setup anaconda. Am I going to need to install anaconda too? This can't just use the regular system python? This should be mentioned in the installation instructions too if this is the case.

v12.0.rc1 does not work on Ubuntu 14.04

There is an issue when using v12.0.rc1 on Ubuntu 14.04. There is an error when setting up the environment:

$ source /cvmfs/lsst.in2p3.fr/software/linux-x86_64/lsst-v12.0.rc1/loadLSST.bash 
-bash: /bin/python: No such file or directory
/cvmfs/lsst.in2p3.fr/software/linux-x86_64/lsst-v12.0.rc1/eups/bin/eups_setup: 6: /cvmfs/lsst.in2p3.fr/software/linux-x86_64/lsst-v12.0.rc1/eups/bin/eups_setup: /bin/python: not found
setup: command not found
setup: command not found

Note that the binary distributed via CernVM FS was built on CentOS 7 where the /bin/python file exists.

We are investigating how to solve / turnaround this issue.

Add lsst-v14.0?

Thank you for the very nice tool and distribution. I was wondering if there were plans to add lsst-v14.0?

Error downloading CernVM FS software from CERN repository

We noticed that there is currently an issue while downloading software packages from CERN repository. You may observe the following error message:

$ curl -O https://ecsft.cern.ch/dist/cvmfs/cvmfs-2.1.19/cvmfs-2.1.19-1.el6.x86_64.rpm
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
curl: (60) SSL certificate problem: Invalid certificate chain
More details here: http://curl.haxx.se/docs/sslcerts.html

curl performs SSL certificate verification by default, using a "bundle"
 of Certificate Authority (CA) public keys (CA certs). If the default
 bundle file isn't adequate, you can specify an alternate file
 using the --cacert option.
If this HTTPS server uses a certificate signed by a CA represented in
 the bundle, the certificate verification probably failed due to a
 problem with the certificate (it might be expired, or the name might
 not match the domain name in the URL).
If you'd like to turn off curl's verification of the certificate, use
 the -k (or --insecure) option.

The cause of this issue is that the server ecsft.cern.ch hosting the software is presenting a certificate which has a distinguished name (DN) cernvm.cern.ch. The curl command above notices that the host name and the certificate DN do not match and stops.

We were told by the CernVM FS developers that this is a transient situation and will be fixed soon. The turnaround is to add the -k option to the curl command, for instance:

$ curl -k -O https://ecsft.cern.ch/dist/cvmfs/cvmfs-2.1.19/cvmfs-2.1.19-1.el6.x86_64.rpm

We will keep this issue open until the problem with the server is fixed.

Running lsst v11.0 demo on Ubuntu 14.04 does not work

We have observed that running the v11.0 demo on Ubuntu 14.04 using the binary distribution does not work. The binary distribution of v11.0 was built on CentOS 7.

This is the error message:

Setting up: astrometry_net_data             Flavor: Linux64    Version: LOCAL:/home/ubuntu/lsst/lsst_dm_stack_demo-11.0/astrometry_net_data
Traceback (most recent call last):
  File "/cvmfs/lsst.in2p3.fr/software/linux-x86_64/lsst-v11.0/Linux64/obs_sdss/11.0+2/bin/processCcdSdss.py", line 23, in <module>
    from lsst.obs.sdss.processCcdSdss import ProcessCcdSdssTask
  File "/cvmfs/lsst.in2p3.fr/software/linux-x86_64/lsst-v11.0/Linux64/obs_sdss/11.0+2/python/lsst/obs/sdss/__init__.py", line 23, in <module>
    from sdssMapper import *
  File "/cvmfs/lsst.in2p3.fr/software/linux-x86_64/lsst-v11.0/Linux64/obs_sdss/11.0+2/python/lsst/obs/sdss/sdssMapper.py", line 24, in <module>
    import lsst.pex.policy as pexPolicy
  File "/cvmfs/lsst.in2p3.fr/software/linux-x86_64/lsst-v11.0/Linux64/pex_policy/11.0/python/lsst/pex/policy/__init__.py", line 23, in <module>
    from policyLib import *
  File "/cvmfs/lsst.in2p3.fr/software/linux-x86_64/lsst-v11.0/Linux64/pex_policy/11.0/python/lsst/pex/policy/policyLib.py", line 34, in <module>
    _policyLib = swig_import_helper()
  File "/cvmfs/lsst.in2p3.fr/software/linux-x86_64/lsst-v11.0/Linux64/pex_policy/11.0/python/lsst/pex/policy/policyLib.py", line 30, in swig_import_helper
    _mod = imp.load_module('_policyLib', fp, pathname, description)
  File "/cvmfs/lsst.in2p3.fr/software/linux-x86_64/lsst-v11.0/Linux64/base/11.0/python/lsstimport.py", line 102, in imp_load_module
    module = orig_imp_load_module(name, *args)
ImportError: libicudata.so.50: cannot open shared object file: No such file or directory

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.