Comments (7)
I looked into it a little bit and at CERN we only have the 10_4_X samples, as that is the dev release.
Issue #21.
from cmssw.
I'm having issues with the dataset availability at CERN, I've made a hypernews thread here: https://hypernews.cern.ch/HyperNews/CMS/get/comp-ops/4388.html
from cmssw.
I was not able to get a response on transferring datasets to CERN. Not sure who is managing T2_CH_CERN and under what conditions can we transfer data there using Phedex.
In any case, datasets can be defined here: https://github.com/jpata/cmssw/blob/pfvalidation-10_4_X-correct/Validation/RecoParticleFlow/test/datasets.py#L129
from cmssw.
OK, so we can't ask to transfer those datasets to CERN (see hn thread). I'm currently seeing how reliable reading them via xrootd from Caltech batch jobs will be.
Added ZMM and MinBias samples here: d9a89a7
from cmssw.
I discussed with Jean-Roch Vlimant, and to us it seemed more logical to transfer 1-2TB of samples to CERN than rely on xrootd daily in hundreds of batch jobs. Indeed, 99% of my batch jobs on lxplus failed because of the xrootd connection from CERN to FNAL.
Here is the Phedex request for the samples: https://cmsweb.cern.ch/phedex/prod/Request::View?request=1620067
from cmssw.
from cmssw.
To close this topic, we will likely have to ask for data to be moved to CERN if we want to run the code only at CERN. Likely we will need one set of datasets per major CMSSW release (few TB), not every RelVal (many TB per release?). LXbatch condor jobs opening files at FNAL will work but require resubmission occasionally.
from cmssw.
Related Issues (20)
- validor script to make response curve from raw response histograms HOT 9
- Script to make HTML pages and PDF plots more user-friendly HOT 6
- jet response definition HOT 11
- move from RECO -> MINIAOD in validation HOT 5
- Add a pt-dependent mean(response) plot HOT 8
- rebase to 10_4_X HOT 1
- README crashes HOT 3
- Cannot read files from cmsxrootd.fnal.gov HOT 1
- 'make plots' step crashes HOT 6
- Update readme based on 10_5_0_pre1? HOT 2
- CRAB recipe for PF validation HOT 7
- Save gen-jet spectrum in DQM HOT 3
- Move PFValidation development to new fork? HOT 6
- Current make QCD_post step can be done in DQM client code? HOT 2
- Response & resolution plot, add additional bin of 3<|eta|<4 ? HOT 1
- Try to revive legacy PFlowDQM and integrate it in our current workflow
- Plot style polishing HOT 1
- PFAlgo refactoring HOT 7
- particleFlow_cfi re-organization? HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from cmssw.