User:Spieker: Difference between revisions

From KIP Wiki
⧼kip-jumptonavigation⧽⧼kip-jumptosearch⧽
(Created page with "= Useful Commands = == Analysis == pkgco.py -r <PACKAGE NAME> pkgco.py -s <PACKAGE NAME> # just show currently used package version cmt co -r MyPackage-00-00-01 Path/To...")
 
 
(9 intermediate revisions by the same user not shown)
Line 2: Line 2:


== Analysis ==
== Analysis ==

svn ls svn+ssh://svn.cern.ch/reps/any/repo/you/want/e.g./atlasoff/or/atlasphys-sm/


pkgco.py -r <PACKAGE NAME>
pkgco.py -r <PACKAGE NAME>
pkgco.py -s <PACKAGE NAME> # just show currently used package version
pkgco.py -s <PACKAGE NAME> # just show currently used package version
cmt co -r MyPackage-00-00-01 Path/To/MyPackage
cmt co -r MyPackage-00-00-01 Path/To/MyPackage
svn co svn+ssh://svn.cern.ch/reps/atlasphys-sm/Physics/StandardModel/Common/BootstrapGenerator/tags/BootstrapGenerator-01-10-01

showVersions athena | grep AthAnalysisBase
showVersions athena | grep AthAnalysisBase
python /afs/cern.ch/work/w/will/public/showConfigurables.py
python /afs/cern.ch/work/w/will/public/showConfigurables.py
Line 18: Line 22:
$CALIBPATH - dev/PileupReweighting/ - get the default config for pileup reweighting from here
$CALIBPATH - dev/PileupReweighting/ - get the default config for pileup reweighting from here
type -a <BINARY> - find where your binary is lying
type -a <BINARY> - find where your binary is lying

== Rucio ==

rucio list-account-usage spieker | grep -v SCRATCHDISK
rucio list-account-limits spieker | grep LOCALGROUPDISK


== L1Calo ==
== L1Calo ==
Line 25: Line 34:
== Farm ==
== Farm ==


=== Check fragmentation level: ===
⚫
Clean jobs from hens
* interactive
⚫
farm_allHensCmd 'pkill -u <USER>'
xfs_db -r /dev/sdd
> frag
* command line
xfs_db -r -c frag /dev/sdd


=== Change quota on field ===
Manage nodes
* check quota
http://docs.adaptivecomputing.com/8-1-0/basic/Content/topics/torque/commands/pbsnodes.htm
xfs_quota -xc 'report -h' /data
pbsnodes -o hen01.atlas-farm.kip.uni-heidelberg.de-0 (offline hen)
* change quota
pbsnodes -r hen01.atlas-farm.kip.uni-heidelberg.de-0 (release hen from offline)
xfs_quota -x -c 'limit bsoft=2500g bhard=2500g <username>' /data
⚫
=== Clean jobs from hens ===
⚫
farm_allHensCmd 'pkill -u <USER>'


Linux security options
=== Linux security options ===
setenforce
setenforce
getenforce
getenforce
Line 39: Line 56:
getsebool -P (permanent)
getsebool -P (permanent)


Open website via ssh tunnel
=== Open website via ssh tunnel ===
* in terminal:
* in terminal:
ssh -L 9000:192.168.0.238:8888 spieker@rooster01.kip.uni-hiedelberg.de
ssh -L 9000:192.168.0.238:8888 spieker@rooster01.kip.uni-hiedelberg.de
* in browser
* in browser
localhost:9000
localhost:9000

= MadGraph Event Generation =

== Installation ==

*get madgraph
wget https://launchpad.net/mg5amcnlo/2.0/2.5.x/+download/MG5_aMC_v2.5.2.tar.gz
*untar
tar -xvzf MG5_aMC_v2.5.2.tar.gz
*setup current python and gcc version (necessary for NLO calculations)
setupATLAS
lsetup root (sets up all most current compilers)

<blockquote>
'''Versions at setup'''
Requested: root ...
Setting up gcc gcc493_x86_64_slc6 ...
Setting up python 2.7.9p1-x86_64-slc6-gcc49 ...
Skipping: python 2.7 x86_64 already setup.
Setting up gsl 1.10-x86_64-slc6-gcc49-opt ...
Setting up fftw 3.1.2-x86_64-slc6-gcc49-opt ...
Setting up root 6.04.14-x86_64-slc6-gcc49-opt ...
Setting up xrootd 4.2.3-x86_64-slc6 ...
Setting up davix 0.6.4-x86_64-slc6 ...
</blockquote>

*run
cd MG5_aMC_v2_5_2 && ./bin/mg5_aMC
*install plugins
install delphes
install pythia-pgs
install pythia8
install madevent

== Find MC command to generate ==

rucio ls mc15_13TeV:mc15_13TeV*aMcAtNlo*yyW*
rucio get mc15_13TeV:mc15_13TeV.342621.aMcAtNloHerwigppEvtGen_UEEE5_CTEQ6L1_CT10ME_hh_yyWW.evgen.log.e4419
tar zxvf log.06501703._000001.job.log.tgz.1
search job_setup.sh for Generate_tf.py
GetTfCommand.py --AMI p1575

== Standalone Generate Wyy @ NLO ==

*in ./mg5_aMC
generate p p > W+ a a [QCD]
output Wpaa_NLO
launch

== OTF Generate Wyy @ NLO ==

Create EVNT files using MadGraph

most important link: https://twiki.cern.ch/twiki/bin/viewauth/AtlasProtected/MadGraph5aMCatNLOForAtlas
asetup 19.2.5.15,here

Convert EVNT files to DAOD TRUTH

see: https://twiki.cern.ch/twiki/bin/view/AtlasProtected/TruthDAOD
asetup 20.1.8.3,AtlasDerivation,gcc48,here
Reco_tf.py --inputEVNTFile EVNT.root --outputDAODFile test.pool.root --reductionConf TRUTH1

Latest revision as of 16:25, 10 November 2017

Useful Commands

Analysis

svn ls svn+ssh://svn.cern.ch/reps/any/repo/you/want/e.g./atlasoff/or/atlasphys-sm/

pkgco.py -r <PACKAGE NAME>
pkgco.py -s <PACKAGE NAME>   # just show currently used package version
cmt co -r MyPackage-00-00-01 Path/To/MyPackage
svn co svn+ssh://svn.cern.ch/reps/atlasphys-sm/Physics/StandardModel/Common/BootstrapGenerator/tags/BootstrapGenerator-01-10-01

showVersions athena | grep AthAnalysisBase
python /afs/cern.ch/work/w/will/public/showConfigurables.py
cmt find_packages; cmt compile
cmt show packages
checkSG.py <xAOD FILE>
checkxAOD.py <xAOD FILE>

Looking for stuff

sometimes athena know how to find stuff and you dont know where it is looking for it? 

$CALIBPATH - dev/PileupReweighting/ - get the default config for pileup reweighting from here
type -a <BINARY> - find where your binary is lying

Rucio

 rucio list-account-usage spieker | grep -v SCRATCHDISK
 rucio list-account-limits spieker | grep LOCALGROUPDISK

L1Calo

setupL1CALO (problably only works on lxplus)

Farm

Check fragmentation level:

  • interactive
 xfs_db -r /dev/sdd
 > frag
  • command line
 xfs_db -r -c frag /dev/sdd

Change quota on field

  • check quota
 xfs_quota -xc 'report -h' /data
  • change quota
 xfs_quota -x -c 'limit bsoft=2500g bhard=2500g <username>' /data

Clean jobs from hens

farm_allHensCmd 'pkill -u <USER>'

Linux security options

setenforce
getenforce
setsebool -a (all)
getsebool -P (permanent)

Open website via ssh tunnel

  • in terminal:
ssh -L 9000:192.168.0.238:8888 spieker@rooster01.kip.uni-hiedelberg.de
  • in browser
localhost:9000

MadGraph Event Generation

Installation

  • get madgraph
wget https://launchpad.net/mg5amcnlo/2.0/2.5.x/+download/MG5_aMC_v2.5.2.tar.gz
  • untar
tar -xvzf MG5_aMC_v2.5.2.tar.gz
  • setup current python and gcc version (necessary for NLO calculations)
setupATLAS
lsetup root (sets up all most current compilers)

Versions at setup Requested: root ... Setting up gcc gcc493_x86_64_slc6 ... Setting up python 2.7.9p1-x86_64-slc6-gcc49 ... Skipping: python 2.7 x86_64 already setup. Setting up gsl 1.10-x86_64-slc6-gcc49-opt ... Setting up fftw 3.1.2-x86_64-slc6-gcc49-opt ... Setting up root 6.04.14-x86_64-slc6-gcc49-opt ... Setting up xrootd 4.2.3-x86_64-slc6 ... Setting up davix 0.6.4-x86_64-slc6 ...

  • run
cd MG5_aMC_v2_5_2 && ./bin/mg5_aMC
  • install plugins
install delphes
install pythia-pgs
install pythia8
install madevent

Find MC command to generate

rucio ls mc15_13TeV:mc15_13TeV*aMcAtNlo*yyW*
rucio get mc15_13TeV:mc15_13TeV.342621.aMcAtNloHerwigppEvtGen_UEEE5_CTEQ6L1_CT10ME_hh_yyWW.evgen.log.e4419
tar zxvf log.06501703._000001.job.log.tgz.1

search job_setup.sh for Generate_tf.py 

GetTfCommand.py --AMI p1575

Standalone Generate Wyy @ NLO

  • in ./mg5_aMC
generate p p > W+ a a [QCD]
output Wpaa_NLO
launch

OTF Generate Wyy @ NLO

Create EVNT files using MadGraph 

most important link: https://twiki.cern.ch/twiki/bin/viewauth/AtlasProtected/MadGraph5aMCatNLOForAtlas
asetup 19.2.5.15,here

Convert EVNT files to DAOD TRUTH 

see: https://twiki.cern.ch/twiki/bin/view/AtlasProtected/TruthDAOD
asetup 20.1.8.3,AtlasDerivation,gcc48,here
Reco_tf.py --inputEVNTFile EVNT.root --outputDAODFile test.pool.root --reductionConf TRUTH1
Retrieved from "https://wiki.kip.uni-heidelberg.de/KIPwiki/index.php?title=User:Spieker&oldid=34557"