ct-grid January 2009

ct-grid@nikhef.nl

8 participants
8 discussions

[Ct-grid] Next BiG Grid Meeting: Monday 2 February at 13.30 in H3.31
by Dennis van Dok 30 Jan '09

30 Jan '09

The next BiG Grid meeting will be held on Monday 2 February, at 13.30h in room H3.31. Video conferencing is available. Agenda: - Operations summary (10min) - Middleware - Applications - AOB Notes will be taken by Jan Just. Minutes of previous meetings can be found on: http://www.nikhef.nl/pub/departments/ct/grid/2009/ Enjoy the weekend! Dennis van Dok -- D.H. van Dok :: Software Engineer :: www.nikhef.nl :: www.vl-e.nl Phone +31 20 592 50 12 :: http://www.nikhef.nl/~dennisvd/

1 0

[Ct-grid] update Ganga installation at NIKHEF
by Hurng-Chun Lee 29 Jan '09

29 Jan '09

Hello, I just updated the Ganga installation at NIKHEF to version 5.1.4 (release note: http://ganga.web.cern.ch/ganga/release/5.1.4/release/ReleaseNotes-5.1.4) . by sourcing "/project/atlas/nikhef/ganga/etc/setup.(c)sh", you are pointed to this version by default. An important new feature is that the FileStager has been supported through the "DQ2Dataset" for jobs running on the Grid. To enable it, just do j.inputdata.type = 'FILE_STAGER' before submitting jobs to the Grid. Preliminary tests on the Grid show some encouragement in using FileStager concerning the performance and same level of reliability as other data copy mode. We will try to improve the reliability in the next Ganga release. Enjoy! Cheers, Hurng

1 0

[Ct-grid] risks
by Jeff Templon 25 Jan '09

25 Jan '09

Yo comp.risks was pretty good this week: http://catless.ncl.ac.uk/Risks/25.52.html I especially like the part about "nothing works unless everything works", sound familiar? JT

1 0

[Ct-grid] of significant local interest
by Jeff Templon 21 Jan '09

21 Jan '09

Yo, See http://indico.cern.ch/conferenceDisplay.py?confId=46744 item 1: deployment plan for the EGEE authz service. it was received mostly positively. item 2 : roadmap for deployment of CREAM and phaseout of lcg-CE. JT

1 0

[Ct-grid] Next BiG Grid Meeting Monday 19 January 13.30 in H3.20
by Dennis van Dok 16 Jan '09

16 Jan '09

The next BiG Grid meeting will be held on Monday 19 January, at 13.30h in room H3.20. There will be no video conferencing. Agenda: - Presentation by Andriaan van der Zee about "Troubleshooting Grid Authentication" (10min) - Operations summary (10min) - Middleware - Applications - AOB Notes will be taken by Ronald. Minutes of previous meetings can be found on: http://www.nikhef.nl/pub/departments/ct/grid/2009/ Enjoy the weekend! --Dennis -- D.H. van Dok :: Software Engineer :: www.nikhef.nl :: www.vl-e.nl Phone +31 20 592 50 12 :: http://www.nikhef.nl/~dennisvd/

1 0

[Ct-grid] DMTCP anyone?
by Sander Klous 13 Jan '09

13 Jan '09

Hi, Ever used this? If so, does it work? > DMTCP is a distributed checkpointing system that can not only checkpoint > sequential programs, but also threaded programs (with pthreads), families > of processes (made with fork), and distributed processes across machines > (like MPI). You can find reference for it here: > > http://dmtcp.sourceforge.net/ > Would it be worthwhile to investigate DMTCP on grid and see how well it works by wrapping it around the job execution boundaries? Thanks, Sander

4 3

[Ct-grid] Grid Meetings in 2009
by Dennis van Dok 06 Jan '09

06 Jan '09

Hi *, in order to stay 'out of sync' with other regular meetings, the upcoming BiG Grid meetings are scheduled on the 1st and 3rd Mondays of each month. This should be easy enough to remember, and as a bonus the sirens at 1200h every first Monday of the month act as a timely warning to have an early lunch! To make things even easier, most of the meetings will be held in H3.31. Cheers, Dennis van Dok -- D.H. van Dok :: Software Engineer :: www.nikhef.nl :: www.vl-e.nl Phone +31 20 592 50 12 :: http://www.nikhef.nl/~dennisvd/

1 0

[Ct-grid] Happy new year: some NDPF stats of 2008 for entertainment
by David Groep 03 Jan '09

03 Jan '09

Hi all, A happy new year to all of you. Apart from all our regular accounting and billing, there are also a few nice graphs to extract from our accounting data. For the Nikhef part, a couple of nice figures for your enjoyment: In 2008, we processed 1441182 jobs, and on average 660 cores were in use averaged over the year. This is the equivalent of a little over 1 million days of work on a 1Ghz Pentium-III system, so if we had used pizza0-class boxes to do this work, we would have needed 1415 of them, or 70 racks full. The average CPU/wall efficiency was 86.3% December was the busiest month, with 221200 jobs, of which quite a sizeable faction (actually most) were submitted during the New-Year break. So, we can happily go on holidays, it's good for business :-) Also, 32 unique groups used our facility, from 25 different user communities (of which only 4 are dedicated to infrastructure testing). Many job submissions are also automated, or people like working over the week-end. Although working days see a slightly higher submission rate, it's not more than ~ 20% over the week-end submission rate. (see the graph below). And Wednesday is the most popular day to start working on the grid. In general, we see more submissions over the course of 2008, also prompted of course by the number of cores available. If you look at job submissions per core, it is rather constant (which means that in forst order all nodes we will buy and commissions will just be used. There is no slack in demand :-). Nice detail: if you reduce the capacity, like what happened to us is May/June 2008, the jobs keep coming, and thus job the submission count per core goes up. Enjoy the database! Cheers, DavidG. -- David Groep ** Nikhef, Dutch National Institute for Sub-atomic Physics,PDP/Grid group ** ** Room: H1.56 Phone: +31 20 5922179, PObox 41882, NL-1009DB Amsterdam NL **

1 0

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

ct-grid January 2009