grid-announce November 2005

grid-announce@nikhef.nl

2 participants
2 discussions

quota on sandbox directories
by Ronald Starink 15 Nov '05

15 Nov '05

Dear grid users, The resource broker service in the NIKHEF grid facility has recently been hindered by a full disk. The full disk contained the sandbox directories. (The sandbox directory of a job contains the input files before submission and the output after execution of the job). As a consequence, it was not possible to submit jobs via the NIKHEF grid facility. After investigation of the problem, it was obvious that: 1) Users sometimes store very large files (>> 10MB) in their sandbox directories. 2) The contents of sandbox directories are not retrieved after the job ends. What can you do to prevent this problem? 1) If your jobs produce output files larger than circa 1 MB, do not leave the files in the sandbox directory, but copy the them to a storage element. Please refer to http://www.dutchgrid.nl/Org/Nikhef/tutorial.pdf for an introduction of using storage elements. Smaller files can be left in the sandbox. 2) Fetch the output of your jobs after the jobs have finished. What have we done to prevent this problem in the future? 1) We have enabled quota on the disk containing the sandboxes. Every user has a quotum that is sufficiently large to run hundreds of grid jobs and store the output of small files in the sandbox directories. Any output that does not fit in the quotum will be lost. 2) We will enable clean up scripts that automatically remove the contents of sandbox directories after 28 days. It will not be possible to retrieve the output after this period of 28 days. Best regards, Ronald -- Ronald Starink ** National Institute for Nuclear and High Energy Physics ** Room: H1.57 Phone: +31 20 5925180 ** PObox 41882, NL-1009DB Amsterdam NL

1 0

problems with RB @ NIKHEF
by Jeff Templon 08 Nov '05

08 Nov '05

Hi *, there are problems with the RB at NIKHEF right now. These problems started yesterday afternoon but were 'user-invisible' ... the RB would accept jobs but they were not submitted to sites for execution. I managed to push some of these jobs through earlier today, right now for debugging purposes I have disabled job submission completely. More info as I have it. JT

1 1

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

grid-announce November 2005