CMS has started the process of rolling out a new workload management system. This system is currently used for reprocessing and monte carlo production with tests under way using it for user analysis. It was decided to combine, as much as possible, the production/processing, analysis and T0 codebases so as to reduce duplicated functionality and make best use of limited developer and testing resources. This system now includes central request submission and management (Request Manager); a task queue for parcelling up and distributing work (WorkQueue) and agents which process requests by interfacing with disparate batch and storage resources (WMAgent).
We describe the architecture and discuss our operational experience in running the off-line reconstruction farm of the CDFII experiment. The Linux PC-based farm performs a wide set of tasks, ranging from producing calibrations and primary event reconstruction to large scale ntuple production. The farm control software uses a standard Condor toolkit [1] and the data handling part is based on SAM (Sequential Access via Metadata [2]) software. During its lifetime, the CDFII experiment will integrate a large amount of data (several petabytes) and the data processing chain is one of the key components of the successful physics program of the experiment.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.