TY - GEN
T1 - A science-gateway workload archive to study pilot jobs, user activity, bag of tasks, task sub-steps, and workflow executions
AU - Da Silva, Rafael Ferreira
AU - Glatard, Tristan
PY - 2013
Y1 - 2013
N2 - Archives of distributed workloads acquired at the infrastructure level reputably lack information about users and application-level middleware. Science gateways provide consistent access points to the infrastructure, and therefore are an interesting information source to cope with this issue. In this paper, we describe a workload archive acquired at the science-gateway level, and we show its added value on several case studies related to user accounting, pilot jobs, fine-grained task analysis, bag of tasks, and workflows. Results show that science-gateway workload archives can detect workload wrapped in pilot jobs, improve user identification, give information on distributions of data transfer times, make bag-of-task detection accurate, and retrieve characteristics of workflow executions. Some limits are also identified.
AB - Archives of distributed workloads acquired at the infrastructure level reputably lack information about users and application-level middleware. Science gateways provide consistent access points to the infrastructure, and therefore are an interesting information source to cope with this issue. In this paper, we describe a workload archive acquired at the science-gateway level, and we show its added value on several case studies related to user accounting, pilot jobs, fine-grained task analysis, bag of tasks, and workflows. Results show that science-gateway workload archives can detect workload wrapped in pilot jobs, improve user identification, give information on distributions of data transfer times, make bag-of-task detection accurate, and retrieve characteristics of workflow executions. Some limits are also identified.
UR - http://www.scopus.com/inward/record.url?scp=84874402786&partnerID=8YFLogxK
U2 - 10.1007/978-3-642-36949-0_10
DO - 10.1007/978-3-642-36949-0_10
M3 - Conference contribution
AN - SCOPUS:84874402786
SN - 9783642369483
T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
SP - 79
EP - 88
BT - Euro-Par 2012 - Parallel Processing Workshops
T2 - Parallel Processing Workshops, Euro-Par 2012: BDMC 2012, CGWS 2012, HeteroPar 2012, HiBB 2012, OMHI 2012, Paraphrase 2012, PROPER 2012, Resilience 2012, UCHPC 2012, VHPC 2012
Y2 - 27 August 2012 through 31 August 2012
ER -