Concurrent Framework Project (CF4Hep)

Goals

Development of key components of a concurrent framwork using as starting point the  existing Gaudi framework. The ultimate deliverables would be a set of components or libraries that can be used in any framework and at the same time to offered as a complete turnkey system with all these integrated.

Milestones

  1. Integration of the Concurrent Whiteboard demonstrator into Gaudi and characterisation of its performance (2012Q4)
  2. Run a restricted set of algrithms (Mini-Brunel) with the GaudiHive framework (2013Q2)

Resources

Thesis

  • I. Shapoval, Adaptive Scheduling Applied to Non-Deterministic Networks of Heterogeneous Tasks for Peak Throughput in Concurrent Gaudi, PhD Thesis, DOI:10.5281/zenodo.3866313, CERN/UNIFE/INFN, Apr 2016

Presentations

  • I. Shapoval, Low latency, scalable concurrency control in Gaudi Hive, 6th LHCb Computing Workshop, Paris, Nov 2015 (pdf)
  • I. Shapoval, Predictive scheduling for peak throughput in Gaudi Hive, 6th LHCb Computing Workshop, Paris, Nov 2015 (pdf)
  • I. Shapoval, Graph-Based Decision Making for Task Scheduling in Concurrent Gaudi, IEEE NSS 2015, Nov 2015 (link)
  • I. Shapoval, Gaudi Hive on the Landscape of Heterogeneous Computing, FCPMF, CERN, Sep 2015 (pdf)
  • I. Shapoval, Graph-based Scheduling in GaudiHive, FCPMF, CERN, Feb 2015 (link)
  • D.Piparo, Preparing HEP Software for Concurrency - Lessons learned from the Concurrent Gaudi Project, October 2013 (link)
  • B. Hegner, Introducing Concurrency in the Gaudi Data Processing Framework, October 2013 (link)
  • B. Hegner,  Running Concurrent Gaudi in Real Life - Status Update on MiniBrunel, ATLAS S&C Week, June 13th, 2013 (pdf)
  • D. Piparo, Running Concurrent Gaudi in Real Life - Status Update on MiniBrunel,  Concurrency Forum Meeting, June 5th, 2013 (pdf)
  • B. Hegner, Adding multithread support to Gaudi,  LHCb Computing Workshop, May 22th, 2013 (pdf)
  • P. Mato, Evolving LHC Data Processing Frameworks for Efficient Exploitation of New CPU Architectures, IEEE NSS, November 1st, 2012 (pdf
  • D. Piparo, Update on Whiteboard and Scheduler: Integration into Gaudi, Concurrency Forum meeting, September 26th, 2012 (pdf)

Papers

  • I. Shapoval et al, Graph-Based Decision Making for Task Scheduling in Concurrent Gaudi, Proceedings of IEEE NSS 2015, San Diego, doi:10.1109/NSSMIC.2015.7581843, pp 1-3
  • B.Hegner et al, Preparing HEP Software for Concurrency, Proceedings CHEP2013 (pdf)
  • B. Hegner et al,  Evolving LHC Data Processing Frameworks for Efficient Exploitation of New CPU Architectures, Proceedings IEEE-NSS 2012 (pdf)