HLTEventLoopMgr Class Reference

Basic event loop and scheduler for fast HLT reconstruction. More...

#include <src/HLTEventLoopMgr.h>

Inheritance diagram for HLTEventLoopMgr:

Collaboration diagram for HLTEventLoopMgr:

Classes
struct	HLTExecutionTask

Public Member Functions
StatusCode	initialize () override
	implementation of IService::initialize More...
StatusCode	reinitialize () override
	implementation of IService::reinitialize More...
StatusCode	finalize () override
	implementation of IService::finalize More...
StatusCode	nextEvent (int maxevt) override
	implementation of IEventProcessor::nextEvent More...
StatusCode	executeEvent (void *par) override
	implementation of IEventProcessor::executeEvent(void* par) More...
StatusCode	executeRun (int maxevt) override
	implementation of IEventProcessor::executeRun() More...
StatusCode	stopRun () override
	implementation of IEventProcessor::stopRun() More...
Public Member Functions inherited from extends< Service, IEventProcessor >
void *	i_cast (const InterfaceID &tid) const override
	Implementation of IInterface::i_cast. More...
StatusCode	queryInterface (const InterfaceID &ti, void **pp) override
	Implementation of IInterface::queryInterface. More...
std::vector< std::string >	getInterfaceNames () const override
	Implementation of IInterface::getInterfaceNames. More...
Public Member Functions inherited from Service
const std::string &	name () const override
	Retrieve name of the service. More...
StatusCode	configure () override
StatusCode	initialize () override
StatusCode	start () override
StatusCode	stop () override
StatusCode	finalize () override
StatusCode	terminate () override
Gaudi::StateMachine::State	FSMState () const override
Gaudi::StateMachine::State	targetFSMState () const override
StatusCode	reinitialize () override
StatusCode	restart () override
StatusCode	sysInitialize () override
	Initialize Service. More...
StatusCode	sysStart () override
	Initialize Service. More...
StatusCode	sysStop () override
	Initialize Service. More...
StatusCode	sysFinalize () override
	Finalize Service. More...
StatusCode	sysReinitialize () override
	Re-initialize the Service. More...
StatusCode	sysRestart () override
	Re-initialize the Service. More...
	Service (std::string name, ISvcLocator *svcloc)
	Standard Constructor. More...
SmartIF< ISvcLocator > &	serviceLocator () const override
	Retrieve pointer to service locator. More...
StatusCode	setProperties ()
	Method for setting declared properties to the values specified for the job. More...
template<class T >
StatusCode	service (const std::string &name, const T *&psvc, bool createIf=true) const
	Access a service by name, creating it if it doesn't already exist. More...
template<class T >
StatusCode	service (const std::string &name, T *&psvc, bool createIf=true) const
template<typename IFace = IService>
SmartIF< IFace >	service (const std::string &name, bool createIf=true) const
template<class T >
StatusCode	service (const std::string &svcType, const std::string &svcName, T *&psvc) const
	Access a service by name and type, creating it if it doesn't already exist. More...
template<class T >
StatusCode	declareTool (ToolHandle< T > &handle, std::string toolTypeAndName, bool createIf=true)
	Declare used tool. More...
SmartIF< IAuditorSvc > &	auditorSvc () const
	The standard auditor service.May not be invoked before sysInitialize() has been invoked. More...
Public Member Functions inherited from PropertyHolder< CommonMessaging< implements< IService, IProperty, IStateful > > >
	PropertyHolder ()=default
Gaudi::Details::PropertyBase &	declareProperty (Gaudi::Details::PropertyBase &prop)
	Declare a property. More...
Gaudi::Details::PropertyBase *	declareProperty (const std::string &name, TYPE &value, const std::string &doc="none")
	Helper to wrap a regular data member and use it as a regular property. More...
Gaudi::Details::PropertyBase *	declareProperty (const std::string &name, Gaudi::Property< TYPE, VERIFIER, HANDLERS > &prop, const std::string &doc="none")
	Declare a PropertyBase instance setting name and documentation. More...
Gaudi::Details::PropertyBase *	declareRemoteProperty (const std::string &name, IProperty *rsvc, const std::string &rname="")
	Declare a remote property. More...
StatusCode	setProperty (const Gaudi::Details::PropertyBase &p) override
	set the property form another property More...
StatusCode	setProperty (const std::string &s) override
	set the property from the formatted string More...
StatusCode	setProperty (const std::string &n, const std::string &v) override
	set the property from name and the value More...
StatusCode	setProperty (const std::string &name, const TYPE &value)
	set the property form the value More...
StatusCode	getProperty (Gaudi::Details::PropertyBase *p) const override
	get the property More...
const Gaudi::Details::PropertyBase &	getProperty (const std::string &name) const override
	get the property by name More...
StatusCode	getProperty (const std::string &n, std::string &v) const override
	convert the property to the string More...
const std::vector< Gaudi::Details::PropertyBase * > &	getProperties () const override
	get all properties More...
bool	hasProperty (const std::string &name) const override
	Return true if we have a property with the given name. More...
	PropertyHolder (const PropertyHolder &)=delete
PropertyHolder &	operator= (const PropertyHolder &)=delete
Public Member Functions inherited from CommonMessaging< implements< IService, IProperty, IStateful > >
MSG::Level	msgLevel () const
	get the cached level (originally extracted from the embedded MsgStream) More...
bool	msgLevel (MSG::Level lvl) const
	get the output level from the embedded MsgStream More...
MSG::Level	outputLevel () const
	Backward compatibility function for getting the output level. More...
Public Member Functions inherited from CommonMessagingBase
virtual	~CommonMessagingBase ()=default
	Virtual destructor. More...
const SmartIF< IMessageSvc > &	msgSvc () const
	The standard message service. More...
MsgStream &	msgStream () const
	Return an uninitialized MsgStream. More...
MsgStream &	msgStream (const MSG::Level level) const
	Predefined configurable message stream for the efficient printouts. More...
MsgStream &	always () const
	shortcut for the method msgStream(MSG::ALWAYS) More...
MsgStream &	fatal () const
	shortcut for the method msgStream(MSG::FATAL) More...
MsgStream &	err () const
	shortcut for the method msgStream(MSG::ERROR) More...
MsgStream &	error () const
	shortcut for the method msgStream(MSG::ERROR) More...
MsgStream &	warning () const
	shortcut for the method msgStream(MSG::WARNING) More...
MsgStream &	info () const
	shortcut for the method msgStream(MSG::INFO) More...
MsgStream &	debug () const
	shortcut for the method msgStream(MSG::DEBUG) More...
MsgStream &	verbose () const
	shortcut for the method msgStream(MSG::VERBOSE) More...
MsgStream &	msg () const
	shortcut for the method msgStream(MSG::INFO) More...

Private Member Functions
StatusCode	declareEventRootAddress ()
	Declare the root address of the event. More...
StatusCode	eventFailed (EventContext *eventContext) const
	Method to check if an event failed and take appropriate actions. More...
void	promoteToExecuted (std::unique_ptr< EventContext > eventContext) const

Private Attributes
friend	HLTExecutionTask
Gaudi::Property< std::string >	m_histPersName {this, "HistogramPersistency", "", ""}
Gaudi::Property< std::string >	m_evtsel {this, "EvtSel", "", ""}
Gaudi::Property< int >	m_threadPoolSize {this, "ThreadPoolSize", -1, "Size of the threadpool initialised by TBB"}
Gaudi::Property< std::string >	m_whiteboardSvcName {this, "WhiteboardSvc", "EventDataSvc", "The whiteboard name"}
Gaudi::Property< std::string >	m_dotfile
Gaudi::Property< std::vector< std::string > >	m_topAlgs {this, "TopAlg", {}}
IDataManagerSvc *	m_evtDataMgrSvc = nullptr
	Reference to the Event Data Service's IDataManagerSvc interface. More...
IEvtSelector *	m_evtSelector = nullptr
	Reference to the Event Selector. More...
IDataManagerSvc *	m_histoDataMgrSvc = nullptr
	Reference to the Histogram Data Service. More...
IConversionSvc *	m_histoPersSvc = nullptr
	Reference to the Histogram Persistency Service. More...
IHiveWhiteBoard *	m_whiteboard = nullptr
	Reference to the Whiteboard. More...
IAlgExecStateSvc *	m_algExecStateSvc = nullptr
	Reference to the AlgExecStateSvc. More...
std::atomic< unsigned int >	m_finishedEvt {0}
	atomic count of the number of finished events More...
std::condition_variable	m_createEventCond
	condition variable to wake up main thread when we need to create a new event More...
std::mutex	m_createEventMutex
	mutex assoiciated with m_createEventCond condition variable More...
IEvtSelector::Context *	m_evtSelContext {nullptr}
	event selector context More...
std::vector< Gaudi::Algorithm * >	m_algos
	Vector of algorithms to run for every event. More...

Additional Inherited Members
Public Types inherited from extends< Service, IEventProcessor >
using	base_class = extends
	Typedef to this class. More...
using	extend_interfaces_base = extend_interfaces< Interfaces... >
	Typedef to the base of this class. More...
Public Types inherited from Service
using	Factory = Gaudi::PluginService::Factory< IService *(const std::string &, ISvcLocator *)>
Public Types inherited from PropertyHolder< CommonMessaging< implements< IService, IProperty, IStateful > > >
using	PropertyHolderImpl = PropertyHolder< CommonMessaging< implements< IService, IProperty, IStateful > > >
	Typedef used to refer to this class from derived classes, as in. More...
Public Types inherited from CommonMessaging< implements< IService, IProperty, IStateful > >
using	base_class = CommonMessaging
Public Types inherited from extend_interfaces< Interfaces... >
using	ext_iids = typename Gaudi::interface_list_cat< typename Interfaces::ext_iids... >::type
	take union of the ext_iids of all Interfaces... More...
Protected Member Functions inherited from Service
	~Service () override
	Standard Destructor. More...
int	outputLevel () const
	get the Service's output level More...
Protected Member Functions inherited from PropertyHolder< CommonMessaging< implements< IService, IProperty, IStateful > > >
Gaudi::Details::PropertyBase *	property (const std::string &name) const
Protected Member Functions inherited from CommonMessaging< implements< IService, IProperty, IStateful > >
MSG::Level	setUpMessaging () const
	Set up local caches. More...
MSG::Level	resetMessaging ()
	Reinitialize internal states. More...
void	updateMsgStreamOutputLevel (int level)
	Update the output level of the cached MsgStream. More...
Protected Attributes inherited from Service
Gaudi::StateMachine::State	m_state = Gaudi::StateMachine::OFFLINE
	Service state. More...
Gaudi::StateMachine::State	m_targetState = Gaudi::StateMachine::OFFLINE
	Service state. More...
Gaudi::Property< int >	m_outputLevel {this, "OutputLevel", MSG::NIL, "output level"}
Gaudi::Property< bool >	m_auditInit {this, "AuditServices", false, "[[deprecated]] unused"}
Gaudi::Property< bool >	m_auditorInitialize {this, "AuditInitialize", false, "trigger auditor on initialize()"}
Gaudi::Property< bool >	m_auditorStart {this, "AuditStart", false, "trigger auditor on start()"}
Gaudi::Property< bool >	m_auditorStop {this, "AuditStop", false, "trigger auditor on stop()"}
Gaudi::Property< bool >	m_auditorFinalize {this, "AuditFinalize", false, "trigger auditor on finalize()"}
Gaudi::Property< bool >	m_auditorReinitialize {this, "AuditReinitialize", false, "trigger auditor on reinitialize()"}
Gaudi::Property< bool >	m_auditorRestart {this, "AuditRestart", false, "trigger auditor on restart()"}
SmartIF< IAuditorSvc >	m_pAuditorSvc
	Auditor Service. More...

Detailed Description

Basic event loop and scheduler for fast HLT reconstruction.

It uses one fifo queue per tbb thread and schedules full events on a given thread by putting all algos in the dedicated queue from the beginning.

Definition at line 21 of file HLTEventLoopMgr.h.

Member Function Documentation

StatusCode HLTEventLoopMgr::declareEventRootAddress ( )

private

Declare the root address of the event.

Definition at line 500 of file HLTEventLoopMgr.cpp.

                                                    {
  IOpaqueAddress* pAddr = nullptr;
  StatusCode      sc    = m_evtSelector->next( *m_evtSelContext );
  if ( sc.isSuccess() ) {
    // Create root address and assign address to data service
    sc = m_evtSelector->createAddress( *m_evtSelContext, pAddr );
    if ( !sc.isSuccess() ) {
      sc = m_evtSelector->next( *m_evtSelContext );
      if ( sc.isSuccess() ) {
        sc = m_evtSelector->createAddress( *m_evtSelContext, pAddr );
        if ( !sc.isSuccess() ) warning() << "Error creating IOpaqueAddress." << endmsg;
      }
    }
  }
  if ( !sc.isSuccess() ) {
    info() << "No more events in event selection " << endmsg;
    return StatusCode::FAILURE;
  }
  sc = m_evtDataMgrSvc->setRoot( "/Event", pAddr );
  if ( !sc.isSuccess() ) { warning() << "Error declaring event root address." << endmsg; }
  return StatusCode::SUCCESS;
}

StatusCode HLTEventLoopMgr::eventFailed ( EventContext *  eventContext ) const

private

Method to check if an event failed and take appropriate actions.

It can be possible that an event fails.

In this case this method is called. It dumps the state of the scheduler, drains the actions (without executing them) and events in the queues and returns a failure.

Definition at line 528 of file HLTEventLoopMgr.cpp.

                                                                          {
  fatal() << "*** Event " << eventContext->evt() << " on slot " << eventContext->slot() << " failed! ***" << endmsg;
  std::ostringstream ost;
  m_algExecStateSvc->dump( ost, *eventContext );
  info() << "Dumping Alg Exec State for slot " << eventContext->slot() << ":\n" << ost.str() << endmsg;
  return StatusCode::FAILURE;
}

StatusCode HLTEventLoopMgr::executeEvent ( void *  par )

override

implementation of IEventProcessor::executeEvent(void* par)

Definition at line 382 of file HLTEventLoopMgr.cpp.

                                                                   {
  // Leave the interface intact and swallow this C trick.
  int& createdEvts = *reinterpret_cast<int*>( createdEvts_IntPtr );

  auto evtContext = std::make_unique<EventContext>();
  evtContext->set( createdEvts, m_whiteboard->allocateStore( createdEvts ) );
  m_algExecStateSvc->reset( *evtContext );

  StatusCode sc = m_whiteboard->selectStore( evtContext->slot() );
  if ( sc.isFailure() ) {
    fatal() << "Slot " << evtContext->slot() << " could not be selected for the WhiteBoard\n"
            << "Impossible to create event context" << endmsg;
    return StatusCode::FAILURE;
  }

  StatusCode declEvtRootSc = declareEventRootAddress();
  if ( declEvtRootSc.isFailure() ) { // We ran out of events!
    createdEvts = -1;                // Set created event to a negative value: we finished!
    return StatusCode::SUCCESS;
  }

  // Now add event to the scheduler
  if ( msgLevel( MSG::DEBUG ) )
    debug() << "Event " << evtContext->evt() << " submitting in slot " << evtContext->slot() << endmsg;

  // Event processing slot forced to be the same as the wb slot
  tbb::task* task = new ( tbb::task::allocate_root() )
      HLTExecutionTask( m_algos, std::move( evtContext ), serviceLocator(), m_algExecStateSvc, this );
  tbb::task::enqueue( *task );

  if ( msgLevel( MSG::DEBUG ) )
    debug() << "All algorithms were submitted on event " << evtContext->evt() << " in slot " << evtContext->slot()
            << endmsg; // FIXME: use after std::move..

  createdEvts++;
  return StatusCode::SUCCESS;
}

StatusCode HLTEventLoopMgr::executeRun ( int  maxevt )

inlineoverride

implementation of IEventProcessor::executeRun()

Definition at line 39 of file HLTEventLoopMgr.h.

{ return nextEvent( maxevt ); }

StatusCode HLTEventLoopMgr::finalize ( )

override

implementation of IService::finalize

Definition at line 348 of file HLTEventLoopMgr.cpp.

                                     {
  StatusCode sc;
  // Save Histograms Now
  if ( m_histoPersSvc ) {
    HistogramAgent agent;
    sc = m_histoDataMgrSvc->traverseTree( &agent );
    if ( sc.isSuccess() ) {
      const IDataSelector& objects = agent.selectedObjects();
      // skip /stat entry!
      sc = std::accumulate( begin( objects ), end( objects ), sc, [&]( StatusCode s, const auto& i ) {
        IOpaqueAddress* pAddr = nullptr;
        StatusCode      iret  = m_histoPersSvc->createRep( i, pAddr );
        if ( iret.isSuccess() ) i->registry()->setAddress( pAddr );
        return s.isFailure() ? s : iret;
      } );
      sc = std::accumulate( begin( objects ), end( objects ), sc, [&]( StatusCode s, const auto& i ) {
        IRegistry* reg  = i->registry();
        StatusCode iret = m_histoPersSvc->fillRepRefs( reg->address(), i );
        return s.isFailure() ? s : iret;
      } );
      if ( sc.isSuccess() ) {
        info() << "Histograms converted successfully according to request." << endmsg;
      } else {
        error() << "Error while saving Histograms." << endmsg;
      }
    } else {
      error() << "Error while traversing Histogram data store" << endmsg;
    }
  }

  StatusCode sc2 = Service::finalize();
  return sc.isFailure() ? sc2.ignore(), sc : sc2;
}

StatusCode HLTEventLoopMgr::initialize ( )

override

implementation of IService::initialize

Definition at line 137 of file HLTEventLoopMgr.cpp.

                                       {
  StatusCode sc = Service::initialize();
  if ( !sc.isSuccess() ) {
    error() << "Failed to initialize Service Base class." << endmsg;
    return StatusCode::FAILURE;
  }
  // Setup access to event data services
  m_evtDataMgrSvc = serviceLocator()->service<IDataManagerSvc>( "EventDataSvc" );
  if ( !m_evtDataMgrSvc ) {
    fatal() << "Error retrieving EventDataSvc interface IDataManagerSvc." << endmsg;
    return StatusCode::FAILURE;
  }
  m_whiteboard = serviceLocator()->service<IHiveWhiteBoard>( "EventDataSvc" );
  if ( !m_whiteboard ) {
    fatal() << "Error retrieving EventDataSvc interface IHiveWhiteBoard." << endmsg;
    return StatusCode::FAILURE;
  }
  // Obtain the IProperty of the ApplicationMgr
  IProperty* appMgrProperty = serviceLocator()->service<IProperty>( "ApplicationMgr" );
  if ( !appMgrProperty ) {
    fatal() << "IProperty interface not found in ApplicationMgr." << endmsg;
    return StatusCode::FAILURE;
  }
  // We do not expect a Event Selector necessarily being declared
  setProperty( appMgrProperty->getProperty( "EvtSel" ) ).ignore();

  if ( m_evtsel != "NONE" || m_evtsel.length() == 0 ) {
    m_evtSelector = serviceLocator()->service<IEvtSelector>( "EventSelector" );
  } else {
    m_evtSelector = nullptr;
    warning() << "Unable to locate service \"EventSelector\" " << endmsg;
    warning() << "No events will be processed from external input." << endmsg;
  }

  // Setup access to histogramming services
  m_histoDataMgrSvc = serviceLocator()->service<IDataManagerSvc>( "HistogramDataSvc" );
  if ( !m_histoDataMgrSvc ) {
    fatal() << "Error retrieving HistogramDataSvc." << endmsg;
    return sc;
  }
  // Setup histogram persistency
  m_histoPersSvc = serviceLocator()->service<IConversionSvc>( "HistogramPersistencySvc" );
  if ( !m_histoPersSvc ) {
    warning() << "Histograms cannot not be saved - though required." << endmsg;
    return sc;
  }

  m_algExecStateSvc = serviceLocator()->service<IAlgExecStateSvc>( "AlgExecStateSvc" );
  if ( !m_algExecStateSvc ) {
    fatal() << "Error retrieving AlgExecStateSvc" << endmsg;
    return StatusCode::FAILURE;
  }

  if ( !m_topAlgs.empty() ) {
    auto databroker = serviceLocator()->service<IDataBroker>( "HiveDataBrokerSvc" );
    // the only control flow supported here is to run the 'topAlgs' (and their depedencies) in a 'lazy_and' fashion
    // as a result, we can just 'flatten' the list, and make sure algorithms appear only once (the latter is not
    // strictly neccessary, but an optimization)
    for ( const auto& alg : m_topAlgs.value() ) {
      auto algs = databroker->algorithmsRequiredFor( alg );
      std::copy_if( begin( algs ), end( algs ), std::back_inserter( m_algos ), [this]( const Gaudi::Algorithm* a ) {
        return std::find( begin( this->m_algos ), end( this->m_algos ), a ) == end( this->m_algos );
      } );
    }
  } else {
    // Get the list of algorithms
    IAlgResourcePool* algResourcePool = serviceLocator()->service<IAlgResourcePool>( "AlgResourcePool" );
    if ( !algResourcePool ) {
      fatal() << "Error retrieving AlgoResourcePool" << endmsg;
      return StatusCode::FAILURE;
    }
    for ( auto alg : algResourcePool->getFlatAlgList() ) {
      Algorithm* algoPtr = dynamic_cast<Algorithm*>( alg );
      if ( !algoPtr ) {
        fatal() << "Could not convert IAlgorithm into Algorithm: this will result in a crash." << endmsg;
      }
      m_algos.push_back( algoPtr );
    }
    /* Dependencies
     1) Look for handles in algo, if none
     2) Assume none are required
    */
    DataObjIDColl globalInp, globalOutp;

    boost::optional<std::ofstream> dot{boost::in_place_init_if, !m_dotfile.empty(), m_dotfile.value()};

    if ( dot ) {
      *dot << "digraph G {\n";
      for ( auto* a : m_algos ) {
        bool is_consumer = a->outputDataObjs().empty();
        *dot << '\"' << a->name() << "\" [shape=box" << ( is_consumer ? ",style=filled" : "" ) << "];\n";
      }
    }

    // figure out all outputs
    std::map<DataObjID, Gaudi::Algorithm*> producers;
    for ( Gaudi::Algorithm* algoPtr : m_algos ) {
      for ( auto id : algoPtr->outputDataObjs() ) {
        auto r        = globalOutp.insert( id );
        producers[id] = algoPtr;
        if ( !r.second ) {
          warning() << "multiple algorithms declare " << id
                    << " as output! could be a single instance in multiple paths "
                       "though, or control flow may guarantee only one runs...!"
                    << endmsg;
        }
      }
    }

    // Building and printing Data Dependencies
    std::vector<DataObjIDColl> algosDependencies;
    algosDependencies.reserve( m_algos.size() ); // reserve so that pointers into the vector do not get invalidated...
    std::map<const Gaudi::Algorithm*, DataObjIDColl*> algo2Deps;
    info() << "Data Dependencies for Algorithms:";

    for ( Gaudi::Algorithm* algoPtr : m_algos ) {
      info() << "\n  " << algoPtr->name();

      DataObjIDColl algoDependencies;
      if ( !algoPtr->inputDataObjs().empty() || !algoPtr->outputDataObjs().empty() ) {
        for ( const DataObjID* idp : sortedDataObjIDColl( algoPtr->inputDataObjs() ) ) {
          DataObjID id = *idp;
          info() << "\n    o INPUT  " << id;
          if ( id.key().find( ":" ) != std::string::npos ) {
            info() << " contains alternatives which require resolution...\n";
            auto tokens = boost::tokenizer<boost::char_separator<char>>{id.key(), boost::char_separator<char>{":"}};
            auto itok   = std::find_if( tokens.begin(), tokens.end(), [&]( const std::string& t ) {
              return globalOutp.find( DataObjID{t} ) != globalOutp.end();
            } );
            if ( itok != tokens.end() ) {
              info() << "found matching output for " << *itok << " -- updating scheduler info\n";
              id.updateKey( *itok );
            } else {
              error() << "failed to find alternate in global output list"
                      << " for id: " << id << " in Alg " << algoPtr->name() << endmsg;
            }
          }
          algoDependencies.insert( id );
          if ( dot ) *dot << DataObjIDDotRepr{id} << " -> \"" << algoPtr->name() << "\";\n";
          globalInp.insert( id );
        }
        for ( const DataObjID* id : sortedDataObjIDColl( algoPtr->outputDataObjs() ) ) {
          info() << "\n    o OUTPUT " << *id;
          if ( id->key().find( ":" ) != std::string::npos ) {
            error() << " in Alg " << algoPtr->name() << " alternatives are NOT allowed for outputs! id: " << *id
                    << endmsg;
          }
          if ( dot ) *dot << '\"' << algoPtr->name() << "\" -> " << DataObjIDDotRepr{*id} << ";\n";
        }
      } else {
        info() << "\n      none";
      }
      algosDependencies.emplace_back( algoDependencies );
      algo2Deps[algoPtr] = &algosDependencies.back();
    }
    if ( dot ) {
      for ( const auto& t : globalOutp ) {
        if ( globalInp.find( t ) == globalInp.end() ) *dot << DataObjIDDotRepr{t} << " [style=filled];\n";
      }
      *dot << "}\n";
    }
    info() << endmsg;

    // Check if we have unmet global input dependencies
    DataObjIDColl unmetDep;
    for ( auto o : globalInp ) {
      if ( globalOutp.find( o ) == globalOutp.end() ) unmetDep.insert( o );
    }
    if ( unmetDep.size() > 0 ) {
      std::ostringstream ost;
      for ( const DataObjID* o : sortedDataObjIDColl( unmetDep ) ) {
        ost << "\n   o " << *o << "    required by Algorithm: ";
        for ( const auto& i : algo2Deps ) {
          if ( i.second->find( *o ) != i.second->end() ) { ost << "\n       * " << i.first->name(); }
        }
      }
      fatal() << "The following unmet INPUT dependencies were found:" << ost.str() << endmsg;
      return StatusCode::FAILURE;
    } else {
      info() << "No unmet INPUT data dependencies were found" << endmsg;
    }

    // rework the flat algo list to respect data dependencies
    auto start = m_algos.begin();
    auto end   = m_algos.end();
    auto current =
        std::partition( start, end, [&algo2Deps]( const Gaudi::Algorithm* algo ) { return algo2Deps[algo]->empty(); } );

    // Repeatedly put in front algos for which input are already fullfilled
    while ( current != end ) {
      current = std::partition( current, end, [start, current, &producers, &algo2Deps]( const Gaudi::Algorithm* algo ) {
        return std::none_of( algo2Deps[algo]->begin(), algo2Deps[algo]->end(),
                             [start, current, &producers]( const DataObjID& id ) {
                               return std::find( start, current, producers[id] ) == current;
                             } );
      } );
    }
  }

  // Clearly inform about the level of concurrency
  info() << "Concurrency level information:" << endmsg;
  info() << " o Number of events slots: " << m_whiteboard->getNumberOfStores() << endmsg;
  info() << " o TBB thread pool size: " << m_threadPoolSize << endmsg;

  // Fill the containers to convert algo names to index
  debug() << "Order of algo execution :" << endmsg;
  for ( const Gaudi::Algorithm* algo : m_algos ) debug() << "  . " << algo->name() << endmsg;

  return sc;
}

StatusCode HLTEventLoopMgr::nextEvent ( int  maxevt )

override

implementation of IEventProcessor::nextEvent

Definition at line 429 of file HLTEventLoopMgr.cpp.

                                                  {
  // Calculate runtime
  using Clock = std::chrono::high_resolution_clock;

  // Reset the application return code.
  auto appmgr = serviceLocator()->as<IProperty>();
  Gaudi::setAppReturnCode( appmgr, Gaudi::ReturnCode::Success, true ).ignore();

  // create m_evtSelContext used internally in executeEvent and more
  // precisely in declareEventRootAddress. Cannot be passed through the interface
  // without breaking other schedulers
  StatusCode sc = m_evtSelector->createContext( m_evtSelContext );
  if ( !sc.isSuccess() ) {
    fatal() << "Can not create the event selector Context." << endmsg;
    return sc;
  }

  // create th tbb thread pool
  tbb::task_scheduler_init tbbSchedInit( m_threadPoolSize.value() + 1 );

  int createdEvts = 0;
  // Run the first event before spilling more than one
  bool newEvtAllowed = false;

  info() << "Starting loop on events" << endmsg;
  auto start_time = Clock::now();
  while ( maxevt < 0 || m_finishedEvt < (unsigned int)maxevt ) {
    // if the created events did not reach maxevt, create an event
    if ( !( ( newEvtAllowed || createdEvts == 0 ) && // Launch the first event alone
                                                     // The events are not finished with an unlimited number of events
            createdEvts >= 0 &&
            // The events are not finished with a limited number of events
            ( createdEvts < maxevt || maxevt < 0 ) &&
            // There are still free slots in the whiteboard
            m_whiteboard->freeSlots() > 0 ) ) {

      std::unique_lock<std::mutex> lock{m_createEventMutex};
      using namespace std::chrono_literals;
      m_createEventCond.wait_for( lock, 1ms, [this, newEvtAllowed, createdEvts, maxevt] {
        return ( newEvtAllowed ||
                 createdEvts == 0 ) && // Launch the first event alone
                                       // The events are not finished with an unlimited number of events
               createdEvts >= 0 &&
               // The events are not finished with a limited number of events
               ( createdEvts < maxevt || maxevt < 0 ) &&
               // There are still free slots in the whiteboard
               this->m_whiteboard->freeSlots() > 0;
      } );
      continue;
    }
    if ( 1 == createdEvts ) // reset counter to count from event 1
      start_time = Clock::now();

    // TODO can we adapt the interface of executeEvent for a nicer solution?
    StatusCode sc = StatusCode::RECOVERABLE;
    sc            = executeEvent( &createdEvts );
    if ( !sc.isSuccess() ) return StatusCode::FAILURE; // else we have an success --> exit loop
    newEvtAllowed = true;
  } // end main loop on finished events
  auto end_time = Clock::now();

  delete m_evtSelContext;
  m_evtSelContext = nullptr;

  constexpr double oneOver1024 = 1. / 1024.;
  info() << "---> Loop Finished (skipping 1st evt) - "
         << " WSS " << System::mappedMemory( System::MemoryUnit::kByte ) * oneOver1024 << " total time "
         << std::chrono::duration_cast<std::chrono::milliseconds>( end_time - start_time ).count() << " ms" << endmsg;
  return StatusCode::SUCCESS;
}

void HLTEventLoopMgr::promoteToExecuted ( std::unique_ptr< EventContext >  eventContext ) const

private

Definition at line 536 of file HLTEventLoopMgr.cpp.

                                                                                        {
  // Check if the execution failed
  if ( m_algExecStateSvc->eventStatus( *eventContext ) != EventStatus::Success )
    eventFailed( eventContext.get() ).ignore();
  int si = eventContext->slot();

  // if ( msgLevel( MSG::DEBUG ) )
  //  debug() << "Event " << eventContext->evt() << " executed in slot " << si << "." << endmsg;

  // Schedule the cleanup of the event
  if ( m_algExecStateSvc->eventStatus( *eventContext ) == EventStatus::Success ) {
    if ( msgLevel( MSG::DEBUG ) )
      debug() << "Event " << eventContext->evt() << " finished (slot " << si << ")." << endmsg;
  } else {
    fatal() << "Failed event detected on " << *eventContext << endmsg;
  }

  debug() << "Clearing slot " << si << " (event " << eventContext->evt() << ") of the whiteboard" << endmsg;

  StatusCode sc = m_whiteboard->clearStore( si );
  if ( !sc.isSuccess() ) warning() << "Clear of Event data store failed" << endmsg;
  sc = m_whiteboard->freeStore( si );
  if ( !sc.isSuccess() ) error() << "Whiteboard slot " << eventContext->slot() << " could not be properly cleared";
  ++m_finishedEvt;
  m_createEventCond.notify_all();
}

StatusCode HLTEventLoopMgr::reinitialize ( )

inlineoverride

implementation of IService::reinitialize

Definition at line 30 of file HLTEventLoopMgr.h.

{ return StatusCode::FAILURE; }

StatusCode HLTEventLoopMgr::stopRun ( )

override

implementation of IEventProcessor::stopRun()

Definition at line 420 of file HLTEventLoopMgr.cpp.

                                    {
  // Set the application return code
  auto appmgr = serviceLocator()->as<IProperty>();
  if ( Gaudi::setAppReturnCode( appmgr, Gaudi::ReturnCode::ScheduledStop ).isFailure() ) {
    error() << "Could not set return code of the application (" << Gaudi::ReturnCode::ScheduledStop << ")" << endmsg;
  }
  return StatusCode::SUCCESS;
}

Member Data Documentation

friend HLTEventLoopMgr::HLTExecutionTask

private

Definition at line 49 of file HLTEventLoopMgr.h.

IAlgExecStateSvc* HLTEventLoopMgr::m_algExecStateSvc = nullptr

private

Reference to the AlgExecStateSvc.

Definition at line 73 of file HLTEventLoopMgr.h.

std::vector<Gaudi::Algorithm*> HLTEventLoopMgr::m_algos

private

Vector of algorithms to run for every event.

Definition at line 86 of file HLTEventLoopMgr.h.

std::condition_variable HLTEventLoopMgr::m_createEventCond

mutableprivate

condition variable to wake up main thread when we need to create a new event

Definition at line 78 of file HLTEventLoopMgr.h.

std::mutex HLTEventLoopMgr::m_createEventMutex

private

mutex assoiciated with m_createEventCond condition variable

Definition at line 80 of file HLTEventLoopMgr.h.

Gaudi::Property<std::string> HLTEventLoopMgr::m_dotfile

private

Initial value:

{
      this, "DotFile", {}, "Name of file to dump dependency graph; if empty, do not dump"}

Definition at line 58 of file HLTEventLoopMgr.h.

IDataManagerSvc* HLTEventLoopMgr::m_evtDataMgrSvc = nullptr

private

Reference to the Event Data Service's IDataManagerSvc interface.

Definition at line 63 of file HLTEventLoopMgr.h.

Gaudi::Property<std::string> HLTEventLoopMgr::m_evtsel {this, "EvtSel", "", ""}

private

Definition at line 55 of file HLTEventLoopMgr.h.

IEvtSelector::Context* HLTEventLoopMgr::m_evtSelContext {nullptr}

private

event selector context

Definition at line 83 of file HLTEventLoopMgr.h.

IEvtSelector* HLTEventLoopMgr::m_evtSelector = nullptr

private

Reference to the Event Selector.

Definition at line 65 of file HLTEventLoopMgr.h.

std::atomic<unsigned int> HLTEventLoopMgr::m_finishedEvt {0}

mutableprivate

atomic count of the number of finished events

Definition at line 76 of file HLTEventLoopMgr.h.

IDataManagerSvc* HLTEventLoopMgr::m_histoDataMgrSvc = nullptr

private

Reference to the Histogram Data Service.

Definition at line 67 of file HLTEventLoopMgr.h.

IConversionSvc* HLTEventLoopMgr::m_histoPersSvc = nullptr

private

Reference to the Histogram Persistency Service.

Definition at line 69 of file HLTEventLoopMgr.h.

Gaudi::Property<std::string> HLTEventLoopMgr::m_histPersName {this, "HistogramPersistency", "", ""}

private

Definition at line 54 of file HLTEventLoopMgr.h.

Gaudi::Property<int> HLTEventLoopMgr::m_threadPoolSize {this, "ThreadPoolSize", -1, "Size of the threadpool initialised by TBB"}

private

Definition at line 56 of file HLTEventLoopMgr.h.

Gaudi::Property<std::vector<std::string> > HLTEventLoopMgr::m_topAlgs {this, "TopAlg", {}}

private

Definition at line 60 of file HLTEventLoopMgr.h.

IHiveWhiteBoard* HLTEventLoopMgr::m_whiteboard = nullptr

private

Reference to the Whiteboard.

Definition at line 71 of file HLTEventLoopMgr.h.

Gaudi::Property<std::string> HLTEventLoopMgr::m_whiteboardSvcName {this, "WhiteboardSvc", "EventDataSvc", "The whiteboard name"}

private

Definition at line 57 of file HLTEventLoopMgr.h.

---

The documentation for this class was generated from the following files:

• GaudiHive/src/HLTEventLoopMgr.h
• GaudiHive/src/HLTEventLoopMgr.cpp