The Gaudi Framework  master (ff829712)
Loading...
Searching...
No Matches
concurrency::PrecedenceRulesGraph Class Reference

#include </builds/gaudi/Gaudi/GaudiHive/src/PRGraph/PrecedenceRulesGraph.h>

Inheritance diagram for concurrency::PrecedenceRulesGraph:
Collaboration diagram for concurrency::PrecedenceRulesGraph:

Public Member Functions

 PrecedenceRulesGraph (const std::string &name, SmartIF< ISvcLocator > svc)
 Constructor.
 
StatusCode initialize ()
 Initialize graph.
 
void accept (IGraphVisitor &visitor) const
 An entry point to visit all graph nodes.
 
StatusCode addDataNode (const DataObjID &dataPath)
 Add DataNode that represents DataObject.
 
DataNodegetDataNode (const DataObjID &dataPath) const
 Get DataNode by DataObject path using graph index.
 
void registerIODataObjects (const Gaudi::Algorithm *algo)
 Register algorithm in the Data Dependency index.
 
StatusCode buildDataDependenciesRealm ()
 Build data dependency realm WITH data object nodes participating.
 
void addHeadNode (const std::string &headName, concurrency::Concurrent, concurrency::PromptDecision, concurrency::ModeOr, concurrency::AllPass, concurrency::Inverted)
 Add a node, which has no parents.
 
DecisionNodegetHeadNode () const
 Get head node.
 
StatusCode addAlgorithmNode (Gaudi::Algorithm *daughterAlgo, const std::string &parentName)
 Add algorithm node.
 
AlgorithmNodegetAlgorithmNode (const std::string &algoName) const
 Get the AlgorithmNode from by algorithm name using graph index.
 
StatusCode addDecisionHubNode (Gaudi::Algorithm *daughterAlgo, const std::string &parentName, concurrency::Concurrent, concurrency::PromptDecision, concurrency::ModeOr, concurrency::AllPass, concurrency::Inverted)
 Add a node, which aggregates decisions of direct daughter nodes.
 
unsigned int getControlFlowNodeCounter () const
 Get total number of control flow graph nodes.
 
void rankAlgorithms (IGraphVisitor &ranker) const
 Rank Algorithm nodes by the number of data outputs.
 
const std::string & name () const override
 Retrieve name of the service.
 
SmartIF< ISvcLocator > & serviceLocator () const override
 Retrieve pointer to service locator.
 
void printState (std::stringstream &output, EventSlot &slot, const unsigned int &recursionLevel) const
 Print a string representing the control flow state.
 
void enableAnalysis ()
 BGL-based facilities.
 
PRVertexDesc node (const std::string &) const
 
std::string dumpDataFlow () const
 Print out all data origins and destinations, as reflected in the EF graph.
 
std::string dumpControlFlow () const
 Print out control flow of Algorithms and Sequences.
 
void dumpPrecRules (const boost::filesystem::path &, const EventSlot &slot)
 dump to file the precedence rules
 
void dumpPrecTrace (const boost::filesystem::path &, const EventSlot &slot)
 dump to file the precedence trace
 
void addEdgeToPrecTrace (const AlgorithmNode *u, const AlgorithmNode *v)
 set cause-effect connection between two algorithms in the precedence trace
 
void dumpControlFlow (std::ostringstream &, ControlFlowNode *, const int &) const
 
- Public Member Functions inherited from CommonMessaging< IPrecedenceRulesGraph >
MSG::Level msgLevel () const
 get the cached level (originally extracted from the embedded MsgStream)
 
bool msgLevel (MSG::Level lvl) const
 get the output level from the embedded MsgStream
 
- Public Member Functions inherited from CommonMessagingBase
virtual ~CommonMessagingBase ()=default
 Virtual destructor.
 
const SmartIF< IMessageSvc > & msgSvc () const
 The standard message service.
 
MsgStreammsgStream () const
 Return an uninitialized MsgStream.
 
MsgStreammsgStream (const MSG::Level level) const
 Predefined configurable message stream for the efficient printouts.
 
MsgStreamalways () const
 shortcut for the method msgStream(MSG::ALWAYS)
 
MsgStreamfatal () const
 shortcut for the method msgStream(MSG::FATAL)
 
MsgStreamerr () const
 shortcut for the method msgStream(MSG::ERROR)
 
MsgStreamerror () const
 shortcut for the method msgStream(MSG::ERROR)
 
MsgStreamwarning () const
 shortcut for the method msgStream(MSG::WARNING)
 
MsgStreaminfo () const
 shortcut for the method msgStream(MSG::INFO)
 
MsgStreamdebug () const
 shortcut for the method msgStream(MSG::DEBUG)
 
MsgStreamverbose () const
 shortcut for the method msgStream(MSG::VERBOSE)
 
MsgStreammsg () const
 shortcut for the method msgStream(MSG::INFO)
 

Private Attributes

DecisionNodem_headNode = nullptr
 the head node of the control flow graph
 
std::unordered_map< std::string, std::unique_ptr< AlgorithmNode > > m_algoNameToAlgoNodeMap
 Index: map of algorithm's name to AlgorithmNode.
 
std::unordered_map< std::string, std::unique_ptr< DecisionNode > > m_decisionNameToDecisionHubMap
 Index: map of decision's name to DecisionHub.
 
std::unordered_map< DataObjID, std::unique_ptr< DataNode >, DataObjID_Hasherm_dataPathToDataNodeMap
 Index: map of data path to DataNode.
 
std::unordered_map< std::string, DataObjIDCollm_algoNameToAlgoInputsMap
 Indexes: maps of algorithm's name to algorithm's inputs/outputs.
 
std::unordered_map< std::string, DataObjIDCollm_algoNameToAlgoOutputsMap
 
unsigned int m_nodeCounter = 0
 Total number of nodes in the graph.
 
unsigned int m_algoCounter = 0
 Total number of algorithm nodes in the graph.
 
SmartIF< ISvcLocatorm_svcLocator
 Service locator (needed to access the MessageSvc)
 
const std::string m_name
 
precedence::PrecTrace m_precTrace
 facilities for algorithm precedence tracing
 
std::map< std::string, precedence::AlgoTraceVertexm_prec_trace_map
 
bool m_enableAnalysis { false }
 
precedence::PRGraph m_PRGraph
 BGL-based graph of precedence rules.
 
bool m_conditionsRealmEnabled { false }
 Enable conditions realm of precedence rules.
 

Additional Inherited Members

- Public Types inherited from CommonMessaging< IPrecedenceRulesGraph >
using base_class
 
- Protected Member Functions inherited from CommonMessaging< IPrecedenceRulesGraph >
MSG::Level setUpMessaging () const
 Set up local caches.
 
MSG::Level resetMessaging ()
 Reinitialize internal states.
 
void updateMsgStreamOutputLevel (int level)
 Update the output level of the cached MsgStream.
 

Detailed Description

Definition at line 621 of file PrecedenceRulesGraph.h.

Constructor & Destructor Documentation

◆ PrecedenceRulesGraph()

concurrency::PrecedenceRulesGraph::PrecedenceRulesGraph ( const std::string & name,
SmartIF< ISvcLocator > svc )
inline

Constructor.

Definition at line 624 of file PrecedenceRulesGraph.h.

624 : m_svcLocator( svc ), m_name( name ) {
625 // make sure that CommonMessaging is initialized
627 }
SmartIF< ISvcLocator > m_svcLocator
Service locator (needed to access the MessageSvc)
const std::string & name() const override
Retrieve name of the service.

Member Function Documentation

◆ accept()

void concurrency::PrecedenceRulesGraph::accept ( IGraphVisitor & visitor) const

An entry point to visit all graph nodes.

Definition at line 538 of file PrecedenceRulesGraph.cpp.

538 {
539 // iterate through Algorithm nodes
540 for ( auto& pr : m_algoNameToAlgoNodeMap ) pr.second->accept( visitor );
541
542 // iterate through DecisionHub nodes
543 for ( auto& pr : m_decisionNameToDecisionHubMap ) pr.second->accept( visitor );
544
545 // iterate through Data [and Conditions] nodes
546 for ( auto& pr : m_dataPathToDataNodeMap ) pr.second->accept( visitor );
547 }
std::unordered_map< std::string, std::unique_ptr< DecisionNode > > m_decisionNameToDecisionHubMap
Index: map of decision's name to DecisionHub.
std::unordered_map< DataObjID, std::unique_ptr< DataNode >, DataObjID_Hasher > m_dataPathToDataNodeMap
Index: map of data path to DataNode.
std::unordered_map< std::string, std::unique_ptr< AlgorithmNode > > m_algoNameToAlgoNodeMap
Index: map of algorithm's name to AlgorithmNode.

◆ addAlgorithmNode()

StatusCode concurrency::PrecedenceRulesGraph::addAlgorithmNode ( Gaudi::Algorithm * daughterAlgo,
const std::string & parentName )

Add algorithm node.

Create new, or fetch existent, AlgorithmNode

Attach AlgorithmNode to its parent DecisionNode

Definition at line 372 of file PrecedenceRulesGraph.cpp.

372 {
373
374 StatusCode sc = StatusCode::SUCCESS;
375
377
378 auto& algoName = algo->name();
379
380 concurrency::AlgorithmNode* algoNode;
381
382 auto itA = m_algoNameToAlgoNodeMap.find( algoName );
383 if ( itA != m_algoNameToAlgoNodeMap.end() ) {
384 algoNode = itA->second.get();
385 } else {
386 auto r = m_algoNameToAlgoNodeMap.emplace(
387 algoName, std::make_unique<concurrency::AlgorithmNode>( *this, algo, m_nodeCounter, m_algoCounter ) );
388 algoNode = r.first->second.get();
389
390 // Mirror AlgorithmNode in the BGL-based graph
391 if ( m_enableAnalysis ) { boost::add_vertex( AlgoProps( algo, m_nodeCounter, m_algoCounter ), m_PRGraph ); }
394 ON_VERBOSE verbose() << "AlgorithmNode '" << algoName << "' added @ " << algoNode << endmsg;
395
396 registerIODataObjects( algo );
397 }
398
400 auto itP = m_decisionNameToDecisionHubMap.find( parentName );
401 if ( itP != m_decisionNameToDecisionHubMap.end() ) {
402 auto parentNode = itP->second.get();
403
404 parentNode->addDaughterNode( algoNode );
405 algoNode->addParentNode( parentNode );
406
407 // Mirror algorithm to CF parent relationship in the BGL-based graph
408 if ( m_enableAnalysis ) boost::add_edge( node( algo->name() ), node( parentName ), m_PRGraph );
409
410 ON_VERBOSE verbose() << "Attached AlgorithmNode '" << algo->name() << "' to parent DecisionNode '" << parentName
411 << "'" << endmsg;
412 } else {
414 error() << "Parent DecisionNode '" << parentName << "' was not found" << endmsg;
415 }
416
417 return sc;
418 }
#define ON_VERBOSE
MsgStream & endmsg(MsgStream &s)
MsgStream Modifier: endmsg. Calls the output method of the MsgStream.
Definition MsgStream.h:198
MsgStream & error() const
shortcut for the method msgStream(MSG::ERROR)
MsgStream & verbose() const
shortcut for the method msgStream(MSG::VERBOSE)
constexpr static const auto SUCCESS
Definition StatusCode.h:99
constexpr static const auto FAILURE
Definition StatusCode.h:100
void addParentNode(DecisionNode *node)
Add a parent node.
void registerIODataObjects(const Gaudi::Algorithm *algo)
Register algorithm in the Data Dependency index.
precedence::PRGraph m_PRGraph
BGL-based graph of precedence rules.
PRVertexDesc node(const std::string &) const
unsigned int m_algoCounter
Total number of algorithm nodes in the graph.
unsigned int m_nodeCounter
Total number of nodes in the graph.

◆ addDataNode()

StatusCode concurrency::PrecedenceRulesGraph::addDataNode ( const DataObjID & dataPath)

Add DataNode that represents DataObject.

Definition at line 421 of file PrecedenceRulesGraph.cpp.

421 {
422
423 auto itD = m_dataPathToDataNodeMap.find( dataPath );
424 if ( itD != m_dataPathToDataNodeMap.end() ) return StatusCode::SUCCESS;
425
426 std::unique_ptr<concurrency::DataNode> dataNode;
428 dataNode = std::make_unique<concurrency::DataNode>( *this, dataPath );
429 ON_VERBOSE verbose() << " DataNode " << dataPath << " added @ " << dataNode.get() << endmsg;
430 // Mirror the action above in the BGL-based graph
431 if ( m_enableAnalysis ) boost::add_vertex( DataProps( dataPath ), m_PRGraph );
432 } else {
433 SmartIF<ICondSvc> condSvc{ serviceLocator()->service( "CondSvc", false ) };
434 if ( condSvc->isRegistered( dataPath ) ) {
435 dataNode = std::make_unique<concurrency::ConditionNode>( *this, dataPath, condSvc );
436 ON_VERBOSE verbose() << " ConditionNode " << dataPath << " added @ " << dataNode.get() << endmsg;
437 // Mirror the action above in the BGL-based graph
438 if ( m_enableAnalysis ) boost::add_vertex( CondDataProps( dataPath ), m_PRGraph );
439 } else {
440 dataNode = std::make_unique<concurrency::DataNode>( *this, dataPath );
441 ON_VERBOSE verbose() << " DataNode " << dataPath << " added @ " << dataNode.get() << endmsg;
442 // Mirror the action above in the BGL-based graph
443 if ( m_enableAnalysis ) boost::add_vertex( DataProps( dataPath ), m_PRGraph );
444 }
445 }
446 m_dataPathToDataNodeMap.emplace( dataPath, std::move( dataNode ) );
447 return StatusCode::SUCCESS;
448 }
virtual SmartIF< IService > & service(const Gaudi::Utils::TypeNameString &typeName, const bool createIf=true)=0
Returns a smart pointer to a service.
bool m_conditionsRealmEnabled
Enable conditions realm of precedence rules.
SmartIF< ISvcLocator > & serviceLocator() const override
Retrieve pointer to service locator.

◆ addDecisionHubNode()

StatusCode concurrency::PrecedenceRulesGraph::addDecisionHubNode ( Gaudi::Algorithm * daughterAlgo,
const std::string & parentName,
concurrency::Concurrent modeConcurrent,
concurrency::PromptDecision modePromptDecision,
concurrency::ModeOr modeOR,
concurrency::AllPass allPass,
concurrency::Inverted isInverted )

Add a node, which aggregates decisions of direct daughter nodes.

Create new, or fetch existent, DecisionNode

Attach DecisionNode to its parent DecisionNode

Definition at line 451 of file PrecedenceRulesGraph.cpp.

453 {
454
455 StatusCode sc = StatusCode::SUCCESS;
456
458
459 auto& decisionHubName = decisionHubAlgo->name();
460
461 auto itA = m_decisionNameToDecisionHubMap.find( decisionHubName );
462 concurrency::DecisionNode* decisionHubNode;
463 if ( itA != m_decisionNameToDecisionHubMap.end() ) {
464 decisionHubNode = itA->second.get();
465 } else {
466 auto r = m_decisionNameToDecisionHubMap.emplace(
467 decisionHubName,
468 std::make_unique<concurrency::DecisionNode>( *this, m_nodeCounter, decisionHubName, modeConcurrent,
469 modePromptDecision, modeOR, allPass, isInverted ) );
470 decisionHubNode = r.first->second.get();
471 // Mirror DecisionNode in the BGL-based graph
472 if ( m_enableAnalysis ) {
473 boost::add_vertex( DecisionHubProps( decisionHubName, m_nodeCounter, modeConcurrent, modePromptDecision, modeOR,
474 allPass, isInverted ),
475 m_PRGraph );
476 }
477
479
480 ON_VERBOSE verbose() << "DecisionNode '" << decisionHubName << "' added @ " << decisionHubNode << endmsg;
481 }
482
484 auto itP = m_decisionNameToDecisionHubMap.find( parentName );
485 if ( itP != m_decisionNameToDecisionHubMap.end() ) {
486 auto parentNode = itP->second.get();
487 parentNode->addDaughterNode( decisionHubNode );
488 decisionHubNode->addParentNode( parentNode );
489
490 // Mirror DecisionNode-to-DecisionNode relationship in the BGL-based graph
491 if ( m_enableAnalysis ) boost::add_edge( node( decisionHubName ), node( parentName ), m_PRGraph );
492
493 ON_VERBOSE verbose() << "Attached DecisionNode '" << decisionHubName << "' to parent DecisionNode '" << parentName
494 << "'" << endmsg;
495 } else {
497 error() << "Parent DecisionNode '" << parentName << "' was not found" << endmsg;
498 }
499
500 return sc;
501 }
void addParentNode(DecisionNode *node)
Add a parent node.

◆ addEdgeToPrecTrace()

void concurrency::PrecedenceRulesGraph::addEdgeToPrecTrace ( const AlgorithmNode * u,
const AlgorithmNode * v )

set cause-effect connection between two algorithms in the precedence trace

Definition at line 719 of file PrecedenceRulesGraph.cpp.

719 {
720
721 std::string u_name = u == nullptr ? "ENTRY" : u->name();
722 std::string v_name = v->name();
723
725
726 if ( !u ) {
727 auto itT = m_prec_trace_map.find( "ENTRY" );
728 if ( itT != m_prec_trace_map.end() ) {
729 source = itT->second;
730 } else {
731 source = boost::add_vertex( precedence::AlgoTraceProps( "ENTRY" ), m_precTrace );
732 m_prec_trace_map["ENTRY"] = source;
733 }
734 } else {
735 auto itS = m_prec_trace_map.find( u_name );
736 if ( itS != m_prec_trace_map.end() ) {
737 source = itS->second;
738 } else {
739
740 source =
741 boost::add_vertex( precedence::AlgoTraceProps( u_name, u->getAlgoIndex(), u->getRank() ), m_precTrace );
742 m_prec_trace_map[u_name] = source;
743 }
744 }
745
747
748 auto itP = m_prec_trace_map.find( v_name );
749 if ( itP != m_prec_trace_map.end() ) {
750 target = itP->second;
751 } else {
752
753 target = boost::add_vertex( precedence::AlgoTraceProps( v_name, v->getAlgoIndex(), v->getRank() ), m_precTrace );
754 m_prec_trace_map[v_name] = target;
755 }
756
757 boost::add_edge( source, target, m_precTrace );
758
759 ON_DEBUG debug() << u_name << "-->" << v_name << " precedence trait added" << endmsg;
760 }
#define ON_DEBUG
MsgStream & debug() const
shortcut for the method msgStream(MSG::DEBUG)
std::map< std::string, precedence::AlgoTraceVertex > m_prec_trace_map
precedence::PrecTrace m_precTrace
facilities for algorithm precedence tracing
boost::graph_traits< PrecTrace >::vertex_descriptor AlgoTraceVertex

◆ addHeadNode()

void concurrency::PrecedenceRulesGraph::addHeadNode ( const std::string & headName,
concurrency::Concurrent modeConcurrent,
concurrency::PromptDecision modePromptDecision,
concurrency::ModeOr modeOR,
concurrency::AllPass allPass,
concurrency::Inverted isInverted )

Add a node, which has no parents.

Definition at line 504 of file PrecedenceRulesGraph.cpp.

506 {
507
508 auto itH = m_decisionNameToDecisionHubMap.find( headName );
509 if ( itH != m_decisionNameToDecisionHubMap.end() ) {
510 m_headNode = itH->second.get();
511 } else {
512 auto r = m_decisionNameToDecisionHubMap.emplace(
513 headName, std::make_unique<concurrency::DecisionNode>( *this, m_nodeCounter, headName, modeConcurrent,
514 modePromptDecision, modeOR, allPass, isInverted ) );
515 m_headNode = r.first->second.get();
516
517 // Mirror the action above in the BGL-based graph
518 if ( m_enableAnalysis ) {
519 boost::add_vertex( DecisionHubProps( headName, m_nodeCounter, modeConcurrent, modePromptDecision, modeOR,
520 allPass, isInverted ),
521 m_PRGraph );
522 }
523
525 }
526 }
DecisionNode * m_headNode
the head node of the control flow graph

◆ buildDataDependenciesRealm()

StatusCode concurrency::PrecedenceRulesGraph::buildDataDependenciesRealm ( )

Build data dependency realm WITH data object nodes participating.

Definition at line 318 of file PrecedenceRulesGraph.cpp.

318 {
319
320 StatusCode global_sc = StatusCode::SUCCESS;
321
322 // Production of DataNodes by AlgorithmNodes (DataNodes are created here)
323 std::vector<decltype( m_algoNameToAlgoNodeMap )::value_type*> sortedAlgs;
324 for ( auto& algo : m_algoNameToAlgoNodeMap ) { sortedAlgs.push_back( &algo ); }
325 std::sort( sortedAlgs.begin(), sortedAlgs.end(),
326 []( const auto* a, const auto* b ) { return a->first < b->first; } );
327 for ( auto* algo : sortedAlgs ) {
328
329 auto& outputs = m_algoNameToAlgoOutputsMap[algo->first];
330 for ( auto output : outputs ) {
331 const auto sc = addDataNode( output );
332 if ( !sc.isSuccess() ) {
333 error() << "Extra producer (" << algo->first << ") for DataObject @ " << output
334 << " has been detected: this is not allowed." << endmsg;
335 global_sc = sc;
336 }
337 auto dataNode = getDataNode( output );
338 dataNode->addProducerNode( algo->second.get() );
339 algo->second->addOutputDataNode( dataNode );
340
341 // Mirror the action above in the BGL-based graph
342 if ( m_enableAnalysis ) boost::add_edge( node( algo->second->name() ), node( output.fullKey() ), m_PRGraph );
343 }
344 }
345
346 // Consumption of DataNodes by AlgorithmNodes
347 sortedAlgs.clear();
348 for ( auto& algo : m_algoNameToAlgoNodeMap ) { sortedAlgs.push_back( &algo ); }
349 std::sort( sortedAlgs.begin(), sortedAlgs.end(),
350 []( const auto* a, const auto* b ) { return a->first < b->first; } );
351 for ( auto* algo : sortedAlgs ) {
352
353 for ( auto input : m_algoNameToAlgoInputsMap[algo->first] ) {
354
355 auto itP = m_dataPathToDataNodeMap.find( input );
356
357 DataNode* dataNode = ( itP != m_dataPathToDataNodeMap.end() ? getDataNode( input ) : nullptr );
358 if ( dataNode ) {
359 dataNode->addConsumerNode( algo->second.get() );
360 algo->second->addInputDataNode( dataNode );
361
362 // Mirror the action above in the BGL-based graph
363 if ( m_enableAnalysis ) boost::add_edge( node( input.fullKey() ), node( algo->second->name() ), m_PRGraph );
364 }
365 }
366 }
367
368 return global_sc;
369 }
StatusCode addDataNode(const DataObjID &dataPath)
Add DataNode that represents DataObject.
DataNode * getDataNode(const DataObjID &dataPath) const
Get DataNode by DataObject path using graph index.
std::unordered_map< std::string, DataObjIDColl > m_algoNameToAlgoInputsMap
Indexes: maps of algorithm's name to algorithm's inputs/outputs.
std::unordered_map< std::string, DataObjIDColl > m_algoNameToAlgoOutputsMap

◆ dumpControlFlow() [1/2]

std::string concurrency::PrecedenceRulesGraph::dumpControlFlow ( ) const

Print out control flow of Algorithms and Sequences.

Definition at line 560 of file PrecedenceRulesGraph.cpp.

560 {
561 std::ostringstream ost;
562 dumpControlFlow( ost, m_headNode, 0 );
563 return ost.str();
564 }
std::string dumpControlFlow() const
Print out control flow of Algorithms and Sequences.

◆ dumpControlFlow() [2/2]

void concurrency::PrecedenceRulesGraph::dumpControlFlow ( std::ostringstream & ost,
ControlFlowNode * node,
const int & indent ) const

Definition at line 566 of file PrecedenceRulesGraph.cpp.

567 {
568 ost << std::string( indent * 2, ' ' );
569 DecisionNode* dn = dynamic_cast<DecisionNode*>( node );
570 AlgorithmNode* an = dynamic_cast<AlgorithmNode*>( node );
571 if ( dn != 0 ) {
572 if ( node != m_headNode ) {
573 ost << node->name() << " [Seq] ";
574 ost << ( ( dn->m_modeConcurrent ) ? " [Concurrent] " : " [Sequential] " );
575 ost << ( ( dn->m_modePromptDecision ) ? " [Prompt] " : "" );
576 ost << ( ( dn->m_modeOR ) ? " [OR] " : "" );
577 ost << ( ( dn->m_allPass ) ? " [PASS] " : "" );
578 ost << "\n";
579 }
580 for ( const auto& i : dn->getDaughters() ) dumpControlFlow( ost, i, indent + 1 );
581 } else if ( an != 0 ) {
582 ost << node->name() << " [Alg] ";
583 auto ar = an->getAlgorithm();
584 ost << " [n= " << ar->cardinality() << "]";
585 ost << ( ( !ar->isClonable() ) ? " [unclonable] " : "" );
586 ost << "\n";
587 }
588 }

◆ dumpDataFlow()

std::string concurrency::PrecedenceRulesGraph::dumpDataFlow ( ) const

Print out all data origins and destinations, as reflected in the EF graph.

Definition at line 591 of file PrecedenceRulesGraph.cpp.

591 {
592
593 const char idt[] = " ";
594 std::ostringstream ost;
595
596 ost << "\n" << idt << "====================================\n";
597 ost << idt << "Data origins and destinations:\n";
598 ost << idt << "====================================\n";
599
600 std::vector<const DataObjID*> vec;
601 vec.reserve( m_dataPathToDataNodeMap.size() );
602 for ( auto& pair : m_dataPathToDataNodeMap ) { vec.push_back( &pair.first ); }
603 std::sort( vec.begin(), vec.end(),
604 []( const DataObjID* a, const DataObjID* b ) { return a->fullKey() < b->fullKey(); } );
605
606 for ( const DataObjID* id : vec ) {
607 const DataNode& node = *m_dataPathToDataNodeMap.find( *id )->second;
608
609 for ( auto algoNode : node.getProducers() ) ost << idt << " " << algoNode->name() << "\n";
610
611 ost << idt << " V\n";
612 ost << idt << " o " << id << "\n";
613 ost << idt << " V\n";
614
615 for ( auto algoNode : node.getConsumers() ) ost << idt << " " << algoNode->name() << "\n";
616
617 ost << idt << "====================================\n";
618 }
619
620 return ost.str();
621 }

◆ dumpPrecRules()

void concurrency::PrecedenceRulesGraph::dumpPrecRules ( const boost::filesystem::path & fileName,
const EventSlot & slot )

dump to file the precedence rules

Definition at line 625 of file PrecedenceRulesGraph.cpp.

625 {
626 std::ofstream myfile;
627 myfile.open( fileName.c_str(), std::ios::app );
628
629 // Declare properties to dump
630 boost::dynamic_properties dp;
631
632 dp.property( "Entity",
633 boost::make_transform_value_property_map(
634 []( const VariantVertexProps& v ) {
635 return std::visit( []( const auto& w ) { return boost::lexical_cast<std::string>( w ); }, v );
636 },
637 boost::get( boost::vertex_bundle, m_PRGraph ) ) );
638
639 auto add_prop = [&]( auto name, auto&& vis ) {
640 dp.property( name, boost::make_transform_value_property_map(
641 [vis = std::forward<decltype( vis )>( vis )]( const VariantVertexProps& v ) {
642 return std::visit( vis, v );
643 },
644 boost::get( boost::vertex_bundle, m_PRGraph ) ) );
645 };
646
647 add_prop( "Name", precedence::VertexName() );
648 add_prop( "Mode", precedence::GroupMode() );
649 add_prop( "Logic", precedence::GroupLogic() );
650 add_prop( "Decision Negation", precedence::DecisionNegation() );
651 add_prop( "Negative Decision Inversion", precedence::AllPass() );
652 add_prop( "Exit Policy", precedence::GroupExit() );
653 add_prop( "Operations", precedence::Operations() );
654 add_prop( "CF Decision", precedence::CFDecision( slot ) );
655 add_prop( "State", precedence::EntityState( slot, serviceLocator(), m_conditionsRealmEnabled ) );
656 add_prop( "Start Time (Epoch ns)", precedence::StartTime( slot, serviceLocator() ) );
657 add_prop( "End Time (Epoch ns)", precedence::EndTime( slot, serviceLocator() ) );
658 add_prop( "Runtime (ns)", precedence::Duration( slot, serviceLocator() ) );
659
660 boost::write_graphml( myfile, m_PRGraph, dp );
661
662 myfile.close();
663 }
std::variant< AlgoProps, DecisionHubProps, DataProps, CondDataProps > VariantVertexProps

◆ dumpPrecTrace()

void concurrency::PrecedenceRulesGraph::dumpPrecTrace ( const boost::filesystem::path & fileName,
const EventSlot & slot )

dump to file the precedence trace

Definition at line 666 of file PrecedenceRulesGraph.cpp.

666 {
667 std::ofstream myfile;
668 myfile.open( fileName.c_str(), std::ios::app );
669
670 // Fill runtimes (as this could not be done on the fly during trace assembling)
671 SmartIF<ITimelineSvc> timelineSvc = m_svcLocator->service<ITimelineSvc>( "TimelineSvc", false );
672 if ( !timelineSvc.isValid() ) {
673 warning() << "Failed to get the TimelineSvc, timing will not be added to "
674 << "the task precedence trace dump" << endmsg;
675 } else {
676
677 std::vector<long long int> start_times;
678
679 for ( auto vp = vertices( m_precTrace ); vp.first != vp.second; ++vp.first ) {
680 TimelineEvent te{};
681 te.algorithm = m_precTrace[*vp.first].m_name;
682 te.slot = slot.eventContext->slot();
683 te.event = slot.eventContext->evt();
684 timelineSvc->getTimelineEvent( te );
685
686 long int runtime{ std::chrono::duration_cast<std::chrono::microseconds>( te.end - te.start ).count() };
687 m_precTrace[*vp.first].m_runtime = runtime;
688
689 long long int start{
690 std::chrono::duration_cast<std::chrono::nanoseconds>( te.start.time_since_epoch() ).count() };
691 m_precTrace[*vp.first].m_start = start;
692 if ( start != 0 ) start_times.push_back( start );
693 }
694
695 auto min = std::min_element( start_times.begin(), start_times.end() );
696
697 for ( auto vp = vertices( m_precTrace ); vp.first != vp.second; ++vp.first ) {
698
699 auto& oldValue = m_precTrace[*vp.first].m_start;
700
701 if ( oldValue != 0 ) oldValue = oldValue - *min;
702 }
703 }
704
705 // Declare properties to dump
706 boost::dynamic_properties dp;
707 using boost::get;
708 using precedence::AlgoTraceProps;
709 dp.property( "Name", get( &AlgoTraceProps::m_name, m_precTrace ) );
710 dp.property( "Rank", get( &AlgoTraceProps::m_rank, m_precTrace ) );
711 dp.property( "Run Time (us)", get( &AlgoTraceProps::m_runtime, m_precTrace ) );
712 dp.property( "Start Time (ns)", get( &AlgoTraceProps::m_start, m_precTrace ) );
713
714 boost::write_graphml( myfile, m_precTrace, dp );
715
716 myfile.close();
717 }
MsgStream & warning() const
shortcut for the method msgStream(MSG::WARNING)
ContextEvt_t evt() const
ContextID_t slot() const
bool isValid() const
Allow for check if smart pointer is valid.
Definition SmartIF.h:69
get
decorate the vector of properties
Definition decorators.py:94
std::unique_ptr< EventContext > eventContext
Cache for the eventContext.
Definition EventSlot.h:82

◆ enableAnalysis()

void concurrency::PrecedenceRulesGraph::enableAnalysis ( )
inline

BGL-based facilities.

Definition at line 674 of file PrecedenceRulesGraph.h.

674{ m_enableAnalysis = true; }

◆ getAlgorithmNode()

AlgorithmNode * concurrency::PrecedenceRulesGraph::getAlgorithmNode ( const std::string & algoName) const
inline

Get the AlgorithmNode from by algorithm name using graph index.

Definition at line 652 of file PrecedenceRulesGraph.h.

652 {
653 return m_algoNameToAlgoNodeMap.at( algoName ).get();
654 }

◆ getControlFlowNodeCounter()

unsigned int concurrency::PrecedenceRulesGraph::getControlFlowNodeCounter ( ) const
inline

Get total number of control flow graph nodes.

Definition at line 660 of file PrecedenceRulesGraph.h.

660{ return m_nodeCounter; }

◆ getDataNode()

DataNode * concurrency::PrecedenceRulesGraph::getDataNode ( const DataObjID & dataPath) const
inline

Get DataNode by DataObject path using graph index.

Definition at line 638 of file PrecedenceRulesGraph.h.

638{ return m_dataPathToDataNodeMap.at( dataPath ).get(); }

◆ getHeadNode()

DecisionNode * concurrency::PrecedenceRulesGraph::getHeadNode ( ) const
inline

Get head node.

Definition at line 648 of file PrecedenceRulesGraph.h.

648{ return m_headNode; }

◆ initialize()

StatusCode concurrency::PrecedenceRulesGraph::initialize ( )

Initialize graph.

Definition at line 220 of file PrecedenceRulesGraph.cpp.

220 {
221 if ( serviceLocator()->existsService( "CondSvc" ) ) {
222 SmartIF<ICondSvc> condSvc{ serviceLocator()->service( "CondSvc" ) };
223 if ( condSvc.isValid() ) {
224 info() << "CondSvc found. DF precedence rules will be augmented with 'Conditions'" << endmsg;
226 }
227 }
228
229 // Detach condition algorithms from the CF realm
231 SmartIF<ICondSvc> condSvc{ serviceLocator()->service( "CondSvc", false ) };
232 auto& condAlgs = condSvc->condAlgs();
233 for ( const auto algo : condAlgs ) {
234 auto itA = m_algoNameToAlgoNodeMap.find( algo->name() );
235 if ( itA != m_algoNameToAlgoNodeMap.end() ) {
236 concurrency::AlgorithmNode* algoNode = itA->second.get();
237 debug() << "Detaching condition algorithm '" << algo->name() << "' from the CF realm.." << endmsg;
238 for ( auto parent : algoNode->getParentDecisionHubs() ) {
239 parent->m_children.erase( std::remove( parent->m_children.begin(), parent->m_children.end(), algoNode ),
240 parent->m_children.end() );
241 // clean up also auxiliary BGL-based graph of precedence rules
242 if ( m_enableAnalysis ) boost::remove_edge( node( algoNode->name() ), node( parent->name() ), m_PRGraph );
243 }
244 algoNode->m_parents.clear();
245
246 } else {
247 warning() << "Algorithm '" << algo->name() << "' is not registered in the graph" << endmsg;
248 }
249 }
250 }
251
252 StatusCode sc = buildDataDependenciesRealm();
253
254 if ( !sc.isSuccess() ) error() << "Could not build the data dependency realm." << endmsg;
255
256 return sc;
257 }
MsgStream & info() const
shortcut for the method msgStream(MSG::INFO)
bool isSuccess() const
Definition StatusCode.h:314
std::vector< DecisionNode * > m_parents
Control flow parents of an AlgorithmNode (DecisionNodes)
const std::vector< DecisionNode * > & getParentDecisionHubs() const
Get all parent decision hubs.
const std::string & name() const
Get node name.
StatusCode buildDataDependenciesRealm()
Build data dependency realm WITH data object nodes participating.

◆ name()

const std::string & concurrency::PrecedenceRulesGraph::name ( ) const
inlineoverride

Retrieve name of the service.

Definition at line 666 of file PrecedenceRulesGraph.h.

666{ return m_name; }

◆ node()

PRVertexDesc concurrency::PrecedenceRulesGraph::node ( const std::string & name) const

Definition at line 529 of file PrecedenceRulesGraph.cpp.

529 {
530 auto vp = vertices( m_PRGraph );
531 auto i = std::find_if( vp.first, vp.second, [&]( const PRVertexDesc& v ) {
532 return std::visit( precedence::VertexName(), m_PRGraph[v] ) == name;
533 } );
534 return i != vp.second ? *i : PRVertexDesc{};
535 }
boost::graph_traits< PRGraph >::vertex_descriptor PRVertexDesc

◆ printState()

void concurrency::PrecedenceRulesGraph::printState ( std::stringstream & output,
EventSlot & slot,
const unsigned int & recursionLevel ) const

Print a string representing the control flow state.

Definition at line 260 of file PrecedenceRulesGraph.cpp.

261 {
262 if ( slot.parentSlot ) {
263 // Start at sub-slot entry point
264 m_decisionNameToDecisionHubMap.at( slot.entryPoint )->printState( output, slot, recursionLevel );
265 } else {
266 // Start at the head node for whole-event slots
267 m_headNode->printState( output, slot, recursionLevel );
268 }
269
270 // Find detached conditions algs in interesting states
272 bool firstPrint = true;
273 SmartIF<ICondSvc> condSvc{ serviceLocator()->service( "CondSvc", false ) };
274 auto& condAlgs = condSvc->condAlgs();
275 for ( const auto algo : condAlgs ) {
276 auto itA = m_algoNameToAlgoNodeMap.find( algo->name() );
277 if ( itA != m_algoNameToAlgoNodeMap.end() ) {
278
279 concurrency::AlgorithmNode* algoNode = itA->second.get();
280
281 // Ignore boring states (reduces verbosity)
282 auto& thisState = slot.algsStates[algoNode->getAlgoIndex()];
283 if ( thisState == AlgsExecutionStates::State::INITIAL ||
285 continue;
286
287 // Make output
288 if ( firstPrint ) {
289 firstPrint = false;
290 output << std::endl << "Detached algorithms:" << std::endl;
291 }
292 algoNode->printState( output, slot, recursionLevel );
293 }
294 }
295 }
296 }
unsigned int getAlgoIndex() const
Get algorithm index.
void printState(std::stringstream &output, EventSlot &slot, const unsigned int &recursionLevel) const override
Print a string representing the control flow state.
EventSlot * parentSlot
Pointer to parent slot (null for top level)
Definition EventSlot.h:95
std::string entryPoint
Event Views bookkeeping (TODO: optimize view bookkeeping)
Definition EventSlot.h:93
AlgsExecutionStates algsStates
Vector of algorithms states.
Definition EventSlot.h:84

◆ rankAlgorithms()

void concurrency::PrecedenceRulesGraph::rankAlgorithms ( IGraphVisitor & ranker) const

Rank Algorithm nodes by the number of data outputs.

Definition at line 550 of file PrecedenceRulesGraph.cpp.

550 {
551
552 info() << "Starting ranking by data outputs .. " << endmsg;
553 for ( auto& pair : m_algoNameToAlgoNodeMap ) {
554 ON_DEBUG debug() << " Ranking " << pair.first << "... " << endmsg;
555 pair.second->accept( ranker );
556 ON_DEBUG debug() << " ... rank of " << pair.first << ": " << pair.second->getRank() << endmsg;
557 }
558 }

◆ registerIODataObjects()

void concurrency::PrecedenceRulesGraph::registerIODataObjects ( const Gaudi::Algorithm * algo)

Register algorithm in the Data Dependency index.

Definition at line 299 of file PrecedenceRulesGraph.cpp.

299 {
300
301 const std::string& algoName = algo->name();
302
303 m_algoNameToAlgoInputsMap[algoName] = algo->inputDataObjs();
304 m_algoNameToAlgoOutputsMap[algoName] = algo->outputDataObjs();
305
306 ON_VERBOSE {
307 verbose() << " Inputs of " << algoName << ": ";
308 for ( auto tag : algo->inputDataObjs() ) verbose() << tag << " | ";
309 verbose() << endmsg;
310
311 verbose() << " Outputs of " << algoName << ": ";
312 for ( auto tag : algo->outputDataObjs() ) verbose() << tag << " | ";
313 verbose() << endmsg;
314 }
315 }
const DataObjIDColl & outputDataObjs() const override
const DataObjIDColl & inputDataObjs() const override
const std::string & name() const override
The identifying name of the algorithm object.

◆ serviceLocator()

SmartIF< ISvcLocator > & concurrency::PrecedenceRulesGraph::serviceLocator ( ) const
inlineoverride

Retrieve pointer to service locator.

Definition at line 668 of file PrecedenceRulesGraph.h.

668{ return m_svcLocator; }

Member Data Documentation

◆ m_algoCounter

unsigned int concurrency::PrecedenceRulesGraph::m_algoCounter = 0
private

Total number of algorithm nodes in the graph.

Definition at line 706 of file PrecedenceRulesGraph.h.

◆ m_algoNameToAlgoInputsMap

std::unordered_map<std::string, DataObjIDColl> concurrency::PrecedenceRulesGraph::m_algoNameToAlgoInputsMap
private

Indexes: maps of algorithm's name to algorithm's inputs/outputs.

Definition at line 700 of file PrecedenceRulesGraph.h.

◆ m_algoNameToAlgoNodeMap

std::unordered_map<std::string, std::unique_ptr<AlgorithmNode> > concurrency::PrecedenceRulesGraph::m_algoNameToAlgoNodeMap
private

Index: map of algorithm's name to AlgorithmNode.

Definition at line 694 of file PrecedenceRulesGraph.h.

◆ m_algoNameToAlgoOutputsMap

std::unordered_map<std::string, DataObjIDColl> concurrency::PrecedenceRulesGraph::m_algoNameToAlgoOutputsMap
private

Definition at line 701 of file PrecedenceRulesGraph.h.

◆ m_conditionsRealmEnabled

bool concurrency::PrecedenceRulesGraph::m_conditionsRealmEnabled { false }
private

Enable conditions realm of precedence rules.

Definition at line 720 of file PrecedenceRulesGraph.h.

720{ false };

◆ m_dataPathToDataNodeMap

std::unordered_map<DataObjID, std::unique_ptr<DataNode>, DataObjID_Hasher> concurrency::PrecedenceRulesGraph::m_dataPathToDataNodeMap
private

Index: map of data path to DataNode.

Definition at line 698 of file PrecedenceRulesGraph.h.

◆ m_decisionNameToDecisionHubMap

std::unordered_map<std::string, std::unique_ptr<DecisionNode> > concurrency::PrecedenceRulesGraph::m_decisionNameToDecisionHubMap
private

Index: map of decision's name to DecisionHub.

Definition at line 696 of file PrecedenceRulesGraph.h.

◆ m_enableAnalysis

bool concurrency::PrecedenceRulesGraph::m_enableAnalysis { false }
private

Definition at line 715 of file PrecedenceRulesGraph.h.

715{ false };

◆ m_headNode

DecisionNode* concurrency::PrecedenceRulesGraph::m_headNode = nullptr
private

the head node of the control flow graph

Definition at line 692 of file PrecedenceRulesGraph.h.

◆ m_name

const std::string concurrency::PrecedenceRulesGraph::m_name
private

Definition at line 710 of file PrecedenceRulesGraph.h.

◆ m_nodeCounter

unsigned int concurrency::PrecedenceRulesGraph::m_nodeCounter = 0
private

Total number of nodes in the graph.

Definition at line 704 of file PrecedenceRulesGraph.h.

◆ m_prec_trace_map

std::map<std::string, precedence::AlgoTraceVertex> concurrency::PrecedenceRulesGraph::m_prec_trace_map
private

Definition at line 714 of file PrecedenceRulesGraph.h.

◆ m_precTrace

precedence::PrecTrace concurrency::PrecedenceRulesGraph::m_precTrace
private

facilities for algorithm precedence tracing

Definition at line 713 of file PrecedenceRulesGraph.h.

◆ m_PRGraph

precedence::PRGraph concurrency::PrecedenceRulesGraph::m_PRGraph
private

BGL-based graph of precedence rules.

Definition at line 717 of file PrecedenceRulesGraph.h.

◆ m_svcLocator

SmartIF<ISvcLocator> concurrency::PrecedenceRulesGraph::m_svcLocator
mutableprivate

Service locator (needed to access the MessageSvc)

Definition at line 709 of file PrecedenceRulesGraph.h.


The documentation for this class was generated from the following files: