pyrosetta.distributed.cluster.utilities.SchedulerManager Class Reference

Inheritance diagram for pyrosetta.distributed.cluster.utilities.SchedulerManager:

Public Attributes
	scheduler

Private Member Functions
Union[Dict[int, ClientType], NoReturn]	_setup_clients_dict (self)
ClusterType	_get_cluster (self)
Tuple[ Dict[int, ClientType], Optional[ClusterType], Optional[AdaptiveType],]	_setup_clients_cluster_adaptive (self)
None	_maybe_adapt (self, Optional[AdaptiveType] adaptive)
None	_maybe_teardown (self, Dict[int, ClientType] clients, Optional[ClusterType] cluster)

Member Function Documentation

_get_cluster()

ClusterType pyrosetta.distributed.cluster.utilities.SchedulerManager._get_cluster (   self )

private

Given user input arguments, return the requested cluster instance.

References pyrosetta.distributed.cluster.core.PyRosettaCluster.dashboard_address, pyrosetta.distributed.cluster.core.PyRosettaCluster.max_workers, pyrosetta.distributed.cluster.core.PyRosettaCluster.scheduler, pyrosetta.distributed.cluster.utilities.SchedulerManager.scheduler, and pyrosetta.distributed.cluster.core.PyRosettaCluster.scratch_dir.

Referenced by pyrosetta.distributed.cluster.utilities.SchedulerManager._setup_clients_cluster_adaptive().

_maybe_adapt()

None pyrosetta.distributed.cluster.utilities.SchedulerManager._maybe_adapt (   self, Optional[AdaptiveType]  adaptive  )

private

Adjust max_workers.

References pyrosetta.distributed.cluster.core.PyRosettaCluster.adapt_threshold, pyrosetta.distributed.cluster.core.PyRosettaCluster.clients_dict, pyrosetta.distributed.cluster.core.PyRosettaCluster.max_workers, pyrosetta.distributed.cluster.core.PyRosettaCluster.scheduler, pyrosetta.distributed.cluster.utilities.SchedulerManager.scheduler, and pyrosetta.distributed.cluster.core.PyRosettaCluster.tasks_size.

Referenced by pyrosetta.distributed.cluster.core.PyRosettaCluster._run().

_maybe_teardown()

None pyrosetta.distributed.cluster.utilities.SchedulerManager._maybe_teardown (   self, Dict[int, ClientType]  clients, Optional[ClusterType]  cluster  )

private

Teardown client and cluster.

References pyrosetta.distributed.cluster.core.PyRosettaCluster.clients_dict.

Referenced by pyrosetta.distributed.cluster.core.PyRosettaCluster._run().

_setup_clients_cluster_adaptive()

Tuple[ Dict[int, ClientType], Optional[ClusterType], Optional[AdaptiveType], ] pyrosetta.distributed.cluster.utilities.SchedulerManager._setup_clients_cluster_adaptive (   self )

private

Given user input arguments, return the requested client, cluster,
and adaptive instance.

References pyrosetta.distributed.cluster.utilities.SchedulerManager._get_cluster(), pyrosetta.distributed.cluster.core.PyRosettaCluster.clients_dict, pyrosetta.distributed.cluster.core.PyRosettaCluster.max_workers, pyrosetta.distributed.cluster.core.PyRosettaCluster.min_workers, pyrosetta.distributed.cluster.core.PyRosettaCluster.scheduler, and pyrosetta.distributed.cluster.utilities.SchedulerManager.scheduler.

Referenced by pyrosetta.distributed.cluster.core.PyRosettaCluster._run().

_setup_clients_dict()

Union[Dict[int, ClientType], NoReturn] pyrosetta.distributed.cluster.utilities.SchedulerManager._setup_clients_dict (   self )

private

References all, pyrosetta.distributed.cluster.core.PyRosettaCluster.client, pyrosetta.tests.distributed.test_dask.TestDaskDistribution.client, pyrosetta.distributed.cluster.core.PyRosettaCluster.clients, pyrosetta.tests.distributed.cluster.test_smoke.TestBase.clients, ui::network::B.clients, and basic::options::OptionKeys::stepwise.enumerate.

Member Data Documentation

scheduler

pyrosetta.distributed.cluster.utilities.SchedulerManager.scheduler

Referenced by pyrosetta.distributed.cluster.utilities.SchedulerManager._get_cluster(), pyrosetta.distributed.cluster.utilities.SchedulerManager._maybe_adapt(), and pyrosetta.distributed.cluster.utilities.SchedulerManager._setup_clients_cluster_adaptive().

---

The documentation for this class was generated from the following file:

• src/python/PyRosetta/src/pyrosetta/distributed/cluster/utilities.py