tf.contrib.cluster_resolver.GceClusterResolver

Class GceClusterResolver

Inherits From: ClusterResolver

Aliases:

  • Class tf.contrib.cluster_resolver.GceClusterResolver
  • Class tf.contrib.cluster_resolver.python.training.GceClusterResolver

Defined in tensorflow/python/distribute/cluster_resolver/gce_cluster_resolver.py.

Cluster Resolver for Google Compute Engine.

This is an implementation of cluster resolvers for the Google Compute Engine instance group platform. By specifying a project, zone, and instance group, this will retrieve the IP address of all the instances within the instance group and return a Cluster Resolver object suitable for use for distributed TensorFlow.

__init__

__init__(
    project,
    zone,
    instance_group,
    port,
    task_type='worker',
    task_index=0,
    rpc_layer='grpc',
    credentials='default',
    service=None
)

Creates a new GceClusterResolver object.

This takes in a few parameters and creates a GceClusterResolver project. It will then use these parameters to query the GCE API for the IP addresses of each instance in the instance group.

Args:

  • project: Name of the GCE project.
  • zone: Zone of the GCE instance group.
  • instance_group: Name of the GCE instance group.
  • port: Port of the listening TensorFlow server (default: 8470)
  • task_type: Name of the TensorFlow job this GCE instance group of VM instances belong to.
  • task_index: The task index for this particular VM, within the GCE instance group. In particular, every single instance should be assigned a unique ordinal index within an instance group manually so that they can be distinguished from each other.
  • rpc_layer: The RPC layer TensorFlow should use to communicate across instances.
  • credentials: GCE Credentials. If nothing is specified, this defaults to GoogleCredentials.get_application_default().
  • service: The GCE API object returned by the googleapiclient.discovery function. (Default: discovery.build('compute', 'v1')). If you specify a custom service object, then the credentials parameter will be ignored.

Raises:

  • ImportError: If the googleapiclient is not installed.

Properties

environment

Returns the current environment which TensorFlow is running in.

For users in the GCE environment, the environment property is always an empty string, and Google users will not use this ClusterResolver for running on internal systems.

rpc_layer

task_index

task_type

Methods

tf.contrib.cluster_resolver.GceClusterResolver.cluster_spec

cluster_spec()

Returns a ClusterSpec object based on the latest instance group info.

This returns a ClusterSpec object for use based on information from the specified instance group. We will retrieve the information from the GCE APIs every time this method is called.

Returns:

A ClusterSpec containing host information retrieved from GCE.

tf.contrib.cluster_resolver.GceClusterResolver.master

master(
    task_type=None,
    task_index=None,
    rpc_layer=None
)

Retrieves the name or URL of the session master.

Args:

  • task_type: (Optional) The type of the TensorFlow task of the master.
  • task_index: (Optional) The index of the TensorFlow task of the master.
  • rpc_layer: (Optional) The RPC protocol for the given cluster.

Returns:

The name or URL of the session master.

Implementors of this function must take care in ensuring that the master returned is up-to-date at the time to calling this function. This usually means retrieving the master every time this function is invoked.

tf.contrib.cluster_resolver.GceClusterResolver.num_accelerators

num_accelerators(
    task_type=None,
    task_index=None,
    accelerator_type='GPU',
    config_proto=None
)

Returns the number of accelerator cores per worker.

This returns the number of accelerator cores (such as GPUs and TPUs) available per worker. If workers only has CPU cores available, then this should return 0. This method will query the master for this information if it is not otherwise known.

Optionally, we allow callers to specify the task_type, task_index, and rpc_layer, if they want to target a specific TensorFlow process to query the number of accelerators. This is to support heterogenous environments, where the number of accelerators cores per host is different.

Args:

  • task_type: (Optional) The type of the TensorFlow task of the machine we want to query.
  • task_index: (Optional) The index of the TensorFlow task of the machine we want to query.
  • accelerator_type: (Optional) The type of accelerator we are trying to query (defaults to 'GPU').
  • config_proto: (Optional) Configuration for starting a new session to query how many accelerator cores it has.