tensorflow::serving::Manager

This is an abstract class.

#include <manager.h>

Manager is responsible for loading, unloading, lookup and lifetime management of all Servable objects via their Loaders.

Summary

Inheritance

Direct Known Subclasses:tensorflow::serving::AspiredVersionsManager, tensorflow::serving::BasicManager, tensorflow::serving::CachingManager, tensorflow::serving::ServerCore

Constructors and Destructors
~Manager()

Public functions
GetAvailableServableHandles() const
std::map< ServableId, ServableHandle< T > >
Returns a map of all the currently available servables of a particular type T.
GetServableHandle(const ServableRequest & request, ServableHandle< T > *const handle)
Status
Returns a ServableHandle given a ServableRequest.
ListAvailableServableIds() const =0
virtual std::vector< ServableId >
Gets a list of all available servable ids, i.e.

Public functions

GetAvailableServableHandles

std::map< ServableId, ServableHandle< T > > GetAvailableServableHandles() const

Returns a map of all the currently available servables of a particular type T.

The map is from the servable's id to its corresponding handle.

IMPORTANT: The caller should not hold onto the handles for a long time, because holding them will delay servable loading and unloading.

GetServableHandle

Status GetServableHandle(
  const ServableRequest & request,
  ServableHandle< T > *const handle
)

Returns a ServableHandle given a ServableRequest.

Returns error if no such Servable is available e.g. not yet loaded, has been quiesced/unloaded, etc. Callers may assume that an OK status indicates a non-null handle.

IMPORTANT: The caller should not hold onto the handles for a long time, because holding them will delay servable loading and unloading.

ListAvailableServableIds

virtual std::vector< ServableId > ListAvailableServableIds() const =0

Gets a list of all available servable ids, i.e.

each of these can be retrieved using GetServableHandle.

~Manager

virtual  ~Manager()=default