tensorflow:: serving
Summary
Typedefs |
|
---|---|
LoaderSource
|
using |
Functions |
|
---|---|
operator!=(const Loader::Metadata & a, const Loader::Metadata & b)
|
bool
|
operator!=(const ServableHandle< T > & l, const ServableHandle< U > & r)
|
constexpr bool
|
operator!=(const ServableStateMonitor::ServableStateAndTime & a, const ServableStateMonitor::ServableStateAndTime & b)
|
bool
|
operator<<(std::ostream & os, const ServableStateMonitor::ServableStateAndTime & state_and_time)
|
std::ostream &
|
operator==(const AspiredVersionPolicy::ServableAction & lhs, const AspiredVersionPolicy::ServableAction & rhs)
|
bool
|
operator==(const Loader::Metadata & a, const Loader::Metadata & b)
|
bool
|
operator==(const ServableHandle< T > & l, const ServableHandle< U > & r)
|
constexpr bool
|
operator==(const ServableStateMonitor::ServableStateAndTime & a, const ServableStateMonitor::ServableStateAndTime & b)
|
bool
|
Classes |
|
---|---|
tensorflow:: |
An interface for the policy to be applied for transitioning servable versions in a servable stream. |
tensorflow:: |
A manager that implements the Target<Loader> API which uses aspired-versions callbacks to dictate which servable versions to load. |
tensorflow:: |
Builds an AspiredVersionsManager with options and sources connected to it. |
tensorflow:: |
Helps manage the lifecycle of servables including loading, serving and unloading them. |
tensorflow:: |
A manager that manages and loads servables on-demand. |
tensorflow:: |
Model-type agnostic interface for performing classification. |
tensorflow:: |
A storage path source that aspires versions for a given set of servables. |
tensorflow:: |
A standardized abstraction for an object that manages the lifecycle of a servable, including loading and unloading it. |
tensorflow:: |
LoaderHarness is a widget the Manager uses to hold on to and talk to a Loader while it owns it. |
tensorflow:: |
Manager is responsible for loading, unloading, lookup and lifetime management of all Servable objects via their Loaders. |
tensorflow:: |
A simple LoaderFactory that looks for a servable at a path formed by concatenating a fixed path prefix with the servable's name. |
tensorflow:: |
Model agnostic interface for performing regression. |
tensorflow:: |
A Loader that is oblivious to resources. |
tensorflow:: |
A factory that creates SavedModelBundles from SavedModel or SessionBundle export paths. |
tensorflow:: |
A smart pointer to the underlying servable object T retrieved from the Loader. |
tensorflow:: |
A utility that listens to an EventBus<ServableState>, and keeps track of the state of each servable mentioned on the bus. |
tensorflow:: |
ServerCore contains state and helper methods enabling the building of ModelServers that support multiple interfaces. |
tensorflow:: |
A Session that blocks state-changing methods such as Close(), while allowing Run() for read-only access (not enforced). |
tensorflow:: |
A ServingSession that wraps a given Session, and blocks all calls other than Run(). |
tensorflow:: |
|
tensorflow:: |
An implementation of UntypedServableHandle using shared_ptr to do ref-counting on the Loader that owns the Servable. |
tensorflow:: |
An abstraction for a module that sources servables to load, or, more precisely, handles to data that can be used to load those servables. |
tensorflow:: |
An abstraction for a module that receives aspired-version callbacks with data of type InputType and converts them into calls with data of type OutputType. |
tensorflow:: |
A non-templatized handle to a servable, used internally in the Manager to retrieve a type-erased servable object from the Loader. |
Structs |
|
---|---|
tensorflow:: |
A snapshot of a servable's state and aspiredness. |
tensorflow:: |
A query for a specific loaded servable object. |
Namespaces |
|
---|---|
tensorflow:: |
|
tensorflow:: |
Typedefs
Functions
operator!=
bool operator!=( const Loader::Metadata & a, const Loader::Metadata & b )
operator!=
constexpr bool operator!=( const ServableHandle< T > & l, const ServableHandle< U > & r )
operator!=
bool operator!=( const ServableStateMonitor::ServableStateAndTime & a, const ServableStateMonitor::ServableStateAndTime & b )
operator<<
std::ostream & operator<<( std::ostream & os, const ServableStateMonitor::ServableStateAndTime & state_and_time )
operator==
bool operator==( const AspiredVersionPolicy::ServableAction & lhs, const AspiredVersionPolicy::ServableAction & rhs )
operator==
bool operator==( const Loader::Metadata & a, const Loader::Metadata & b )
operator==
constexpr bool operator==( const ServableHandle< T > & l, const ServableHandle< U > & r )
operator==
bool operator==( const ServableStateMonitor::ServableStateAndTime & a, const ServableStateMonitor::ServableStateAndTime & b )