Experimental API for building input pipelines.

This module contains experimental Dataset sources and transformations that can be used in conjunction with the API. Note that the API is not subject to the same backwards compatibility guarantees as, but we will provide deprecation advice in advance of removing existing functionality.

See Importing Data for an overview.


service module: API for using the service.


class AutoShardPolicy: Represents the type of auto-sharding to use.

class CheckpointInputPipelineHook: Checkpoints input pipeline state every N steps or seconds.

class CsvDataset: A Dataset comprising lines from one or more CSV files.

class DatasetStructure: Type specification for

class DistributeOptions: Represents options for distributed data processing.

class ExternalStatePolicy: Represents how to handle external state during serialization.