Docs4dev
Docs
tensorflow / 2.9 / raw_ops / snapshotdatasetv2.html

tf.raw_ops.SnapshotDatasetV2

Creates a dataset that will write to / read from a snapshot.

tf.raw_ops.SnapshotDatasetV2(
    input_dataset,
    path,
    reader_func_other_args,
    shard_func_other_args,
    output_types,
    output_shapes,
    reader_func,
    shard_func,
    compression='',
    reader_prefix='',
    writer_prefix='',
    hash_valid=False,
    hash=0,
    metadata='',
    name=None
)

This dataset attempts to determine whether a valid snapshot exists at the snapshot_path, and reads from the snapshot in lieu of using input_dataset. If not, it will run the preprocessing pipeline as usual, and write out a snapshot of the data processed for future use.

Args
input_dataset A Tensor of type variant. A variant tensor representing the input dataset.
path A Tensor of type string. The path we should write snapshots to / read snapshots from.
reader_func_other_args A list of Tensor objects.
shard_func_other_args A list of Tensor objects.
output_types A list of tf.DTypes that has length >= 1.
output_shapes A list of shapes (each a tf.TensorShape or list of ints) that has length >= 1.
reader_func A function decorated with @Defun. Optional. A function to control how to read data from snapshot shards.
shard_func A function decorated with @Defun. Optional. A function to control how to shard data when writing a snapshot.
compression An optional string. Defaults to "". The type of compression to be applied to the saved snapshot files.
reader_prefix An optional string. Defaults to "".
writer_prefix An optional string. Defaults to "".
hash_valid An optional bool. Defaults to False.
hash An optional int. Defaults to 0.
metadata An optional string. Defaults to "".
name A name for the operation (optional).
Returns
A Tensor of type variant.

© 2022 The TensorFlow Authors. All rights reserved.
Licensed under the Creative Commons Attribution License 4.0.
Code samples licensed under the Apache 2.0 License.
https://www.tensorflow.org/versions/r2.9/api_docs/python/tf/raw_ops/SnapshotDatasetV2