tflite_support.metadata_writers.writer_utils.get_tokenizer_associated_files
Stay organized with collections
Save and categorize content based on your preferences.
Gets a list of associated files packed in the tokenzier_options.
View aliases
Main aliases
tflite_support.metadata_writers.audio_classifier.metadata_info.writer_utils.get_tokenizer_associated_files, tflite_support.metadata_writers.audio_classifier.metadata_writer.metadata_info.writer_utils.get_tokenizer_associated_files, tflite_support.metadata_writers.audio_classifier.metadata_writer.writer_utils.get_tokenizer_associated_files, tflite_support.metadata_writers.audio_classifier.writer_utils.get_tokenizer_associated_files, tflite_support.metadata_writers.bert_nl_classifier.metadata_info.writer_utils.get_tokenizer_associated_files, tflite_support.metadata_writers.bert_nl_classifier.metadata_writer.metadata_info.writer_utils.get_tokenizer_associated_files, tflite_support.metadata_writers.bert_nl_classifier.metadata_writer.writer_utils.get_tokenizer_associated_files, tflite_support.metadata_writers.bert_nl_classifier.writer_utils.get_tokenizer_associated_files, tflite_support.metadata_writers.image_classifier.metadata_info.writer_utils.get_tokenizer_associated_files, tflite_support.metadata_writers.image_classifier.metadata_writer.metadata_info.writer_utils.get_tokenizer_associated_files, tflite_support.metadata_writers.image_classifier.metadata_writer.writer_utils.get_tokenizer_associated_files, tflite_support.metadata_writers.image_classifier.writer_utils.get_tokenizer_associated_files, tflite_support.metadata_writers.image_segmenter.metadata_info.writer_utils.get_tokenizer_associated_files, tflite_support.metadata_writers.image_segmenter.metadata_writer.metadata_info.writer_utils.get_tokenizer_associated_files, tflite_support.metadata_writers.image_segmenter.metadata_writer.writer_utils.get_tokenizer_associated_files, tflite_support.metadata_writers.image_segmenter.writer_utils.get_tokenizer_associated_files, tflite_support.metadata_writers.metadata_info.writer_utils.get_tokenizer_associated_files, tflite_support.metadata_writers.nl_classifier.metadata_info.writer_utils.get_tokenizer_associated_files, tflite_support.metadata_writers.nl_classifier.metadata_writer.metadata_info.writer_utils.get_tokenizer_associated_files, tflite_support.metadata_writers.nl_classifier.metadata_writer.writer_utils.get_tokenizer_associated_files, tflite_support.metadata_writers.nl_classifier.writer_utils.get_tokenizer_associated_files, tflite_support.metadata_writers.object_detector.metadata_info.writer_utils.get_tokenizer_associated_files, tflite_support.metadata_writers.object_detector.metadata_writer.metadata_info.writer_utils.get_tokenizer_associated_files, tflite_support.metadata_writers.object_detector.metadata_writer.writer_utils.get_tokenizer_associated_files, tflite_support.metadata_writers.object_detector.writer_utils.get_tokenizer_associated_files
tflite_support.metadata_writers.writer_utils.get_tokenizer_associated_files(
tokenizer_options: Union[None, _metadata_fb.BertTokenizerOptionsT, _metadata_fb.
SentencePieceTokenizerOptionsT, _metadata_fb.RegexTokenizerOptionsT]
) -> List[Optional[str]]
Args |
|---|
tokenizer_options
|
a tokenizer metadata object. Support the following
tokenizer types:
- BertTokenizerOptions:
https://github.com/tensorflow/tflite-support/blob/b80289c4cd1224d0e1836c7654e82f070f9eefaa/tensorflow_lite_support/metadata/metadata_schema.fbs#L436
- SentencePieceTokenizerOptions:
https://github.com/tensorflow/tflite-support/blob/b80289c4cd1224d0e1836c7654e82f070f9eefaa/tensorflow_lite_support/metadata/metadata_schema.fbs#L473
- RegexTokenizerOptions:
https://github.com/tensorflow/tflite-support/blob/b80289c4cd1224d0e1836c7654e82f070f9eefaa/tensorflow_lite_support/metadata/metadata_schema.fbs#L475
|
Returns |
|---|
|
A list of associated files included in tokenizer_options.
|
Except as otherwise noted, the content of this page is licensed under the Creative Commons Attribution 4.0 License, and code samples are licensed under the Apache 2.0 License. For details, see the Google Developers Site Policies. Java is a registered trademark of Oracle and/or its affiliates.
Last updated 2022-11-04 UTC.
View source on GitHub