tf.keras.config.enable_flash_attention
Stay organized with collections
Save and categorize content based on your preferences.
Enable flash attention.
tf.keras.config.enable_flash_attention()
Flash attention offers performance optimization for attention layers,
making it especially useful for large language models (LLMs) that
benefit from faster and more memory-efficient attention computations.
Once enabled, supported layers like MultiHeadAttention will attempt to
use flash attention for faster computations. By default, this feature is
enabled.
Note that enabling flash attention does not guarantee it will always be
used. Typically, the inputs must be in float16 or bfloat16 dtype, and
input layout requirements may vary depending on the backend.
Except as otherwise noted, the content of this page is licensed under the Creative Commons Attribution 4.0 License, and code samples are licensed under the Apache 2.0 License. For details, see the Google Developers Site Policies. Java is a registered trademark of Oracle and/or its affiliates. Some content is licensed under the numpy license.
Last updated 2026-10-31 UTC.
[[["Easy to understand","easyToUnderstand","thumb-up"],["Solved my problem","solvedMyProblem","thumb-up"],["Other","otherUp","thumb-up"]],[["Missing the information I need","missingTheInformationINeed","thumb-down"],["Too complicated / too many steps","tooComplicatedTooManySteps","thumb-down"],["Out of date","outOfDate","thumb-down"],["Samples / code issue","samplesCodeIssue","thumb-down"],["Other","otherDown","thumb-down"]],["Last updated 2026-10-31 UTC."],[],[]]
View source on GitHub