tf.keras.config.is_flash_attention_enabled
Stay organized with collections
Save and categorize content based on your preferences.
Checks whether flash attention is globally enabled in Keras.
tf.keras.config.is_flash_attention_enabled()
Flash attention is a performance-optimized method for computing attention
in large models, such as transformers, allowing for faster and more
memory-efficient operations. This function checks the global Keras
configuration to determine if flash attention is enabled for compatible
layers (e.g., MultiHeadAttention).
Note that enabling flash attention does not guarantee it will always be
used. Typically, the inputs must be in float16 or bfloat16 dtype, and
input layout requirements may vary depending on the backend.
Returns |
|---|
False if disabled; otherwise, it indicates that it is enabled.
|
Except as otherwise noted, the content of this page is licensed under the Creative Commons Attribution 4.0 License, and code samples are licensed under the Apache 2.0 License. For details, see the Google Developers Site Policies. Java is a registered trademark of Oracle and/or its affiliates. Some content is licensed under the numpy license.
Last updated 2026-10-31 UTC.
[[["Easy to understand","easyToUnderstand","thumb-up"],["Solved my problem","solvedMyProblem","thumb-up"],["Other","otherUp","thumb-up"]],[["Missing the information I need","missingTheInformationINeed","thumb-down"],["Too complicated / too many steps","tooComplicatedTooManySteps","thumb-down"],["Out of date","outOfDate","thumb-down"],["Samples / code issue","samplesCodeIssue","thumb-down"],["Other","otherDown","thumb-down"]],["Last updated 2026-10-31 UTC."],[],[]]
View source on GitHub