RealmOA LibraryReference
Realm Inc.Realm Inc.
API Reference
Introduction
Coding Standards
Modules
Audio
Core
Crypto
Data
Ml
Enoa::Activation
Cloa::ActorCritic
Stoa::ActorCriticOutput
Cloa::Adam
Cloa::AdamW
Cloa::AdaptiveAvgPool2d
Enoa::AttentionBackend
Enoa::AttentionMode
Cloa::AvgPool2d
Cloa::BatchNorm2d
Stoa::BatchNorm2dBwdResult
Cloa::BpeTokenizer
Cloa::ByteEmbedding
Cloa::ByteEncoder
Cloa::ByteHead
Cloa::CategoricalActorCritic
Stoa::CategoricalActorCriticConfig
Cloa::CbCheckpoint
Cloa::CbCsvLogger
Cloa::CbEarlyStop
Cloa::CbLrScheduler
Cloa::CbPhase
Cloa::CbProgressBar
Cloa::CbSummary
Cloa::CbTraining
Cloa::CbValidation
Stoa::ChannelNormBwdResult
Cloa::CheckpointManager
Cloa::CheckpointManagerConfig
Stoa::ContinuousPolicyResult
Cloa::Conv1d
Stoa::Conv1dBwdWeightResult
Cloa::Conv2d
Stoa::Conv2dBwdWeightResult
Cloa::ConvTranspose1d
Cloa::ConvTranspose2d
Stoa::ConvTranspose2dBwdWeightResult
Cloa::CosineScheduler
Cloa::CosineWarmRestartsScheduler
Enoa::CyclicMode
Cloa::CyclicScheduler
Stoa::DqnLossConfig
Stoa::DqnLossResult
Cloa::DqnTrainer
Stoa::DqnTrainerConfig
Stoa::DqnTrainerMetrics
Cloa::Dropout
Enoa::EarlyStopMode
Cloa::Embedding
Cloa::EmpyrealmCore
Stoa::EmpyrealmCoreEmbeddedOnly
Cloa::Environment
Stoa::EnvironmentSpace
Enoa::EnvironmentSpaceKind
Stoa::EnvironmentSpec
Stoa::EnvironmentTransition
Cloa::Ffn
Stoa::FlashAttentionBwdResult
Cloa::Flatten
Cloa::FlowDenoiser
Stoa::FlowDenoiserConfig
Stoa::FlowMatchBatch
Cloa::FlowTimeEmbedding
Cloa::FlowTransformer
Stoa::FlowTransformerConfig
Nsoa::FnAutograd
Nsoa::FnFlow
Nsoa::FnLoss
Nsoa::FnMetric
Stoa::GaeConfig
Stoa::GaeResult
Cloa::Gelu
Stoa::GpuTimingStats
Cloa::GradientTape
Cloa::GradNo
Cloa::Gru
Cloa::GruCell
Stoa::GruCellPointwiseBwdResult
Stoa::GruScanBwdResult
Stoa::GruScanResult
Cloa::Identity
Cloa::ItRolloutTraining
Stoa::ItRolloutTrainingConfig
Cloa::ItTraining
Stoa::ItTrainingConfig
Cloa::LayerNorm
Stoa::LayerNormBwdResult
Cloa::Linear
Cloa::LinearWarmupCosineScheduler
Stoa::LinearWeightBiasBwdResult
Fnoa::loadOptimizerYaml
Fnoa::loadTrainBaseYaml
Cloa::LRScheduler
Cloa::Mamba3Module
Cloa::MaxPool2d
Stoa::MaxPool2dResult
Cloa::Metric
Cloa::MetricAccuracy
Cloa::MetricLoss
Cloa::MetricValueFormatter
Cloa::ModelFile
Enoa::ModelFileCompression
Cloa::ModelFileConfig
Fnoa::modelFileHasKnownOptimizer
Cloa::ModelFileHeader
Fnoa::modelFileIsMuonOnly
Fnoa::modelFileOptimizerTypeIs
Fnoa::modelFilePageAlign
Enoa::ModelFileSection
Cloa::ModelFileSectionHeader
Cloa::ModelOptimizerState
Enoa::ModelTensorEncoding
Cloa::ModelTensorEntry
Cloa::ModelTrainingProgress
Cloa::ModelTranslator
Cloa::Module
Cloa::ModuleBuffer
Cloa::Moe
Stoa::MoeRouteStats
Cloa::MultiHeadAttention
Cloa::Muon
Stoa::NamedParameter
Cloa::NnTransformer
Cloa::OneCycleScheduler
Cloa::Optimizer
Cloa::OptimizerConfig
Cloa::OptimizerNoOp
Cloa::Parameter
Enoa::PlateauMode
Stoa::PolicyEvaluationConfig
Stoa::PolicyEvaluationMetrics
Cloa::PolicyEvaluator
Stoa::PolicyResult
Stoa::PpoLossConfig
Stoa::PpoLossResult
Cloa::PpoTrainer
Stoa::PpoTrainerConfig
Stoa::PpoTrainerMetrics
Enoa::Quantization
Fnoa::quantizationFromString
Fnoa::quantizationToString
Cloa::QuantMatrix
Cloa::ReduceOnPlateauScheduler
Cloa::Relu
Stoa::ReplayBatch
Cloa::ReplayBuffer
Stoa::ReplayConfig
Stoa::ReplayTransition
Cloa::ResidualVectorQuantizer
Stoa::ResidualVqResult
Cloa::RmsNorm
Stoa::RmsNormBwdResult
Stoa::RmsNormGatedBwdResult
Cloa::Rnn
Cloa::RnnCell
Stoa::RnnCellPointwiseBwdResult
Stoa::RnnScanBwdResult
Stoa::RnnScanResult
Stoa::RolloutBatch
Cloa::RolloutBuffer
Cloa::RolloutCollector
Stoa::RolloutCollectorConfig
Stoa::RolloutCollectorMetrics
Stoa::RolloutConfig
Enoa::RolloutTrainingPhase
Stoa::RolloutTransition
Cloa::Rope
Stoa::SacCriticLossResult
Stoa::SacLossConfig
Cloa::SacTrainer
Stoa::SacTrainerConfig
Stoa::SacTrainerMetrics
Cloa::Sequential
Cloa::SequentialScheduler
Cloa::Sgd
Cloa::Silu
Cloa::Softmax
Cloa::Swiglu
Stoa::SwigluBwdResult
Cloa::TrainBaseConfig
Stoa::TrainingCommand
Enoa::TrainingCommandDisposition
Enoa::TrainingCommandKind
Stoa::TrainingCommandResult
Enoa::TrainingCompilationStage
Stoa::TrainingCompilationStageRecord
Enoa::TrainingCompilationState
Stoa::TrainingMetricSample
Enoa::TrainingParameterClass
Stoa::TrainingParameterDesc
Stoa::TrainingPhaseStats
Cloa::TrainingProgram
Cloa::TrainingProgramOptions
Cloa::TrainingSession
Stoa::TrainingSessionConfig
Stoa::TrainingSessionHandlers
Stoa::TrainingSnapshot
Enoa::TrainingState
Stoa::TrainingValue
Enoa::TrainingValueKind
Stoa::TrainPhaseConfig
Cloa::TransformerBlock
Cloa::Upsample
Enoa::UpsampleMode
Cloa::ValidationMetric
Stoa::ValidationResult
Cloa::VectorQuantizer
Stoa::VectorQuantizerConfig
Stoa::VqAssignResult
Stoa::VqResult
Cloa::VramBudgetConfig
Cloa::VramBudgetResult
Cloa::WarmupScheduler
Enoa::WeightFormat
Stoa::WeightInfo
Stoa::WeightMap
Stoa::WeightMapping
Stoa::WeightSlice
Cloa::WeightSource
Stoa::WeightTransferReport
Enoa::WeightTransform
Ui
Vision
Classes
SDK
API ReferenceAPI Reference·ModulesModules·MlMl

oa::AttentionMode

Token-visibility contract for self-attention.

EnC++ public headers#include <oa/ml/nn/attention.h>#include <oa/ml/nn/attention.h>

Public Values

Causal
Bidirectional

On this page