#[repr(u32)]pub enum Nvfp4Activation {
None = 0,
Silu = 1,
Sigmoid = 2,
SquaredRelu = 3,
}Expand description
Fused projection epilogue. Its integer representation is part of artifact v1.
Variants§
None = 0
Silu = 1
Sigmoid = 2
SquaredRelu = 3
max(x, 0)^2 after the projection has applied tensor_scale once.
A fused routed-expert caller folds the omitted second scale squared
into the following projection’s tensor scale. This keeps the private
intermediate normal without changing the composed result.
Trait Implementations§
Source§impl Clone for Nvfp4Activation
impl Clone for Nvfp4Activation
Source§fn clone(&self) -> Nvfp4Activation
fn clone(&self) -> Nvfp4Activation
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreimpl Copy for Nvfp4Activation
Source§impl Debug for Nvfp4Activation
impl Debug for Nvfp4Activation
Source§impl Default for Nvfp4Activation
impl Default for Nvfp4Activation
Source§fn default() -> Nvfp4Activation
fn default() -> Nvfp4Activation
Returns the “default value” for a type. Read more
impl Eq for Nvfp4Activation
Source§impl PartialEq for Nvfp4Activation
impl PartialEq for Nvfp4Activation
Source§fn eq(&self, other: &Nvfp4Activation) -> bool
fn eq(&self, other: &Nvfp4Activation) -> bool
Tests for
self and other values to be equal, and is used by ==.impl StructuralPartialEq for Nvfp4Activation
Auto Trait Implementations§
impl Freeze for Nvfp4Activation
impl RefUnwindSafe for Nvfp4Activation
impl Send for Nvfp4Activation
impl Sync for Nvfp4Activation
impl Unpin for Nvfp4Activation
impl UnsafeUnpin for Nvfp4Activation
impl UnwindSafe for Nvfp4Activation
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more