diff options
| author | Konstantin <const@const.me> | 2023-01-23 13:48:29 +0100 |
|---|---|---|
| committer | Konstantin <const@const.me> | 2023-01-23 13:48:29 +0100 |
| commit | 01aba39f15a03ed96e034ffc3b6ee9ec12294b0d (patch) | |
| tree | c8f4b5610c15404f97e01f2436febf13994ed586 /Whisper/ML/Context.ops.cpp | |
| parent | 99b87744ba22df78e3c476c92945b75acd267b87 (diff) | |
Minor, profiler tags
Diffstat (limited to 'Whisper/ML/Context.ops.cpp')
| -rw-r--r-- | Whisper/ML/Context.ops.cpp | 1 |
1 files changed, 1 insertions, 0 deletions
diff --git a/Whisper/ML/Context.ops.cpp b/Whisper/ML/Context.ops.cpp index 7dfca9f..a94497e 100644 --- a/Whisper/ML/Context.ops.cpp +++ b/Whisper/ML/Context.ops.cpp @@ -192,6 +192,7 @@ Tensor MlContext::flashAttention( const Tensor& q, const Tensor& k, const Tensor profiler.setNextTag( "flashAttn.1" ); Tensor tmp = mulMat( k, q ); + profiler.setNextTag( "flashAttention" ); const float tempScale = (float)( 1.0 / sqrt( (double)(int)q.ne[ 0 ] ) ); softMax( tmp, tempScale ); |