attention

Editor GitHub 1-044-2025-hardware-for-codesignlibraries h4cd specs interfaces thingsattention

Editor

Visualization

	`interface { """interface for an attention kernel""" provides cache_dim_q [dimensionless] provides cache_dim_x [dimensionless] provides cache_dim_d [dimensionless] provides num_tiles_q [dimensionless] provides num_tiles_x [dimensionless] provides num_tiles_d [dimensionless] requires compute [ops] requires memory_movement [B] requires cache_size [MB] }`

Other informationremove

NDPInterface                                                                 
├ fs: fdict[6]                                                               
│     │ cache_dim_q: SB(≥0)                                                  
│     │ cache_dim_x: SB(≥0)                                                  
│     │ cache_dim_d: SB(≥0)                                                  
│     │ num_tiles_q: SB(≥0)                                                  
│     │ num_tiles_x: SB(≥0)                                                  
│     └ num_tiles_d: SB(≥0)                                                  
└ rs: {compute: SB(≥0) ops, memory_movement: SB(≥0) B, cache_size: SB(≥0) MB}