Spark-Attn / 02 / interactive illustration

Reweight the summary, restore the mass

Spark-Reweight combines weighted summaries with a log-mass bias.

01 · Mean pooling

02 · Restore attention mass

03 · Weighted value

Progress0%