Positional Encoding
Type:
Sinusoidal (Vaswani 2017)
Relative Position
Learned (matrix)
Seq len:
32
d_model:
32