In this video, John Barron was talking about the toy problem of memorizing a 2D image. I wanted to try, and see the results of the Positional Encoding
| Input | no encoding | sin_cos |
|---|---|---|
 |
 |
 |
In this video, John Barron was talking about the toy problem of memorizing a 2D image. I wanted to try, and see the results of the Positional Encoding
| Input | no encoding | sin_cos |
|---|---|---|
|
|
|