Skip to content

v2.0.0, update Autograd

Choose a tag to compare

View all tags
@AkiRusProd AkiRusProd released this 21 Jul 14:17
· 57 commits to master since this release
v2.0.0
19d2d54
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.
  • Now Autograd is tape-based, (previously it was fully recursive)
  • Bug fixes and optimization
    • Simplify nn.Embedding
    • Simplify autograd reverse_broadcast method
    • Fix where grad_fn method
  • Add Seq2Seq Transformer example
  • Other
    • Add nn.LogSoftmax
    • Edit nn.Linear bias initialization
    • Оther fixes and improvements

New autograd version enables transformer training, overcoming previous limitations due to slow backpropagation speed.

Assets 2
Loading