Skip to content

b5704

Latest

Choose a tag to compare

@github-actions github-actions released this 19 Jun 11:12
4dfbeed
[EAGLE] Initial support for EAGLE model (#1)

* [EAGLE] Initial support for EAGLE model

Added the definition and ```decode``` function for the EAGLE model.
Also added a sequence-based speculative decoding example using the EAGLE draft model under ```examples/speculative-simple-eagle```.