NOTE: This site has just upgraded to Forester 5.x and is still having some style and functionality issues, we will fix them ASAP.

reference. Eagle and finch: RWKV with matrix-valued states and dynamic recurrence [peng2024eagle]
✍️source

  • 2024
  • Bo Peng, Daniel Goldstein, Quentin Anthony, Alon Albalak, Eric Alcaide, Stella Biderman, Eugene Cheah, Teddy Ferdinan, Haowen Hou, Przemysław Kazienko, others
@article{peng2024eagle,
 title = {Eagle and Finch: RWKV with matrix-valued states and dynamic recurrence},
 author = {Peng, Bo and Goldstein, Daniel and Anthony, Quentin and Albalak, Alon and Alcaide, Eric and Biderman, Stella and Cheah, Eugene and Ferdinan, Teddy and Hou, Haowen and Kazienko, Przemys{\l}aw and others},
 year = {2024},
 journal = {arXiv preprint arXiv:2404.05892}
}