Chengyue Jiang's picture
8

Chengyue Jiang

jeffchy
·

AI & ML interests

NLP, LLM

Recent Activity

Organizations

NLP Team at Alibaba DAMO Academy's profile picture

jeffchy's activity

reacted to BlinkDL's post with 🔥 28 days ago
view post
Post
4880
RWKV-7 "Goose" 0.4B trained w/ ctx4k automatically extrapolates to ctx32k+, and perfectly solves NIAH ctx16k 🤯 100% RNN and attention-free. Only trained on the Pile. No finetuning. Replicable training runs. tested by our community: https://github.com/Jellyfish042/LongMamba
liked a Space 11 months ago
liked a model about 1 year ago