Kukedlc/NeuralLLaMa-3-8b-ORPO-v0.3
Text Generation
•
Updated
•
8.16k
•
2
Eugenio Schiavoni
Kukedlc
AI & ML interests
LLM, Computer Vision, Forecast, Neural Muse (EEG), ML for EEG, Cognitive Artificial Intelligence, Neurophysiology, Experimental Psychobiology, Consciousness and Philosophy, Linguistics, Arts, among others.
Recent Activity
updated
a model
7 days ago
Kukedlc/NeuralLLaMa-3-8b-ORPO-v0.3
liked
a model
7 days ago
TIGER-Lab/Qwen2.5-Math-7B-CFT
liked
a dataset
7 days ago
TIGER-Lab/WebInstruct-CFT
Organizations
Kukedlc's activity
updated
a
model
7 days ago
liked
a
model
7 days ago
liked
a
dataset
7 days ago
liked
2
models
8 days ago
liked
a
model
9 days ago
upvoted
an
article
9 days ago
Article
Open-R1: a fully open reproduction of DeepSeek-R1
•
657
liked
a
model
9 days ago
liked
a
dataset
9 days ago
liked
a
model
10 days ago
liked
2
models
11 days ago
liked
a
model
12 days ago
liked
a
dataset
13 days ago
reacted to
lewtun's
post with 🤗🔥🚀
13 days ago
Post
9907
We are reproducing the full DeepSeek R1 data and training pipeline so everybody can use their recipe. Instead of doing it in secret we can do it together in the open!
🧪 Step 1: replicate the R1-Distill models by distilling a high-quality reasoning corpus from DeepSeek-R1.
🧠 Step 2: replicate the pure RL pipeline that DeepSeek used to create R1-Zero. This will involve curating new, large-scale datasets for math, reasoning, and code.
🔥 Step 3: show we can go from base model -> SFT -> RL via multi-stage training.
Follow along: https://github.com/huggingface/open-r1
🧪 Step 1: replicate the R1-Distill models by distilling a high-quality reasoning corpus from DeepSeek-R1.
🧠 Step 2: replicate the pure RL pipeline that DeepSeek used to create R1-Zero. This will involve curating new, large-scale datasets for math, reasoning, and code.
🔥 Step 3: show we can go from base model -> SFT -> RL via multi-stage training.
Follow along: https://github.com/huggingface/open-r1
- 5 replies
updated
a
model
13 days ago
published
a
model
13 days ago
liked
a
model
16 days ago
