Jim Lai

grimjim

AI & ML interests

Experimenting primarily with 7B-12B parameter text completion models. Not all models are intended for direct use, but aim for research and/or educational purposes.

Recent Activity

posted an update about 11 hours ago

I've made yet another merge of reasoning models with incremental gains on the current Open LLM leaderboard. open-llm-leaderboard/open_llm_leaderboard Merging in DeepSeek R1 distillation to Llama 3.1 8B (at 10% task arithmetic weight, using the Llama 3.1 8B base model as the case rather than the instruct model) with a prior best merge resulted in a slightly lower IFEval, but a higher result in every other benchmark save for MMLU-PRO, which went down only marginally. MATH Lvl5 and GPQA went up palpably. grimjim/DeepSauerHuatuoSkywork-R1-o1-Llama-3.1-8B This result is currently my best Llama 3.1 8B merge result to date. The actual R1 distillation itself scored quite badly, so this would seem to be another case of unexpected formatting (reflected in IFEval) hurting the evaluation results, obscuring the strength of a model. It is also possible to use the text generation feature of this model to generate roleplay completions. Based on informal testing, this model's bias toward problem-solving will subtly impact narration.

updated a collection 1 day ago

Highlighted work

new activity 8 days ago

google/gemma-2-2b-it:SLERP merge example code?

View all activity

Organizations

grimjim's activity

New activity in google/gemma-2-2b-it 8 days ago

SLERP merge example code?

#20 opened 6 months ago by

grimjim

New activity in grimjim/SauerHuatuoSkywork-o1-Llama-3.1-8B 11 days ago

Adding Evaluation Results

#1 opened 11 days ago by

T145

New activity in FreedomIntelligence/HuatuoGPT-o1-8B 11 days ago

Please submit this model to the Open LLM Leaderboard

#1 opened about 1 month ago by

grimjim

New activity in grimjim/HuatuoSkywork-o1-Llama-3.1-8B about 1 month ago

Adding Evaluation Results

#1 opened about 1 month ago by

T145

New activity in anthracite-org/magnum-v4-27b 3 months ago

Adding Evaluation Results

#2 opened 3 months ago by

leaderboard-pr-bot

New activity in anthracite-org/magnum-v4-12b 3 months ago

Adding Evaluation Results

#3 opened 3 months ago by

leaderboard-pr-bot

New activity in anthracite-org/magnum-v2-72b 4 months ago

Adding Evaluation Results

#6 opened 4 months ago by

kirin7

New activity in anthracite-org/magnum-v3-27b-kto 4 months ago

Adding Evaluation Results

#4 opened 4 months ago by

CombinHorizon

New activity in grimjim/PAlign-PAPI-personality_prompt.json-cleaned 5 months ago

[bot] Conversion to Parquet

#1 opened 5 months ago by

parquet-converter

New activity in grimjim/llama-3-Nephilim-v2.1-8B 5 months ago

Adding Evaluation Results

#1 opened 5 months ago by

leaderboard-pr-bot

New activity in grimjim/llama-3-Nephilim-v2-8B 5 months ago

Adding Evaluation Results

#2 opened 5 months ago by

leaderboard-pr-bot

New activity in grimjim/Llama-3.1-8B-Instruct-abliterated_via_adapter-GGUF 5 months ago

fp16 version?

#2 opened 5 months ago by

Tycho-S

New activity in grimjim/Llama-3.1-8B-Instruct-abliterated_via_adapter 5 months ago

Adding Evaluation Results

#3 opened 5 months ago by

leaderboard-pr-bot

New activity in grimjim/Llama-3-Instruct-8B-SimPO-SPPO-Iter3-merge 5 months ago

Adding Evaluation Results

#1 opened 5 months ago by

leaderboard-pr-bot

New activity in grimjim/Llama-3-Instruct-8B-SPPO-Iter3-SimPO-merge 5 months ago

Adding Evaluation Results

#1 opened 5 months ago by

leaderboard-pr-bot

New activity in anthracite-org/magnum-v2-12b 5 months ago

Adding Evaluation Results

#8 opened 5 months ago by

leaderboard-pr-bot

New activity in anthracite-org/magnum-v3-34b 5 months ago

Adding Evaluation Results

#1 opened 5 months ago by

leaderboard-pr-bot

New activity in grimjim/Llama-3.1-8B-Instruct-abliterated_via_adapter-GGUF 5 months ago

q8 gives error in LM studio: "Checksum failed file corrupted"

#1 opened 5 months ago by

tazztone

New activity in grimjim/llama-3-Nephilim-v3-8B 5 months ago

Adding Evaluation Results

#2 opened 5 months ago by

leaderboard-pr-bot

New activity in grimjim/Llama-3.1-8B-Instruct-abliterated_via_adapter 6 months ago

Can you tell me how to donwload this in the cli?

#2 opened 6 months ago by

GoudaCouda