BigCodeBench: Benchmarking Large Language Models on Solving Practical and Challenging Programming Tasks
•
52
AI & ML interests
None defined yet.
Recent Activity
Articles
Running
10
BigCodeArena
🚀
Compare code outputs from two AI models
Running
BigCodeBench Evaluator
🥇
Evaluate code samples using specified parameters
Running
on
CPU Upgrade
18
BigCodeBench Evaluator
🥇
Evaluate code samples and get results
Running
221
BigCodeBench Leaderboard
🥇
Explore and analyze code completion benchmarks
Running
25
BigCode Model License Agreement
🤝
Display PDF Document
Runtime error
BigCodeBench Interaction
🥇
Running
1.42k
Big Code Models Leaderboard
📈
Search and submit code models for evaluation
Runtime error
BigCodeBench Evaluator
🥇
Running
README
✨
Running
on
CPU Upgrade
90
Am I in The Stack?
📑
Check if your GitHub repositories are in The Stack dataset
Running
14
StarCoder2 Search
🔎
Sleeping
3
Data Inspection
🕵
Running
40
StarCoder Search
🔎
Search code snippets in StarCoder dataset
Runtime error
15
Near Deduplication
⚡
Runtime error
13
OctoCoder Demo
🐙
Runtime error
1
In The CommitPack
👁
Sleeping
Stack V2 Extensions
🏆
Runtime error
414
BigCode - Playground
🪐
Running
32
Reasoning With StarCoder
🧐
Generate code solutions to mathematical and logical problems
Running
54
BigCode - Editor
💻
Start a web server for an app
Runtime error
10
Santa Explains Code
🎅
Runtime error
169
SantaCoder Demo
🎅
Generate code snippets in Python, Java, JavaScript
Build error
Tokenizer Testing
😻
Runtime error
Bot Issues Visualization
🐨