BigCodeBench: Benchmarking Large Language Models on Solving Practical and Challenging Programming Tasks
•
46
BigCode
Enterprise
non-profit
AI & ML interests
None defined yet.
Recent Activity
View all activity
Articles
bigcode's activity
hughesthe1st
updated
a
dataset
4 days ago
albertvillanova
posted
an
update
7 days ago
Post
2307
smolagents v1.14.0 is out! 🚀
🔌 MCPClient: A sleek new client for connecting to remote MCP servers, making integrations more flexible and scalable.
🪨 Amazon Bedrock: Native support for Bedrock-hosted models.
SmolAgents is now more powerful, flexible, and enterprise-ready. 💼
Full release 👉 https://github.com/huggingface/smolagents/releases/tag/v1.14.0
#smolagents #LLM #AgenticAI
🔌 MCPClient: A sleek new client for connecting to remote MCP servers, making integrations more flexible and scalable.
🪨 Amazon Bedrock: Native support for Bedrock-hosted models.
SmolAgents is now more powerful, flexible, and enterprise-ready. 💼
Full release 👉 https://github.com/huggingface/smolagents/releases/tag/v1.14.0
#smolagents #LLM #AgenticAI
terryyz
updated
8
datasets
12 days ago
bigcode/bigcodebench-hard-results
Viewer
•
Updated
•
202
•
139
•
1
bigcode/bigcodebench-hard-solve-rate
Viewer
•
Updated
•
296
•
179
•
1
bigcode/bigcodebench-hard-domain
Viewer
•
Updated
•
372
•
212
•
1
bigcode/bigcodebench-hard-perf
Viewer
•
Updated
•
372
•
181
bigcode/bigcodebench-results
Viewer
•
Updated
•
202
•
156
•
2
bigcode/bigcodebench-solve-rate
Viewer
•
Updated
•
2.28k
•
154
bigcode/bigcodebench-domain
Viewer
•
Updated
•
279
•
121
bigcode/bigcodebench-perf
Viewer
•
Updated
•
279
•
91
ncmeade
authored
a
paper
14 days ago
Post
4438
If you've followed the progress of robotics in the past 18 months, you've likely noticed how robotics is increasingly becoming the next frontier that AI will unlock.
At Hugging Face—in robotics and across all AI fields—we believe in a future where AI and robots are open-source, transparent, and affordable; community-built and safe; hackable and fun. We've had so much mutual understanding and passion working with the Pollen Robotics team over the past year that we decided to join forces!
You can already find our open-source humanoid robot platform Reachy 2 on the Pollen website and the Pollen community and people here on the hub at
pollen-robotics
We're so excited to build and share more open-source robots with the world in the coming months!
At Hugging Face—in robotics and across all AI fields—we believe in a future where AI and robots are open-source, transparent, and affordable; community-built and safe; hackable and fun. We've had so much mutual understanding and passion working with the Pollen Robotics team over the past year that we decided to join forces!
You can already find our open-source humanoid robot platform Reachy 2 on the Pollen website and the Pollen community and people here on the hub at
pollen-robotics
We're so excited to build and share more open-source robots with the world in the coming months!
- 1 reply
Post
3403
Having some fun with long context benchmarks (watch the video!!)
NoLiMA: NoLiMa: Long-Context Evaluation Beyond Literal Matching (2502.05167)
Fiction LiveBench: https://fiction.live/stories/Fiction-liveBench-Mar-25-2025/oQdzQvKHw8JyXbN87
Michalenglo: https://deepmind.google/research/publications/117639/
LongGenBench: Spinning the Golden Thread: Benchmarking Long-Form Generation in Language Models (2409.02076)
NeedleBench: NeedleBench: Can LLMs Do Retrieval and Reasoning in 1 Million Context Window? (2407.11963)
RULER: RULER: What's the Real Context Size of Your Long-Context Language Models? (2404.06654)
For more: https://www.reddit.com/r/rajistics/comments/1jxwk29/long_context_llm_benchmarks_video/
let me know if you like these posts
NoLiMA: NoLiMa: Long-Context Evaluation Beyond Literal Matching (2502.05167)
Fiction LiveBench: https://fiction.live/stories/Fiction-liveBench-Mar-25-2025/oQdzQvKHw8JyXbN87
Michalenglo: https://deepmind.google/research/publications/117639/
LongGenBench: Spinning the Golden Thread: Benchmarking Long-Form Generation in Language Models (2409.02076)
NeedleBench: NeedleBench: Can LLMs Do Retrieval and Reasoning in 1 Million Context Window? (2407.11963)
RULER: RULER: What's the Real Context Size of Your Long-Context Language Models? (2404.06654)
For more: https://www.reddit.com/r/rajistics/comments/1jxwk29/long_context_llm_benchmarks_video/
let me know if you like these posts
ncmeade
authored
a
paper
18 days ago
benlipkin
authored
3
papers
18 days ago
LINC: A Neurosymbolic Approach for Logical Reasoning by Combining Language Models with First-Order Logic Provers
Paper
•
2310.15164
•
Published
•
2
Elements of World Knowledge (EWOK): A cognition-inspired framework for evaluating basic world knowledge in language models
Paper
•
2405.09605
•
Published
Fast Controlled Generation from Language Models with Adaptive Weighted Rejection Sampling
Paper
•
2504.05410
•
Published
•
3
albanie
authored
a
paper
19 days ago
thomwolf
authored
a
paper
21 days ago
anton-l
authored
a
paper
21 days ago