AI & ML interests

Maintainers of the `huggingface/text-generation-inference` repo

text-generation-inference's activity

julien-cΒ 
posted an update 3 days ago
view post
Post
3595
BOOOOM: Today I'm dropping TINY AGENTS

the 50 lines of code Agent in Javascript πŸ”₯

I spent the last few weeks working on this, so I hope you will like it.

I've been diving into MCP (Model Context Protocol) to understand what the hype was all about.

It is fairly simple, but still quite powerful: MCP is a standard API to expose sets of Tools that can be hooked to LLMs.

But while doing that, came my second realization:

Once you have a MCP Client, an Agent is literally just a while loop on top of it. 🀯

➑️ read it exclusively on the official HF blog: https://huggingface.co./blog/tiny-agents
  • 1 reply
Β·
victorΒ 
posted an update 5 days ago
view post
Post
2450
DIA TTS is just amazing - please share your funniest gens (here is mine) πŸ˜‚
nari-labs/Dia-1.6B
clemΒ 
posted an update 6 days ago
view post
Post
3798
Energy is a massive constraint for AI but do you even know what energy your chatGPT convos are using?

We're trying to change this by releasing ChatUI-energy, the first interface where you see in real-time what energy your AI conversations consume. Great work from @jdelavande powered by spaces & TGI, available for a dozen of open-source models like Llama, Mistral, Qwen, Gemma and more.

jdelavande/chat-ui-energy

Should all chat interfaces have this? Just like ingredients have to be shown on products you buy, we need more transparency in AI for users!
  • 3 replies
Β·
clemΒ 
posted an update 7 days ago
view post
Post
2836
Just crossed half a million public apps on Hugging Face. A new public app is created every minute these days 🀯🀯🀯

What's your favorite? http://hf.co/spaces
  • 3 replies
Β·
clemΒ 
posted an update 12 days ago
view post
Post
1435
You can now bill your inference costs from all our inference partners (together, fireworks, fal, sambanova, cerebras, hyperbolic,...) to your Hugging Face organization.

Useful to drive more company-wide usage of AI without the billing headaches!
  • 1 reply
Β·
clemΒ 
posted an update 23 days ago
clemΒ 
posted an update 25 days ago
view post
Post
1975
Llama models (arguably the most successful open AI models of all times) just represented 3% of total model downloads on Hugging Face in March.

People and media like stories of winner takes all & one model/company to rule them all but the reality is much more nuanced than this!

Kudos to all the small AI builders out there!
  • 2 replies
Β·
clemΒ 
posted an update 26 days ago
view post
Post
1336
Now in Enterprise Hub organizations, you can centralize your billing not only for HF usage but also inference through our inference partners.

Will prevent some headaches for your finance & accounting teams haha (so feel free to share that with them).
  • 3 replies
Β·
clemΒ 
posted an update 28 days ago
view post
Post
4004
Before 2020, most of the AI field was open and collaborative. For me, that was the key factor that accelerated scientific progress and made the impossible possibleβ€”just look at the β€œT” in ChatGPT, which comes from the Transformer architecture openly shared by Google.

Then came the myth that AI was too dangerous to share, and companies started optimizing for short-term revenue. That led many major AI labs and researchers to stop sharing and collaborating.

With OAI and sama now saying they're willing to share open weights again, we have a real chance to return to a golden age of AI progress and democratizationβ€”powered by openness and collaboration, in the US and around the world.

This is incredibly exciting. Let’s go, open science and open-source AI!
Β·
clemΒ 
posted an update about 1 month ago
view post
Post
2414
What's this cool purple banner haha 😢😢😢
Β·
clemΒ 
posted an update about 1 month ago
clemΒ 
posted an update about 1 month ago
clemΒ 
posted an update about 1 month ago
view post
Post
3729
Should we assemble affordable open-source robots at Hugging Face for the community. Would you buy them? At what price?
Β·
clemΒ 
posted an update about 1 month ago
view post
Post
2595
Nice new space to see how fast your personal or organization followers are growing on HF:
julien-c/follow-history

As you can see, I still have more followers than @julien-c even if he's trying to change this by building such cool spaces 😝😝😝
clemΒ 
posted an update about 2 months ago
view post
Post
4653
We just crossed 1,500,000 public models on Hugging Face (and 500k spaces, 330k datasets, 50k papers). One new repository is created every 15 seconds. Congratulations all!
Β·
julien-cΒ 
posted an update about 2 months ago
view post
Post
3666
Important notice 🚨

For Inference Providers who have built support for our Billing API (currently: Fal, Novita, HF-Inference – with more coming soon), we've started enabling Pay as you go (=PAYG)

What this means is that you can use those Inference Providers beyond the free included credits, and they're charged to your HF account.

You can see it on this view: any provider that does not have a "Billing disabled" badge, is PAYG-compatible.
Β·
clemΒ 
posted an update about 2 months ago
view post
Post
7320
I was chatting with @peakji , one of the cofounders of Manu AI, who told me he was on Hugging Face (very cool!).

He shared an interesting insight which is that agentic capabilities might be more of an alignment problem rather than a foundational capability issue. Similar to the difference between GPT-3 and InstructGPT, some open-source foundation models are simply trained to 'answer everything in one response regardless of the complexity of the question' - after all, that's the user preference in chatbot use cases. Just a bit of post-training on agentic trajectories can make an immediate and dramatic difference.

As a thank you to the community, he shared 100 invite code first-come first serve, just use β€œHUGGINGFACE” to get access!
Β·
clemΒ 
posted an update about 2 months ago
clemΒ 
posted an update about 2 months ago
view post
Post
5931
Super happy to welcome Nvidia as our latest enterprise hub customer. They have almost 2,000 team members using Hugging Face, and close to 20,000 followers of their org. Can't wait to see what they'll open-source for all of us in the coming months!

Nvidia's org: nvidia
Enterprise hub: https://huggingface.co./enterprise
clemΒ 
posted an update 2 months ago
view post
Post
2849
What are the best organizations to follow on @huggingface ?

On top of my head:
- Deepseek (35,000 followers): deepseek-ai
- Meta Llama (27,000 followers): meta-llama
- Black Forrest Labs (11,000 followers): black-forest-labs
- OpenAI (5,000 followers): openai
- Nvidia (16,000 followers): nvidia
- MIcrosoft (9,000 followers): microsoft
- AllenAI (2,000 followers): allenai
- Mistral (5,000 followers): mistralai
- XAI (600 followers): xai-org
- Stability AI (16,000 followers): stabilityai
- Qwen (16,000 followers): Qwen
- GoogleAI (8,000 followers): google
- Unsloth (3,000 followers): unsloth
- Bria AI (4,000 followers): briaai
- NousResearch (1,300 followers): NousResearch

Bonus, the agent course org with 17,000 followers: agents-course
  • 1 reply
Β·