Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

preference-optimization

Inference Endpoints

text-generation-inference

AutoTrain Compatible

8-bit precision

Misc with no match

4-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

6

Full-text search

Active filters: preference-optimization

tahamajs/llama-3.2-3b-orpo-lora64-4bit-instruct

Updated 25 days ago • 3

tokutsu/japanese-answer-13b-8bit

Updated 8 days ago • 14

Likhith003/dpo-pairrm-lora-adapter

Text Generation • Updated 10 days ago • 16

Likhith003/dpo-llmjudge-lora-adapter

Text Generation • Updated 10 days ago • 16

jasperyeoh2/mistral-dpo-peft

Updated 4 days ago • 11

loganlin777/mistral-7b-dpo-adapter

Updated 1 day ago