Error converting microsoft/Phi-4-mini-instruct: Shapes (48) and (64) cannot be broadcast.

#35
by Felladrin - opened
MLX Community org
MLX Community org

The model needed some fixes to work. It's now fixed in mlx-lm 0.21.5.

MLX Community org

I restarted the space hopefully it will install the latest mlx-lm.

MLX Community org

I did a "factory reset" and it works now, here's a converted model: https://huggingface.co./mlx-community/Phi-4-mini-instruct-Q4-mlx

pcuenq changed discussion status to closed
Your need to confirm your account before you can post a new comment.

Sign up or log in to comment