Missing EuroBertForQuestionAnswering
Currently there is no implementation for EuroBertForQuestionAnswering
This prevents model evaluation on EuroEval:
https://github.com/EuroEval/EuroEval/issues/815#issuecomment-2711785169
Hey Kenneth, thanks for your comment!
We’re currently working on adding new tasks to meet an upcoming conference deadline, and we will include an updated modeling file when we support them.
If you don’t mind waiting a bit, we’d be happy to update you then.
Cheers!
No rush - whenever you have it ready, we will run the missing evaluation
Hi @hgissbkh I still can't seem to load the for QA:
from transformers import AutoModelForQuestionAnswering
model_id = "EuroBERT/EuroBERT-210m"
mdl = AutoModelForQuestionAnswering.from_pretrained(model_id)
I also can't seem to find any reference on when the implementation was added. Did I miss anything?
Hi
@KennethEnevoldsen
,
Apologies for accidentally closing the discussion earlier, that was my mistake.
I just wanted to let you know that we’ve added the token classification modeling code. However, we don’t plan to add support for QA tasks anytime soon, as we haven’t conducted evaluations for those yet, and several other tasks need to be completed first.
If you’re interested in contributing to the EuroBERT modeling effort, we’d be happy to support you in any way we can!
Thanks for your patience, and we hope you enjoy experimenting with our models!
Ahh, sorry to hear that, but understand that there are different priorities