Official Results

Leaderboard

Subtask 1

Context-Aware English-to-Dialectal Arabic MT

Constrained and unconstrained submissions are ranked separately by Average SPBLEU.

Constrained Track
Rank Team Participants Average SPBLEU Average chrF++
1 Thakaa Meshal Alamr, Maryam Altuwaijri, Hassan Alqaeri 30.423306 45.424961
2 LahjaMT Mohamed Abdallah, Samhaa El-Beltagy 28.300849 43.813008
3 FCDS Ranwa Aly, Seif Eldin Maan, Farida Aly, Isis Ashraf 26.482499 42.302886
4 Rosetta Nada Esmaeil, Fathima Rena, Sibi Subhas, Osama Elgendy, Mina Fady, Salma Yehia, Muhammad Arif 26.099997 41.788715
5 Namaa Community Fatimah Emad Eldin, Omer Nacar, Khloud AL Jallad, Mona Abdelazim 23.257001 39.033835
6 Hasan_kh Hasan Alkhder, Maher Pasa, Amro Najjar, Ahmet zengin 20.362129 36.639966
Unconstrained Track
Rank Team Participants Average SPBLEU Average chrF++
1 Thakaa Meshal Alamr, Maryam Altuwaijri, Hassan Alqaeri 33.489055 48.132030
2 cepin Josef Jon 32.500504 47.046802
3 LahjaMT Mohamed Abdallah, Samhaa El-Beltagy 28.539732 44.024134
4 Namaa Community Fatimah Emad Eldin, Omer Nacar, Khloud AL Jallad, Mona Abdelazim 27.413210 42.583782
5 Rosetta Nada Esmaeil, Fathima Rena, Sibi Subhas, Osama Elgendy, Mina Fady, Salma Yehia, Muhammad Arif 25.094340 41.018987
6 Hasan_kh Hasan Alkhder, Maher Pasa, Amro Najjar, Ahmet zengin 20.362129 36.639966
Subtask 2

Cross-Dialect Arabic MT

Systems are ranked by Average SPBLEU across Arabic dialect-pair settings.

Official Leaderboard
Rank Team Participants Average SPBLEU Average chrF++
1 Thakaa Meshal Alamr, Maryam Altuwaijri, Hassan Alqaeri 28.401135 42.150868
2 ALEXIS Momen Ibrahim Fawzy, Mariam Hassib, Ahmed Salem, Marwan Torki 25.840361 39.018509
3 Namaa Community Fatimah Emad Eldin, Omer Nacar, Khloud AL Jallad, Mona Abdelazim 24.528436 39.036475
4 L3IA Mohamed M'haouach, Houda Bouraqqadi, Hamza Alami 14.072907 29.747538
Subtask 3

MT Error Detection and Classification

Systems are ranked by Overall Score; Exact Match F1, Overlap F1, and Error Class Macro-F1 are also reported.

Official Leaderboard
Rank Team Participants Overall Score Exact Match F1 Overlap F1 Error Class Macro-F1
1 Thakaa Meshal Alamr, Maryam Altuwaijri, Hassan Alqaeri 0.498212 0.231933 0.542642 0.453782
2 Namaa Community Fatimah Emad Eldin, Omer Nacar, Khloud AL Jallad, Mona Abdelazim 0.464135 0.223926 0.544835 0.383436
3 TTlab Ali Abusaleh, Bhuvanesh Verma, Alexander Mehler 0.409109 0.194030 0.460009 0.358209
4 REGLAT Mariam Labib, Hammdaa El Nayel, Bakhoum Ramzy 0.402132 0.004098 0.427215 0.377049
5 Axiom Md. Ajwad Hossain 0.392645 0.166400 0.481290 0.304000
6 ArabicMTDiagnostics Sarah Yassine 0.348448 0.122186 0.381783 0.315113