IBERSPEECH 2022 EVALUATION CHALLENGES

Granada, November, 2022

IberSPEECH’2022 will be held in Granada (Spain), from 14 to 16 November 2022.
The IberSPEECH event –the fifth of its kind using this name– brings together the XI Jornadas en Tecnologías del Habla and the VI Iberian SLTech Workshop events.

We are glad to announce that IberSPEECH'2022 will hold the traditional Albayzín evaluation organized by the Spanish Thematic Network on Speech Technologies.

ALBAYZIN EVALUATION CHALLENGE

The Albayzín evaluation challenge focuses on evaluating different speech technologies over TV and radio broadcast.

Four evaluations are proposed:

  • Speech to Text Challenge (S2TC), organized by RTVE and Universidad de Zaragoza, consists of automatically transcribe different types of TV shows. More information and evaluation plans ...

  • Speaker Diarization and Identity Assignement Challenge (SDIAC), organized by RTVE and Universidad de Zaragoza, consists of segmenting broadcast audio documents according to different speakers, linking those segments which originate from the same speaker and identify a closed set of speakers. More information and evaluation plans ...

  • Text and Speech Alignment Challenge (TaSAC), consists of two subchallenges:
    • (Task 1)TaSAC-ST:Alignment of respeaking generated subtitles, organized by RTVE and Universidad de Zaragoza, consists of synchronazing the broadcast subtitles created by respeaking of different TV shows. More information and evaluation plans ...
    • (Task 2)TaSAC-BP:Alignment and validation of speech signals with partial and inaccurate text transcriptions, organized by University of the Basque Country (UPV/EHU), consists of aligning text and audio extracted from a plenary session of the Basque Parliament. More information and evaluation plans ...
  • Search on Speech Challenge (SoSC), organized by Universidad San Pablo-CEU and AuDIaS from Universidad Autónoma de Madrid, consists of searching in audio content a list of terms/queries. More information and evaluation plans ...

The organization will release a corpus consisting of more than 700 hours of TV shows from Radio Televisión Española (RTVE), more than 80 hours of speech from 3/24 TV channel (Corporació Catalana de Mitjans Audiovisuals, CCMA) and more than 20 hours of speech from Aragón Radio (Corporación Aragonesa de Radio y Televisión, CARTV).

RTVE Databases License

The data is available subject to the terms of a licence agreement with the RTVE.
To download the RTVE databases,  a representative of your research group, company,..., must sign the license agreement (Digital signature is valid)

LATE SUBMISSION: The calendar for the Albayzín evaluations is:
  • April 22th, 2022: Registration opens
  • April 22th, 2022: Release of the training and development data
  • September 4th, 2022: Registration deadline.
  • September 5th, 2022 Release of the evaluation data
  • October 16th, 2022: Submission deadline
  • October 24th, 2022: Results distribution to the participants
  • October 30th, 2022: Paper submission deadline
  • November 15th, 2022:Iberspeech 2022 Albayzin Evaluations special session in Granada

For any additional information, please contact the organizers of the calls.

The ALBAYZIN 2022 Evaluations Organizing Committee

Eduardo Lleida Solano, lleida@unizar.es, Universidad de Zaragoza, Spain
Alfonso Ortega Giménez, ortega@unizar.es, Universidad de Zaragoza, Spain
Javier Tejedor Noguerales, javier.tejedornoguerales@ceu.es, Universidad San Pablo CEU, Spain
Luis Javier Rodríguez Fuentes, luisjavier.rodriguez@ehu.es, Universidad del País Vasco, Spain