This project has received funding from the European Union's Horizon H2020 research and innovation programme under grant agreement No 957017
The internet contains vast amounts of data and information, written and audiovisual, and in many different languages. There is a growing need to take advantage of this largely untapped resource.
The EU-funded SELMA project will address the ingestion and monitoring of large amounts of data.
The project will systematically train machine learning models for natural language tasks and use these models to monitor data streams, aiming to improve multilingual media monitoring and news content production.
The project will ultimately advance the state of the art in language modelling, machine translation and speech recognition and synthesis.
SELMA builds a continuous deep learning multilingual media platform using extreme analytics.
Large amounts of multilingual text and speech data are available in the internet, but the potential to fully take advantage of this data has remained largely untapped.
Recent advances in deep learning and transfer learning have opened the door to new possibilities – in particular integrating knowledge from these large unannotated datasets into plugable models for tackling machine learning tasks.
The aim of the Stream Learning for Multilingual Knowledge Transfer (SELMA) is to address three tasks: ingest large amounts of data and continuously train machine learning models for several natural language tasks; monitor these data streams using such models to improve multilingual Media Monitoring (use case 1); and improve the task of multilingual News Content Production (use case 2), thereby closing the loop between content monitoring and production.
SELMA has eight goals:
- Enable processing of massive video and text data streams in a distributed and scalable fashion
- Develop new methods for training unsupervised deep learning language models in 30 languages
- Enable knowledge transfer across tasks and languages, supporting low-resourced languages
- Develop novel data analytics methods and visualizations to facilitate the media monitoring decision-making process
- Develop an open-source platform to optimize multilingual content production in 30 languages
- Fine-tune deep learning models from user feedback, reducing recurring errors
- Ensure a sustainable exploitation of the SELMA platform
- Encourage active user involvement in the platform.
Achieving these aims requires advancing the state of the art in multiple technologies (transfer learning, language modelling, speech recognition, machine translation, summarization, speech synthesis, named entity linking, learning from user feedback), while building upon previous project results and existing services.
- AVIGNON UNIVERSITE
- LATVIJAS UNIVERSITATES MATEMATIKAS UN INFORMATIKAS INSTITUTS
- PRIBERAM INFORMATICA SA
- FRAUNHOFER GESELLSCHAFT ZUR FOERDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
Start date: 1 January 2021 - End date: 31 December 2023