Big data analysis can be greatly facilitated if decentralized/distributed DNN architectures are employed. This lecture presents a novel Learning-by-Education Multi-Agent framework (LEMA) that facilitates communication and knowledge exchange among diverse Deep Neural Networks (DNN) agents, undertaking the role of a student or teacher DNN by offering or absorbing knowledge respectively. The framework enables efficient and effective knowledge transfer among participating DNN agents while enhancing their learning capabilities and fostering their collaboration among diverse networks. The proposed framework addresses the challenges of handling diverse training data distributions and the limitations of individual DNN agent learning abilities. The LEMA framework ensures the exploitation of the best available teacher knowledge upon learning a new task and protects the DNN agents from catastrophic forgetting. The experiments demonstrate the LEMA framework functionalities on multiple teacher-student learning techniques and their integration with lifelong learning. Our experiments manifest the LEMA framework’s ability to maximize the accuracy of all participating DNN agents in classification tasks by leveraging the collaborative knowledge of the framework. The LEMA framework also addresses the problem of task-agnostic lifelong learning as DNN agents have no information on task boundaries.
Prof. Ioannis Pitas (IEEE fellow, IEEE Distinguished Lecturer, EURASIP fellow) received the Diploma and PhD degree in Electrical Engineering, both from the Aristotle University of Thessaloniki (AUTH), Greece. Since 1994, he has been a Professor at the Department of Informatics of AUTH and Director of the Artificial Intelligence and Information Analysis (AIIA) lab. He served as a Visiting Professor at several Universities.
His current interests are in the areas of computer vision, machine learning, autonomous systems, intelligent digital media, image/video processing, human-centred computing, affective computing, 3D imaging and biomedical imaging. He has published over 970 papers, contributed to 46 books in his areas of interest and edited or (co-)authored another 15 books. He has also been member of the program committee of many scientific conferences and workshops. In the past he served as Associate Editor or co-Editor of 23 international journals and General or Technical Chair of 5 international conferences. He delivered 129 keynote/invited speeches worldwide. He co-organized 38 conferences and participated in technical committees of 291 conferences. He participated in 75+ R&D projects, primarily funded by the European Union and is/was principal investigator in 47 such projects. He is the coordinator of the Horizon Europe R&D project TEMA ( https://tema-project.eu/) , AUTH principal investigator in H2020 R&D projects AI4Media (https://www.ai4media.eu/ one of the 4 H2020 ICT48 AI flagship projects) and Horizon Europe R&D projects AI4Europe (https://www.egi.eu/project/ai4europe/), SIMAR (https://simar-project.eu/). He is chair of the International AI Doctoral Academy (AIDA) (https://www.i-aida.org/). He was chair and initiator of the IEEE Autonomous Systems Initiative (https://ieeeasi.signalprocessingsociety.org/). He has 37300+ citations to his work and h-index 92+.