Large Language Models are All You Need?

Tuesday 14th March 2023 17:00 – 18:00 CET


Prof. Giuseppe Attardi online


LLMs are part of three major scientific breakthroughs in just 10 years of Deep Learning applied to NLP: word embeddings, transformers with attention and prompt tuning. LLMs have shown surprising effectiveness in all tasks and have been adopted even in cross-cutting creative tasks such as the generation of images, code or music from textual descriptions. They seem to exhibit abilities which go beyond the tasks on which they were trained. Emergent abilities arise with scaling and are a phenomenon still subject to investigation. LLMs also raised concerns, since the release of GPT-2, the withdrawal of Galactica or the unexpected success of ChatGPT. We will discuss their benefits, their limitations and how they will evolve. In particular, if the resources to build them will continue to grow, this might lead to a discrimination between groups of researchers and solutions to avoid this must be considered.


Giuseppe Attardi is a retired professor of Computer Science at the University of Pisa. He also worked at MIT’s AI Lab, Sony Paris Research Laboratory, ICSI in Berkeley and Yahoo Research Barcelona. He developed Omega, a description logic; CMM, the garbage collector used in Java and DeSR, a neural dependency parser. He participated in the development of Arianna, the first Italian search engine and introduced the technique of categorisation by context for web pages. He is the founder or partner of a few startups, in Italy and Spain. He contributed to building the fiber optic networks of the University of Pisa and of GARR. He led a national campaign to facilitate and disseminate Internet access. He led the development of the GARR cloud platform. He contributed to the drafting of the Italian strategy on Artificial Intelligence and the birth of the first national PhD in Artificial Intelligence.


ZOOM & Password: 148148



More events

Cookie Settings

A AIDA - AI Doctoral Academy may use cookies to remember your login data, collect statistics to optimize the functionality of the site and to perform marketing actions based on your interests.

These cookies are necessary to allow the main functionality of the website and are automatically activated when you use this website.
These cookies allow us to analyze the use of the website, so that we can measure and improve its performance.
Allow you to stay in touch with your social network, share content, send and post comments.

Required Cookies They allow you to personalize the commercial offers that are presented to you, directing them to your interests. They can be own or third party cookies. We warn you that, even if you do not accept these cookies, you will receive commercial offers, but without meeting your preferences.

Functional Cookies They offer a more personalized and complete experience, allow you to save preferences, show you content relevant to your taste and send you the alerts you have requested.

Advertising Cookies Allow you to stay in touch with your social network, share content, send and post comments.