Social Value Alignment in Large Language Models
Giulio Antonio Abbo, Serena Marchesi, Agnieszka Wykowska and Tony BelpaemeTL;DR
Presented in October 2023, this is the first work on assessing value alignment of generative AI. Through a crowdsourced evaluation, we determined that the LLMs’ responses are as value-aligned as humans’ and they are often preferred. They are, however, biased towards Western values.
PUBLICATIONS IN THIS RESEARCH LINE
Values and Generative AI
Abstract
Large Language Models (LLMs) have demonstrated remarkable proficiency in text generation and display an apparent understanding of both physical and social aspects of the world. In this study, we look into the capabilities of LLMs to generate responses that align with human values. We focus on five prominent LLMs – GPT-3, GPT-4, PaLM-2, LLaMA-2 and BLOOM – and compare their generated responses with those provided by human participants. To evaluate the value alignment of LLMs, we presented domestic scenarios to the model and elicited a response with minimal prompting instructions. Human raters judged the responses on appropriateness and value alignment. The results revealed that GPT-3, 4 and PaLM-2 performed on par with human participants, displaying a notable level of value alignment in their generated responses. However, LLaMA-2 and BLOOM fell short in this aspect, indicating a possible divergence from human values. Furthermore, our findings indicate that the raters faced difficulty in distinguishing between responses generated by LLMs and those by humans, with raters exhibiting a preference for machine-generated responses in certain cases. These findings shed light on the capabilities of state-of-the-art LLMs to align with human values, but also allow us to speculate on whether these models could be value-aware. This research contributes to the ongoing exploration of LLMs’ understanding of ethical considerations and provides insights into their potential for engaging in value-driven interactions.
ACM Reference
Giulio Antonio Abbo, Serena Marchesi, Agnieszka Wykowska, and Tony Belpaeme. 2024. Social Value Alignment in Large Language Models. In Value Engineering in Artificial Intelligence (VALE '23), Springer Nature Switzerland, Cham, 83–97.BibTeX
@InProceedings{10.1007/978-3-031-58202-8_6,
author="Abbo, Giulio Antonio
and Marchesi, Serena
and Wykowska, Agnieszka
and Belpaeme, Tony",
editor="Osman, Nardine
and Steels, Luc",
title="Social Value Alignment in Large Language Models",
booktitle="Value Engineering in Artificial Intelligence",
year="2024",
publisher="Springer Nature Switzerland",
address="Cham",
pages="83--97",
abstract="Large Language Models (LLMs) have demonstrated remarkable proficiency in text generation and display an apparent understanding of both physical and social aspects of the world. In this study, we look into the capabilities of LLMs to generate responses that align with human values. We focus on five prominent LLMs -- GPT-3, GPT-4, PaLM-2, LLaMA-2 and BLOOM -- and compare their generated responses with those provided by human participants. To evaluate the value alignment of LLMs, we presented domestic scenarios to the model and elicited a response with minimal prompting instructions. Human raters judged the responses on appropriateness and value alignment. The results revealed that GPT-3, 4 and PaLM-2 performed on par with human participants, displaying a notable level of value alignment in their generated responses. However, LLaMA-2 and BLOOM fell short in this aspect, indicating a possible divergence from human values. Furthermore, our findings indicate that the raters faced difficulty in distinguishing between responses generated by LLMs and those by humans, with raters exhibiting a preference for machine-generated responses in certain cases. These findings shed light on the capabilities of state-of-the-art LLMs to align with human values, but also allow us to speculate on whether these models could be value-aware. This research contributes to the ongoing exploration of LLMs' understanding of ethical considerations and provides insights into their potential for engaging in value-driven interactions.",
isbn="978-3-031-58202-8"
}