Processing math: 100%
Skip to yearly menu bar Skip to main content


Poster

CtD: Composition through Decomposition in Emergent Communication

Boaz Carmeli · Ron Meir · Yonatan Belinkov

Hall 3 + Hall 2B #325
[ ]
Thu 24 Apr midnight PDT — 2:30 a.m. PDT

Abstract:

Compositionality is a cognitive mechanism that allows humans to systematically combine known concepts in novel ways.This study demonstrates how artificial neural agents acquire and utilize compositional generalization to describe previously unseen images.Our method, termed Composition through Decomposition'', involves two sequential training steps.In the \'Decompose\' step, the agents learn to decompose an image into basic concepts using a codebook acquired during interaction in a multi-target coordination game.Subsequently, in the Composestep,theantsemploythiscodebkdescribenovelimasbycomposingbasicconceptsocompxphrases.Remarkably,weobservecaseswhereralizationtheCompose' step is achieved zero-shot, without the need for additional training.

Live content is unavailable. Log in and register to view live content