Artificial Intelligence (AI) influences every facet of human life, from professional environments to daily routines and interpersonal relationships. While technology aims to fulfill desires and enable new capabilities, questions are raised about whether human agency is truly enhanced in a world shaped by these technologies across social, economic, and political dimensions In this social event, we will engage in a discourse on the impact of autonomous AI on human agency and explore solutions to potential challenges. Our discussion will focus on how to socio-technically prioritize human agency as a central criterion in AI development, aiming for positive outcomes in AI alignment and safety.