The proposed ICLR social, "LLMs in the Public Sector," organized by GovTech Singapore, will commence with an insightful presentation highlighting key advancements and applications of Large Language Models (LLMs) across essential public sector domains, including Education, Healthcare, and Labour Markets. Following the presentation, participants will engage in a networking session designed to facilitate structured discussions on innovative use-cases, practical implementation experiences, and prevailing challenges. Emphasis will be placed on public sector use-cases, challenges in development and deployment, Responsible AI.