An exciting application area of machine learning and deep learning methods is completion, repair, synthesis, and automatic explanation of program code. This field has received a fair amount of attention in the last decade, yet arguably the recent application of large scale language modelling techniques to the domain of code holds a tremendous promise to completely revolutionize this area. The new large pretrained models excel at completing code and synthesizing code from natural language descriptions; they work across a wide range of domains, tasks, and programming languages. The excitement about new possibilities is spurring tremendous interest in both industry and academia. Yet, we are just beginning to explore the potential of large-scale deep learning for code, and state-of-the-art models still struggle with correctness and generalization. This calls for platforms to exchange ideas and discuss the challenges in this line of work. Deep Learning for Code (DL4C) is a workshop that will provide a platform for researchers to share their work on deep learning for code.DL4C welcomes researchers interested in a number of topics, including but not limited to: AI code assistants, representations and model architectures for code, pretraining methods, methods for producing code from natural language, static code analysis and evaluation of deep learning for code techniques.
| Opening Remarks (Announcement) | |
| Deep Learning Models for Bug Detection and Repair (Invited Talk) | |
| Learning to Program by Learning to Read (Invited Talk) | |
| Coffee Break (Break) | |
| Learning to Superoptimize Real-World Programs (Best Paper Spotlight) | |
| CodeBPE: Investigating Subtokenization Options for Large Language Model Pretraining on Source Code (Spotlight) | |
| NS3: Neuro-Symbolic Semantic Code Search (Spotlight) | |
| In-IDE Code Generation from Natural Language: Promise and Challenges (Invited Talk) | |
| Competitive Programming with AlphaCode (Invited Talk) | |
| Lunch Break (Break) | |
| Panel Discussion (Discussion Panel) | |
| NS3: Neuro-Symbolic Semantic Code Search (Poster) | |
| Learning to Superoptimize Real-World Programs (Poster) | |
| Generating Programming Puzzles to Train Language Models (Poster) | |
| Code Editing from Few Exemplars by Adaptive Multi-Extent Composition (Poster) | |
| ReGVD: Revisiting Graph Neural Networks for Vulnerability Detection (Poster) | |
| Show Your Work: Scratchpads for Intermediate Computation with Language Models (Poster) | |
| CodeBPE: Investigating Subtokenization Options for Large Language Model Pretraining on Source Code (Poster) | |
| On-the-fly Discovery of Local Bugs using Inconsistency Analysis (Poster) | |
| Neural Instruction Combiner (Poster) | |
| COBRA: Enhancing DNN Latency Prediction with Language Models trained on Source Code (Poster) | |
| Code Summarization: Do Transformers Really Understand Code? (Poster) | |
| Patch Generation with Language Models: Feasibility and Scaling Behavior (Poster) | |
| Compositional Generalization and Decomposition in Neural Program Synthesis (Poster) | |
| Learning to Walk over Relational Graphs of Source Code (Poster) | |
| Scotch: A Semantic Code Search Engine for IDEs (Poster) | |
| Fix Bugs with Transformer through a Neural-Symbolic Edit Grammar (Poster) | |
| A Systematic Evaluation of Large Language Models of Code (Poster) | |
| Static Prediction of Runtime Errors by Learning to Execute Programs with External Resource Descriptions (Poster) | |
| Coffee Break (Break) | |
| Where generative models meet search: a brief history of recent advancements in neural program synthesis. (Invited Talk) | |
| Learning to Model Structures and Execution for Program Synthesis (Invited Talk) | |
| Closing Remarks (Announcement) | |