We use few-shot learning to train transformer-based models to predict the experimental measurements of the effects of single point mutations. Using sequence-based inputs, we supervise the pre-training of our models to predict ~150,000 normalized measurements derived from various experiments (MAVE data). The pre-training is done on proteins distinct from the one under evaluation. The inputs include embeddings from a protein foundation model, sequence conservation features, and protein stability features. After pre-training, for each experiment, we rely on 2\%-5\% randomly sampled values in the tested protein to estimate the normalization transform and to fine-tune the model for that experiment. We transform the normalized predictions of the fine-tuned model of all the single point mutations using the inverse of the estimated normalization transform, thus predicting the experimental values, and compare their Mean Absolute Error (MAE) to the true experimental values. We compare the accuracy of predictions in different settings, including ablation to study the contributions of the different inputs.