Is Programming by Example solved by LLMs?

Large Language Models (LLMs) show promise in solving Programming-by-Examples (PBE) tasks but require fine-tuning for better performance, especially for out-of-distribution problems.