There is now another way to improve AI performance without additional training.
Sakana AI had multiple different diffusion language models collaborate on a single answer, outperforming both individual models and existing methods on coding benchmarks.
The research began with the observation that the standard approach of increasing temperature to generate more diverse outputs does not work for diffusion models. Here is a breakdown of how they addressed that problem.
from choiopenai