idler Corpus / Vol.01 / 1.5.4

An eval is a learning material.

Each environment is a block, sized by pass@k, coloured by domain. Read the magnitude before the label. The model is the student; the block is what it grasps or drops.

Idler Inc. / San Francisco idler.ai