El caso por la experiencia vertical en el entrenamiento de IA
Los anotadores generalistas tienen un límite. Abogamos por una división más clara: especialistas en la materia para el contenido, lingüistas para el tono, revisores calibrados para ambos.
Escrito por
Alex Voss
Network Strategy
The industry's default annotation worker is a generalist. Smart, attentive, willing to follow a rubric. That worker has a ceiling, and frontier models have already hit it on the questions that matter most. The next decade of training data is going to come from people who are deep before they are broad.
What the generalist cannot do
A generalist can apply a rubric. A generalist cannot, in any reasonable amount of time, build the rubric for a domain they do not understand. They cannot recognise the moment the model is being technically correct and clinically wrong. They cannot tell when an answer is sophisticated nonsense, because the sophisticated nonsense is in their out-of-distribution.
This is not a critique of generalists. It is a description of where the boundary of their useful contribution sits, and an argument for staffing past it.
The vertical division of labour
We staff frontier projects in three layers: subject-matter specialists for substance, calibrated linguists for tone and clarity, and senior reviewers who arbitrate when the first two disagree. Each layer has a different rate, a different rubric, and a different success metric.
“Hire for depth where the question is hard. Hire for breadth where the question is fluency.”
- Substance: oncologist, contracts attorney, distributed-systems engineer, working in their own domain.
- Tone: editorially trained writers who do not have to understand the medicine to know that a sentence is wrong.
- Calibration: senior arbiters with rubric-design responsibility and a published track record on both sides.
The strategic claim
If you believe the next jump in model quality comes from the hard cases — and we do — then your annotation pool has to look more like a hospital consultancy list than a clickworker bench. That is not a marketing line. It is what the work has actually become.
Network Strategy
Alex Voss
Alex shapes who joins the Lona network, which domains we open next, and which we leave alone.
Más de la red sobre las mismas cuestiones.
Datos de entrenamiento y la brecha de juicio
Por qué el próximo salto en la calidad del modelo no vendrá de más tokens, sino de más desacuerdo — y cómo obtener el tipo correcto de desacuerdo de los expertos.
Pagar a los expertos de forma justa es más difícil de lo que parece
Un desglose de cómo establecemos tarifas: señales del mercado, intereses del proyecto, multiplicadores de nivel y las decisiones deliberadas que tomamos para evitar dinámicas de carrera hacia el fondo.
¿Tienes algo que decir?
Propón un ensayo
Se aceptan publicaciones de invitados de expertos de Lona y profesionales serios.