Against: where the combination fails

The evidence that a person plus a model is not always better.

Shape: against

The meta-analysis

  • Vaccaro 2024 pooled 106 experiments and 370 effect sizes. Human-AI combinations did worse than the best of human or AI alone: Hedges' g of -0.23, confidence interval -0.39 to -0.07 (secondary, read in the abstract).
  • Decision tasks lost; content-creation tasks gained.
  • When the human beat the AI alone, the combination gained. When the AI beat the human alone, it lost.
  • The authors name possible publication bias and varied designs.

The jagged frontier

  • Dell'Acqua 2023: outside the model's reach, workers using it were 19 percentage points less likely to produce correct solutions (secondary; the paper's abstract gives the figure in points, not percent).

The paradox

  • Raisch 2021: augmentation cannot be separated from automation; stressing either one creates reinforcing cycles with bad outcomes.

What it does to the family

  • A rule that the person decides is not a guarantee of a better result.
  • A claim of a gain must compare human alone, model alone and the combination.
  • The task type matters: the family works on content creation, which is the side that gained.