Zero-shot evaluation
Also known as: zero-shot evaluation · zero-shot
Evaluating pretrained models without task-specific fine-tuning. Kedzierska et al. report limitations of scGPT and Geneformer in this setting, and the Virtual Cell Challenge 2026 benchmarks zero-shot generalisation across cellular contexts. VC0050 VC0058
Review pending Version 0.1.0 · status: draft · last expert review: not yet reviewed
Relations
| Subject | Relation | Object | Confidence | Evidence (role) |
|---|---|---|---|---|
| scGPT | benchmarked on | Zero-shot evaluation | high | VC0050 benchmark Zero-shot limitations reported. |
| Geneformer | benchmarked on | Zero-shot evaluation | high | VC0050 benchmark Zero-shot limitations reported. |
Appears in research topics
- AI virtual cell models (Models)
- Validating virtual cells: benchmarks, baselines and critiques (Validation)
Appears in library items (4)
Items whose title, tags or one-line summary match this entity (derived from the data), plus the items cited as evidence for the description.
- VC0058 Virtual Cell Challenge 2026: Benchmarking zero-shot generalization across cellular contexts. — Arc Virtual Cell Initiative Team, Goodarzi H., Cell, 2026
- VC0107 Virtual Cell Challenge 2026 (zero-shot, 6 unseen cell lines) — Arc Institute, virtualcellchallenge.org, 2026
- VC0050 Zero-shot evaluation reveals limitations of single-cell foundation models. — Kedzierska KZ, Crawford L, Amini AP, Lu AX., Genome biology, 2025
- VC0012 · preprint Universal Cell Embeddings: A Foundation Model for Cell Biology — Rosen Y, Roohani Y, Agrawal A, Samotorcan L, Tabula Sapiens Consortium, Quake SR, Quake SR, Leskovec J., bioRxiv, 2023
For research and education only. Not medical advice and not a recommendation of any diagnosis, treatment or product. Patients should consult their own physicians.