{"id":"VC0050","type":"paper","title":"Zero-shot evaluation reveals limitations of single-cell foundation models.","authors_or_org":"Kedzierska KZ, Crawford L, Amini AP, Lu AX.","date":"2025-04-18","year":"2025","venue":"Genome biology","url":"https://doi.org/10.1186/s13059-025-03574-x","doi":"10.1186/s13059-025-03574-x","pmid":"40251685","brain_tumor_focus":"no","tags":["benchmark","zero-shot","critique"],"tag_slugs":["benchmark","zero-shot","critique"],"tag_labels":["Benchmark & validation","Zero-shot","Critique"],"tag_labels_zh":["基准评测与验证","零样本","批评与反证"],"unmapped_tags":[],"one_line_summary_en":"Kedzierska et al.: zero-shot limitations of scGPT/Geneformer.","one_line_summary_zh":"Kedzierska等：零样本评估揭示单细胞基础模型局限。","verified":"yes","verification_source":"Europe PMC","page_url":"https://gliostate.com/library/VC0050/","api_url":"https://gliostate.com/api/items/VC0050.json","sameAs":["https://doi.org/10.1186/s13059-025-03574-x","https://pubmed.ncbi.nlm.nih.gov/40251685/"],"is_preprint":false,"facets":{"type":"https://gliostate.com/library/type/paper/","year":"https://gliostate.com/library/year/2025/","tags":["https://gliostate.com/library/tag/benchmark/","https://gliostate.com/library/tag/zero-shot/","https://gliostate.com/library/tag/critique/"]},"cited_by":[{"id":"cell-state-npc-opc-like","type":"cell_state","title_en":"Neural-progenitor-like (NPC-like) and OPC-like glioma cell states","title_zh":"神经前体样（NPC 样）与少突前体样（OPC 样）胶质瘤细胞状态","url":"https://gliostate.com/cell-states/neural-progenitor-like-opc-like/","api_url":"https://gliostate.com/api/topics/cell-state-npc-opc-like.json"},{"id":"model-virtual-cell","type":"model","title_en":"AI virtual cell models","title_zh":"AI 虚拟细胞模型","url":"https://gliostate.com/models/virtual-cell/","api_url":"https://gliostate.com/api/topics/model-virtual-cell.json"},{"id":"validation-benchmarks","type":"validation","title_en":"Validating virtual cells: benchmarks, baselines and critiques","title_zh":"虚拟细胞的验证：基准、基线与批评","url":"https://gliostate.com/validation/benchmarks-and-baselines/","api_url":"https://gliostate.com/api/topics/validation-benchmarks.json"},{"id":"validation-gbm-state-replication","type":"validation","title_en":"Do Neftel-style GBM state calls replicate across platforms? A GlioState re-analysis (draft)","title_zh":"Neftel 式 GBM 状态判定能否跨平台复现？GlioState 再分析（初稿）","url":"https://gliostate.com/validation/gbm-state-call-replication/","api_url":"https://gliostate.com/api/topics/validation-gbm-state-replication.json"}],"related":[{"id":"VC0058","title":"Virtual Cell Challenge 2026: Benchmarking zero-shot generalization across cellular contexts.","shared_tags":["benchmark","zero-shot"],"page_url":"https://gliostate.com/library/VC0058/","api_url":"https://gliostate.com/api/items/VC0058.json"},{"id":"VC0107","title":"Virtual Cell Challenge 2026 (zero-shot, 6 unseen cell lines)","shared_tags":["zero-shot"],"page_url":"https://gliostate.com/library/VC0107/","api_url":"https://gliostate.com/api/items/VC0107.json"},{"id":"VC0048","title":"Deep-learning-based gene perturbation effect prediction does not yet outperform simple linear baselines.","shared_tags":["benchmark","critique"],"page_url":"https://gliostate.com/library/VC0048/","api_url":"https://gliostate.com/api/items/VC0048.json"},{"id":"VC0049","title":"Benchmarking foundation cell models for post-perturbation RNA-seq prediction.","shared_tags":["benchmark","critique"],"page_url":"https://gliostate.com/library/VC0049/","api_url":"https://gliostate.com/api/items/VC0049.json"},{"id":"VC0078","title":"Biological domain shift and statistical nesting concerns in generative AI-based spatial tumor growth prediction for pediatric diffuse midline glioma.","shared_tags":["critique"],"page_url":"https://gliostate.com/library/VC0078/","api_url":"https://gliostate.com/api/items/VC0078.json"},{"id":"VC0056","title":"Systematic evaluation of single-cell foundation model interpretability: attention-derived edge scores add no incremental value over gene-level features for perturbation-target prediction.","shared_tags":["critique"],"page_url":"https://gliostate.com/library/VC0056/","api_url":"https://gliostate.com/api/items/VC0056.json"}]}