File size: 8,508 Bytes
b7fab27
 
 
 
 
 
 
0cb1a9f
 
b7fab27
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
e71851a
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
b7fab27
 
 
 
 
 
 
 
 
e71851a
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
b7fab27
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
---
library_name: popV
license: cc-by-4.0
tags:
- biology
- genomics
- single-cell
- anndata_version:0.11.3
- python_version:3.11.11
- popV
- 'tissue: Thymus'
---

Popular Vote (popV) model for automated cell type annotation of single-cell RNA-seq data. We provide here pretrained models
for plug-in use in your own analysis.
Follow our [tutorial](https://github.com/YosefLab/popV/blob/main/tabula_sapiens_tutorial.ipynb) to learn how to use the model for cell type annotation.

# Model description

Tabula Sapiens is a benchmark, first-draft human cell atlas of over 1.1M cells from 28 organs of 24 normal human subjects. This work is the product of the Tabula Sapiens Consortium. Taking the organs from the same individual controls for genetic background, age, environment, and epigenetic effects, and allows detailed analysis and comparison of cell types that are shared between tissues.

**Link to CELLxGENE**:
Link to the [data](https://cellxgene.cziscience.com/e/0ced5e76-6040-47ff-8a72-93847965afc0.cxg/) in the CELLxGENE browser for interactive exploration of the data and download of the source data.

**Training Code URL**:
Not provided by uploader.

# Metrics

We provide here accuracies for each of the experts and the ensemble model. The validation set accuracies are
computed on a 10% random subset of the data that was not used for training.

| Cell Type | N cells |  celltypist |  knn bbknn |  knn harmony |  knn on scvi |  onclass |  scanvi |  svm |  xgboost | Consensus Prediction |
| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
| CD4-positive, alpha-beta T cell | 748 | 0.76 | 0.85 | 0.85 | 0.72 | 0.00 | 0.77 | 0.71 | 0.79 | 0.85 |
| CD4-positive, alpha-beta thymocyte | 447 | 0.70 | 0.52 | 0.76 | 0.63 | 0.00 | 0.60 | 0.61 | 0.70 | 0.74 |
| B cell | 450 | 1.00 | 0.99 | 0.99 | 1.00 | 0.00 | 1.00 | 1.00 | 1.00 | 1.00 |
| thymic fibroblast type 2 | 378 | 0.84 | 0.88 | 0.89 | 0.82 | 0.00 | 0.91 | 0.89 | 0.89 | 0.92 |
| thymic fibroblast type 1 | 346 | 0.85 | 0.86 | 0.89 | 0.82 | 0.00 | 0.90 | 0.88 | 0.88 | 0.91 |
| CD8-positive, alpha-beta T cell | 275 | 0.79 | 0.86 | 0.86 | 0.82 | 0.00 | 0.86 | 0.79 | 0.86 | 0.87 |
| capillary endothelial cell | 270 | 0.79 | 0.84 | 0.90 | 0.79 | 0.00 | 0.83 | 0.83 | 0.82 | 0.86 |
| naive thymus-derived CD4-positive, alpha-beta T cell | 259 | 0.48 | 0.44 | 0.51 | 0.31 | 0.00 | 0.49 | 0.35 | 0.51 | 0.54 |
| smooth muscle cell | 228 | 0.98 | 0.97 | 0.97 | 0.98 | 0.00 | 0.99 | 0.98 | 0.98 | 0.99 |
| vein endothelial cell | 213 | 0.82 | 0.82 | 0.90 | 0.77 | 0.00 | 0.84 | 0.84 | 0.84 | 0.87 |
| plasma cell | 136 | 1.00 | 0.98 | 0.99 | 0.99 | 0.00 | 1.00 | 0.99 | 0.99 | 0.99 |
| endothelial cell of artery | 85 | 0.90 | 0.94 | 0.91 | 0.69 | 0.00 | 0.85 | 0.89 | 0.90 | 0.92 |
| macrophage | 86 | 0.98 | 0.98 | 0.97 | 0.98 | 0.00 | 0.98 | 0.99 | 1.00 | 0.99 |
| CD8-positive, alpha-beta thymocyte | 71 | 0.68 | 0.78 | 0.85 | 0.52 | 0.00 | 0.72 | 0.67 | 0.73 | 0.82 |
| thymocyte | 45 | 0.63 | 0.71 | 0.83 | 0.36 | 0.00 | 0.78 | 0.67 | 0.80 | 0.79 |
| naive thymus-derived CD8-positive, alpha-beta T cell | 34 | 0.46 | 0.53 | 0.63 | 0.14 | 0.00 | 0.50 | 0.52 | 0.57 | 0.72 |
| natural killer cell | 46 | 0.89 | 0.97 | 0.93 | 0.92 | 0.00 | 0.90 | 0.94 | 0.94 | 0.98 |
| endothelial cell of lymphatic vessel | 35 | 1.00 | 1.00 | 0.99 | 0.96 | 0.00 | 0.95 | 1.00 | 1.00 | 1.00 |
| fibroblast | 23 | 0.46 | 0.22 | 0.18 | 0.77 | 0.00 | 0.73 | 0.79 | 0.75 | 0.84 |
| vascular associated smooth muscle cell | 12 | 0.67 | 0.00 | 0.27 | 0.74 | 0.00 | 0.83 | 0.92 | 0.89 | 0.91 |
| mesothelial cell | 16 | 0.93 | 0.93 | 0.97 | 0.88 | 0.00 | 0.91 | 0.94 | 0.88 | 0.97 |
| erythrocyte | 18 | 0.91 | 1.00 | 0.91 | 0.94 | 0.00 | 0.94 | 0.97 | 0.97 | 0.97 |
| neuro-medullary thymic epithelial cell | 14 | 0.96 | 0.96 | 0.92 | 0.96 | 0.00 | 0.93 | 1.00 | 0.96 | 1.00 |
| neutrophil | 12 | 0.74 | 0.79 | 0.92 | 0.92 | 0.00 | 0.92 | 0.92 | 0.83 | 0.88 |
| hematopoietic precursor cell | 10 | 0.80 | 0.18 | 0.95 | 0.90 | 0.00 | 0.90 | 0.89 | 0.82 | 0.84 |
| myo-medullary thymic epithelial cell | 5 | 0.91 | 0.91 | 0.89 | 0.91 | 0.00 | 0.91 | 0.91 | 0.91 | 0.91 |
| medullary thymic epithelial cell | 7 | 1.00 | 0.83 | 0.92 | 0.62 | 0.00 | 0.88 | 0.92 | 1.00 | 1.00 |
| monocyte | 2 | 0.00 | 0.00 | 0.80 | 0.00 | 0.00 | 0.67 | 0.67 | 1.00 | 0.67 |
| mast cell | 2 | 1.00 | 1.00 | 0.67 | 0.00 | 0.00 | 0.40 | 1.00 | 1.00 | 1.00 |
| fast muscle cell | 0 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 |
| T follicular helper cell | 0 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 |
| innate lymphoid cell | 0 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 |
| endothelial cell | 0 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 |

The train accuracies are computed on the training data.

| Cell Type | N cells |  celltypist |  knn bbknn |  knn harmony |  knn on scvi |  onclass |  scanvi |  svm |  xgboost | Consensus Prediction |
| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
| CD4-positive, alpha-beta T cell | 6378 | 0.75 | 0.81 | 0.89 | 0.79 | 0.00 | 0.78 | 0.74 | 0.78 | 0.86 |
| CD4-positive, alpha-beta thymocyte | 4116 | 0.72 | 0.44 | 0.85 | 0.78 | 0.00 | 0.74 | 0.69 | 0.75 | 0.81 |
| B cell | 4012 | 1.00 | 0.99 | 1.00 | 1.00 | 0.00 | 1.00 | 1.00 | 1.00 | 1.00 |
| thymic fibroblast type 2 | 3827 | 0.88 | 0.90 | 0.94 | 0.90 | 0.00 | 0.93 | 0.92 | 0.92 | 0.95 |
| thymic fibroblast type 1 | 2924 | 0.86 | 0.86 | 0.93 | 0.87 | 0.00 | 0.91 | 0.90 | 0.90 | 0.93 |
| CD8-positive, alpha-beta T cell | 2542 | 0.79 | 0.84 | 0.90 | 0.85 | 0.00 | 0.82 | 0.82 | 0.84 | 0.87 |
| capillary endothelial cell | 2351 | 0.79 | 0.85 | 0.94 | 0.87 | 0.00 | 0.88 | 0.89 | 0.88 | 0.91 |
| naive thymus-derived CD4-positive, alpha-beta T cell | 2264 | 0.48 | 0.41 | 0.67 | 0.55 | 0.00 | 0.55 | 0.50 | 0.55 | 0.64 |
| smooth muscle cell | 1997 | 0.96 | 0.94 | 0.99 | 0.98 | 0.00 | 0.99 | 0.99 | 0.99 | 0.99 |
| vein endothelial cell | 1835 | 0.82 | 0.82 | 0.93 | 0.83 | 0.00 | 0.87 | 0.89 | 0.88 | 0.91 |
| plasma cell | 1442 | 0.99 | 0.99 | 0.99 | 1.00 | 0.00 | 1.00 | 1.00 | 1.00 | 1.00 |
| endothelial cell of artery | 688 | 0.89 | 0.92 | 0.96 | 0.78 | 0.00 | 0.93 | 0.94 | 0.94 | 0.96 |
| macrophage | 684 | 0.98 | 0.98 | 0.99 | 0.97 | 0.00 | 0.98 | 1.00 | 1.00 | 0.99 |
| CD8-positive, alpha-beta thymocyte | 601 | 0.64 | 0.70 | 0.82 | 0.63 | 0.00 | 0.78 | 0.79 | 0.82 | 0.86 |
| thymocyte | 410 | 0.66 | 0.67 | 0.83 | 0.49 | 0.00 | 0.84 | 0.81 | 0.88 | 0.92 |
| naive thymus-derived CD8-positive, alpha-beta T cell | 400 | 0.46 | 0.45 | 0.73 | 0.18 | 0.00 | 0.69 | 0.66 | 0.75 | 0.77 |
| natural killer cell | 382 | 0.86 | 0.90 | 0.93 | 0.90 | 0.00 | 0.91 | 0.96 | 0.96 | 0.96 |
| endothelial cell of lymphatic vessel | 336 | 0.97 | 0.97 | 0.98 | 0.93 | 0.00 | 0.95 | 0.99 | 0.97 | 0.99 |
| fibroblast | 249 | 0.65 | 0.07 | 0.96 | 0.89 | 0.00 | 0.97 | 0.89 | 0.91 | 0.96 |
| vascular associated smooth muscle cell | 229 | 0.69 | 0.03 | 0.96 | 0.86 | 0.00 | 0.97 | 0.97 | 0.95 | 0.98 |
| mesothelial cell | 159 | 0.94 | 0.90 | 0.96 | 0.93 | 0.00 | 0.98 | 0.97 | 0.97 | 0.98 |
| erythrocyte | 134 | 0.94 | 0.91 | 0.93 | 0.95 | 0.00 | 0.97 | 0.98 | 0.94 | 0.98 |
| neuro-medullary thymic epithelial cell | 121 | 0.92 | 0.91 | 0.90 | 0.90 | 0.00 | 0.98 | 1.00 | 0.98 | 0.98 |
| neutrophil | 109 | 0.61 | 0.73 | 0.90 | 0.85 | 0.00 | 0.97 | 1.00 | 1.00 | 1.00 |
| hematopoietic precursor cell | 82 | 0.74 | 0.07 | 0.89 | 0.87 | 0.00 | 0.97 | 1.00 | 0.99 | 0.99 |
| myo-medullary thymic epithelial cell | 72 | 0.85 | 0.87 | 0.96 | 0.95 | 0.00 | 0.98 | 0.99 | 0.99 | 0.97 |
| medullary thymic epithelial cell | 36 | 0.83 | 0.62 | 0.87 | 0.67 | 0.00 | 0.96 | 1.00 | 1.00 | 0.96 |
| monocyte | 24 | 0.00 | 0.00 | 0.82 | 0.42 | 0.00 | 0.84 | 1.00 | 0.98 | 0.93 |
| mast cell | 22 | 0.88 | 0.77 | 0.87 | 0.71 | 0.00 | 0.78 | 0.96 | 1.00 | 1.00 |
| fast muscle cell | 21 | 0.00 | 0.28 | 0.98 | 0.85 | 0.00 | 0.98 | 1.00 | 1.00 | 0.98 |
| T follicular helper cell | 6 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.33 | 0.86 | 0.75 | 0.83 |
| innate lymphoid cell | 2 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.80 | 0.50 | 1.00 | 1.00 |
| endothelial cell | 1 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 1.00 | 0.67 | 1.00 | 1.00 |

</details>


# References

Tabula Sapiens reveals transcription factor expression, senescence effects, and sex-specific features in cell types from 28 human organs and tissues, The Tabula Sapiens Consortium; bioRxiv, doi: https://doi.org/10.1101/2024.12.03.626516