Update README.md
Browse files
README.md
CHANGED
@@ -11,4 +11,41 @@ elements in a sequence at a single nucleotide resolution. It was trained on 14 d
|
|
11 |
tissue-specific promoters and enhancers, and CTCF-bound sites) elements.
|
12 |
|
13 |
|
14 |
-
**Developed by:** [InstaDeep](https://huggingface.co/InstaDeepAI)
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
11 |
tissue-specific promoters and enhancers, and CTCF-bound sites) elements.
|
12 |
|
13 |
|
14 |
+
**Developed by:** [InstaDeep](https://huggingface.co/InstaDeepAI)
|
15 |
+
|
16 |
+
### How to use
|
17 |
+
|
18 |
+
To Be Done
|
19 |
+
|
20 |
+
|
21 |
+
|
22 |
+
## Training data
|
23 |
+
|
24 |
+
The **SegmentBorzoi** model was trained on all human chromosomes except for chromosomes 20 and 21, kept as test set, and chromosome 22, used as a validation set.
|
25 |
+
During training, sequences are randomly sampled in the genome with associated annotations. However, we keep the sequences in the validation and test set fixed by
|
26 |
+
using a sliding window of length 524kb (original borzoi input length) over the chromosomes 20 and 21. The validation set was used to monitor training and for early stopping.
|
27 |
+
|
28 |
+
## Training procedure
|
29 |
+
|
30 |
+
### Preprocessing
|
31 |
+
|
32 |
+
The DNA sequences are tokenized using one-hot encoding similar to the Enformer model
|
33 |
+
|
34 |
+
### Architecture
|
35 |
+
|
36 |
+
The model is composed of the Borzoi backbone, from which we remove the heads and replaced it by a 1-dimensional U-Net segmentation head made of 2 downsampling convolutional blocks and 2 upsampling convolutional blocks. Each of these
|
37 |
+
blocks is made of 2 convolutional layers with 1, 024 and 2, 048 kernels respectively.
|
38 |
+
|
39 |
+
### BibTeX entry and citation info
|
40 |
+
|
41 |
+
```bibtex
|
42 |
+
@article{de2024segmentnt,
|
43 |
+
title={SegmentNT: annotating the genome at single-nucleotide resolution with DNA foundation models},
|
44 |
+
author={de Almeida, Bernardo P and Dalla-Torre, Hugo and Richard, Guillaume and Blum, Christopher and Hexemer, Lorenz and Gelard, Maxence and Pandey, Priyanka and Laurent, Stefan and Laterre, Alexandre and Lang, Maren and others},
|
45 |
+
journal={bioRxiv},
|
46 |
+
pages={2024--03},
|
47 |
+
year={2024},
|
48 |
+
publisher={Cold Spring Harbor Laboratory}
|
49 |
+
}
|
50 |
+
|
51 |
+
```
|