|
|
--- |
|
|
license: apache-2.0 |
|
|
metrics: |
|
|
- accuracy |
|
|
pipeline_tag: zero-shot-classification |
|
|
tags: |
|
|
- chemistry |
|
|
- art |
|
|
- medical |
|
|
--- |
|
|
|
|
|
# Pentachora Encoder Notebook 1 of 5; Advanced Greyscale Encoder - Simpler Pentachoron Constellation |
|
|
|
|
|
This variation was a bit hit or miss, but showed high promise and fair accuracy for earlier trains. |
|
|
|
|
|
The outcomes and train results speak for themselves and the notebook is included. |
|
|
|
|
|
The encoder is a bit lackluster - the attention is hit or miss and causes disruptions to the high learn rate crystalization process. The outcomes show potential promise and the speed isn't quite up to the standards I was hoping for - so I began again from this point and shrank the encoder while advancing the pentachoron structure for the next notebook. |
|
|
|
|
|
The geometry for this one is fickle so high attention often causes overfitting early, which is why the latest version does not use multihead attention in the encoder. |
|
|
|
