Lod34 commited on
Commit
96fb909
·
verified ·
1 Parent(s): b4d3962

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +62 -3
README.md CHANGED
@@ -1,3 +1,62 @@
1
- ---
2
- license: mit
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - en
4
+ tags:
5
+ - sprite-generation
6
+ - pixel-art
7
+ - animation
8
+ - text-to-image
9
+ - pytorch
10
+ - residual-blocks
11
+ - self-attention
12
+ - game-assets
13
+ - v3
14
+ license: mit
15
+ datasets:
16
+ - pawkanarek/spraix_1024
17
+ library_name: pytorch
18
+ pipeline_tag: text-to-image
19
+ base_model: t5-base
20
+ ---
21
+ # 🎨 Animator2D
22
+
23
+ Animator2D is an AI-powered model designed to generate pixel-art sprite animations from textual descriptions. This model leverages a BERT-based text encoder to extract textual features and a convolutional generative network to create animated sprites. The goal is to provide game developers and artists with a tool that can bring character concepts to life with minimal effort.
24
+
25
+ ## 🛠️ Model Overview
26
+
27
+ - **Name:** Animator2D
28
+ - **Input:**
29
+ - Character description
30
+ - Number of animation frames
31
+ - Character action
32
+ - Viewing direction
33
+ - **Output:** Animated sprite sheet in image format
34
+
35
+ ## 📦 Dataset
36
+
37
+ The model was trained using the [spraix\_1024](https://huggingface.co/datasets/pawkanarek/spraix_1024) dataset, which contains animated sprites with detailed textual descriptions. This dataset serves as a foundation for training the model to generate high-quality, relevant sprites based on textual inputs.
38
+
39
+ ## 🚀 Model Versions
40
+
41
+ Over time, several iterations of Animator2D have been developed, each improving on the previous version with different training strategies and hyperparameters. Below is a chronological overview of the versions created so far:
42
+
43
+ | Model Version | Description |
44
+ |----------------------|-------------|
45
+ | **Animator2D-v1** | The first full version developed in this project, utilizing a structured training approach with BERT for text encoding and a convolutional generator for sprite creation. |
46
+ | **Animator2D-mini-10e** | A simplified version trained with only 10 epochs, batch size of 8, learning rate of 1e-4, and image size of 64x64. |
47
+ | **Animator2D-mini-100e** | An extension of the mini-10e version, trained for 100 epochs for improved performance. |
48
+ | **Animator2D-mini-250e** | A more refined version with 250 epochs, batch size increased to 16, learning rate of 2e-4, and image resolution of 128x128. |
49
+ | **Animator2D-v2 (In Development)** | A new version being built from scratch with an entirely redesigned training process, aiming for better animation quality and efficiency. |
50
+
51
+ ## 🔮 Future Goals
52
+
53
+ This is just the first iteration of Animator2D. Future updates will focus on refining and expanding its capabilities:
54
+
55
+ - **Multiple Output Formats**: Currently, the model generates a single sprite sheet. Future updates will enable exporting animations in various formats, including folders with individual frames, GIFs, and videos.
56
+ - **Frame Input Optimization**: The number of frames is currently manually defined. Improvements will include a more intuitive system that considers FPS and actual animation duration.
57
+ - **Model Refinement**: The current model is in an early stage. Future improvements will enhance sprite generation consistency and quality by optimizing the architecture and training dataset.
58
+ - **Sprite Size Customization**: A new input will allow users to specify the character height in pixels, dynamically adjusting the sprite’s artistic style. This will ensure greater flexibility, allowing for different art styles (e.g., Pokémon vs. Metal Slug aesthetics).
59
+
60
+ ---
61
+
62
+ Animator2D is an exciting step toward AI-assisted sprite animation generation, and future versions will continue to push the boundaries of what’s possible in pixel-art automation! 🚀🎮