shimmyshimmer commited on
Commit
e5a6395
·
verified ·
1 Parent(s): b61f0bf

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +46 -75
README.md CHANGED
@@ -1,15 +1,52 @@
1
  ---
2
- license: gemma
 
 
3
  library_name: transformers
4
- pipeline_tag: image-text-to-text
5
- extra_gated_heading: Access Gemma on Hugging Face
6
- extra_gated_prompt: >-
7
- To access Gemma on Hugging Face, you’re required to review and agree to
8
- Google’s usage license. To do this, please ensure you’re logged in to Hugging
9
- Face and click below. Requests are processed immediately.
10
- extra_gated_button_content: Acknowledge license
11
- base_model: google/gemma-3-12b
12
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
13
 
14
  # Gemma 3 model card
15
 
@@ -59,72 +96,6 @@ for everyone.
59
  question, analysis of image content, or a summary of a document
60
  - Total output context of 8192 tokens
61
 
62
- ### Usage
63
-
64
- Below, there are some code snippets on how to get quickly started with running the model. First, install the Transformers library with the version made for Gemma 3:
65
-
66
- ```sh
67
-
68
- $ pip install git+https://github.com/huggingface/[email protected]
69
-
70
- ```
71
-
72
- Then, copy the snippet from the section that is relevant for your use case.
73
-
74
- #### Running with the `pipeline` API
75
-
76
- ```python
77
- from transformers import pipeline
78
- import torch
79
-
80
- pipe = pipeline(
81
- "image-text-to-text",
82
- model="google/gemma-3-12b-pt",
83
- device="cuda",
84
- torch_dtype=torch.bfloat16
85
- )
86
-
87
- output = pipe(
88
- "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/bee.jpg",
89
- text="<start_of_image> in this image, there is"
90
- )
91
-
92
- print(output)
93
- # [{'input_text': '<start_of_image> in this image, there is',
94
- # 'generated_text': '<start_of_image> in this image, there is a bumblebee on a pink flower.\n\n'}]
95
- ```
96
-
97
- #### Running the model on a single / multi GPU
98
-
99
- ```python
100
- # pip install accelerate
101
-
102
- from transformers import AutoProcessor, Gemma3ForConditionalGeneration
103
- from PIL import Image
104
- import requests
105
- import torch
106
-
107
- model_id = "google/gemma-3-12b-pt"
108
-
109
- url = "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/bee.jpg"
110
- image = Image.open(requests.get(url, stream=True).raw)
111
-
112
- model = Gemma3ForConditionalGeneration.from_pretrained(model_id).eval()
113
- processor = AutoProcessor.from_pretrained(model_id)
114
-
115
- prompt = "<start_of_image> in this image, there is"
116
- model_inputs = processor(text=prompt, images=image, return_tensors="pt")
117
-
118
- input_len = model_inputs["input_ids"].shape[-1]
119
-
120
- with torch.inference_mode():
121
- generation = model.generate(**model_inputs, max_new_tokens=100, do_sample=False)
122
- generation = generation[0][input_len:]
123
-
124
- decoded = processor.decode(generation, skip_special_tokens=True)
125
- print(decoded)
126
- ```
127
-
128
  ### Citation
129
 
130
  ```none
 
1
  ---
2
+ base_model: google/gemma-3-12b-pt
3
+ language:
4
+ - en
5
  library_name: transformers
6
+ license: gemma
7
+ tags:
8
+ - unsloth
9
+ - transformers
10
+ - gemma3
11
+ - gemma
12
+ - google
 
13
  ---
14
+ <div>
15
+ <p style="margin-bottom: 0; margin-top: 0;">
16
+ <strong>See <a href="https://huggingface.co/collections/unsloth/gemma-3-67d12b7e8816ec6efa7e4e5b">our collection</a> for all versions of Gemma 3 including GGUF, 4-bit & 16-bit formats.</strong>
17
+ </p>
18
+ <p style="margin-bottom: 0;">
19
+ <em>Unsloth's Gemma 3 <a href="https://unsloth.ai/blog/dynamic-4bit">Dynamic Quants</a> is selectively quantized, greatly improving accuracy over standard 4-bit.</em>
20
+ </p>
21
+ <div style="display: flex; gap: 5px; align-items: center; ">
22
+ <a href="https://github.com/unslothai/unsloth/">
23
+ <img src="https://github.com/unslothai/unsloth/raw/main/images/unsloth%20new%20logo.png" width="133">
24
+ </a>
25
+ <a href="https://discord.gg/unsloth">
26
+ <img src="https://github.com/unslothai/unsloth/raw/main/images/Discord%20button.png" width="173">
27
+ </a>
28
+ <a href="https://docs.unsloth.ai/basics/tutorial-how-to-run-deepseek-r1-on-your-own-local-device">
29
+ <img src="https://raw.githubusercontent.com/unslothai/unsloth/refs/heads/main/images/documentation%20green%20button.png" width="143">
30
+ </a>
31
+ </div>
32
+ <h1 style="margin-top: 0rem;">✨ Fine-tune Gemma 3 with Unsloth!</h1>
33
+ </div>
34
+
35
+ - Fine-tune Gemma 3 (12B) for free using our Google [Colab notebook here](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Gemma3.ipynb)!
36
+ - Read our Blog about Gemma 3 support: [unsloth.ai/blog/gemma3](https://unsloth.ai/blog/gemma3)
37
+ - View the rest of our notebooks in our [docs here](https://docs.unsloth.ai/get-started/unsloth-notebooks).
38
+ - Export your fine-tuned model to GGUF, Ollama, llama.cpp or 🤗HF.
39
+
40
+ | Unsloth supports | Free Notebooks | Performance | Memory use |
41
+ |-----------------|--------------------------------------------------------------------------------------------------------------------------|-------------|----------|
42
+ | **GRPO with Gemma 3 (12B)** | [▶️ Start on Colab](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Gemma_3_(12B)-GRPO.ipynb) | 2x faster | 80% less |
43
+ | **Llama-3.2 (3B)** | [▶️ Start on Colab](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Llama3.2_(1B_and_3B)-Conversational.ipynb) | 2.4x faster | 58% less |
44
+ | **Llama-3.2 (11B vision)** | [▶️ Start on Colab](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Llama3.2_(11B)-Vision.ipynb) | 2x faster | 60% less |
45
+ | **Qwen2.5 (7B)** | [▶️ Start on Colab](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Qwen2.5_(7B)-Alpaca.ipynb) | 2x faster | 60% less |
46
+ | **Phi-4 (14B)** | [▶️ Start on Colab](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Phi_4-Conversational.ipynb) | 2x faster | 50% less |
47
+ | **Mistral (7B)** | [▶️ Start on Colab](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Mistral_v0.3_(7B)-Conversational.ipynb) | 2.2x faster | 62% less |
48
+
49
+ <br>
50
 
51
  # Gemma 3 model card
52
 
 
96
  question, analysis of image content, or a summary of a document
97
  - Total output context of 8192 tokens
98
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
99
  ### Citation
100
 
101
  ```none