shimmyshimmer commited on
Commit
c348b69
·
verified ·
1 Parent(s): 76ff208

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +46 -74
README.md CHANGED
@@ -1,14 +1,52 @@
1
  ---
2
- license: gemma
 
 
3
  library_name: transformers
4
- pipeline_tag: image-text-to-text
5
- extra_gated_heading: Access Gemma on Hugging Face
6
- extra_gated_prompt: >-
7
- To access Gemma on Hugging Face, you’re required to review and agree to
8
- Google’s usage license. To do this, please ensure you’re logged in to Hugging
9
- Face and click below. Requests are processed immediately.
10
- extra_gated_button_content: Acknowledge license
11
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
12
 
13
  # Gemma 3 model card
14
 
@@ -58,72 +96,6 @@ for everyone.
58
  question, analysis of image content, or a summary of a document
59
  - Total output context of 8192 tokens
60
 
61
- ### Usage
62
-
63
- Below, there are some code snippets on how to get quickly started with running the model. First, install the Transformers library with the version made for Gemma 3:
64
-
65
- ```sh
66
-
67
- $ pip install git+https://github.com/huggingface/[email protected]
68
-
69
- ```
70
-
71
- Then, copy the snippet from the section that is relevant for your use case.
72
-
73
- #### Running with the `pipeline` API
74
-
75
- ```python
76
- from transformers import pipeline
77
- import torch
78
-
79
- pipe = pipeline(
80
- "image-text-to-text",
81
- model="google/gemma-3-4b-pt",
82
- device="cuda",
83
- torch_dtype=torch.bfloat16
84
- )
85
-
86
- output = pipe(
87
- "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/bee.jpg",
88
- text="<start_of_image> in this image, there is"
89
- )
90
-
91
- print(output)
92
- # [{'input_text': '<start_of_image> in this image, there is',
93
- # 'generated_text': '<start_of_image> in this image, there is a bumblebee on a pink flower.\n\n'}]
94
- ```
95
-
96
- #### Running the model on a single / multi GPU
97
-
98
- ```python
99
- # pip install accelerate
100
-
101
- from transformers import AutoProcessor, Gemma3ForConditionalGeneration
102
- from PIL import Image
103
- import requests
104
- import torch
105
-
106
- model_id = "google/gemma-3-4b-pt"
107
-
108
- url = "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/bee.jpg"
109
- image = Image.open(requests.get(url, stream=True).raw)
110
-
111
- model = Gemma3ForConditionalGeneration.from_pretrained(model_id).eval()
112
- processor = AutoProcessor.from_pretrained(model_id)
113
-
114
- prompt = "<start_of_image> in this image, there is"
115
- model_inputs = processor(text=prompt, images=image, return_tensors="pt")
116
-
117
- input_len = model_inputs["input_ids"].shape[-1]
118
-
119
- with torch.inference_mode():
120
- generation = model.generate(**model_inputs, max_new_tokens=100, do_sample=False)
121
- generation = generation[0][input_len:]
122
-
123
- decoded = processor.decode(generation, skip_special_tokens=True)
124
- print(decoded)
125
- ```
126
-
127
  ### Citation
128
 
129
  ```none
 
1
  ---
2
+ base_model: google/gemma-3-4b-pt
3
+ language:
4
+ - en
5
  library_name: transformers
6
+ license: gemma
7
+ tags:
8
+ - unsloth
9
+ - transformers
10
+ - gemma3
11
+ - gemma
12
+ - google
13
  ---
14
+ <div>
15
+ <p style="margin-bottom: 0; margin-top: 0;">
16
+ <strong>See <a href="https://huggingface.co/collections/unsloth/gemma-3-67d12b7e8816ec6efa7e4e5b">our collection</a> for all versions of Gemma 3 including GGUF, 4-bit & 16-bit formats.</strong>
17
+ </p>
18
+ <p style="margin-bottom: 0;">
19
+ <em>Unsloth's Gemma 3 <a href="https://unsloth.ai/blog/dynamic-4bit">Dynamic Quants</a> is selectively quantized, greatly improving accuracy over standard 4-bit.</em>
20
+ </p>
21
+ <div style="display: flex; gap: 5px; align-items: center; ">
22
+ <a href="https://github.com/unslothai/unsloth/">
23
+ <img src="https://github.com/unslothai/unsloth/raw/main/images/unsloth%20new%20logo.png" width="133">
24
+ </a>
25
+ <a href="https://discord.gg/unsloth">
26
+ <img src="https://github.com/unslothai/unsloth/raw/main/images/Discord%20button.png" width="173">
27
+ </a>
28
+ <a href="https://docs.unsloth.ai/basics/tutorial-how-to-run-deepseek-r1-on-your-own-local-device">
29
+ <img src="https://raw.githubusercontent.com/unslothai/unsloth/refs/heads/main/images/documentation%20green%20button.png" width="143">
30
+ </a>
31
+ </div>
32
+ <h1 style="margin-top: 0rem;">✨ Fine-tune Gemma 3 with Unsloth!</h1>
33
+ </div>
34
+
35
+ - Fine-tune Gemma 3 (12B) for free using our Google [Colab notebook here](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Gemma3.ipynb)!
36
+ - Read our Blog about Gemma 3 support: [unsloth.ai/blog/gemma3](https://unsloth.ai/blog/gemma3)
37
+ - View the rest of our notebooks in our [docs here](https://docs.unsloth.ai/get-started/unsloth-notebooks).
38
+ - Export your fine-tuned model to GGUF, Ollama, llama.cpp or 🤗HF.
39
+
40
+ | Unsloth supports | Free Notebooks | Performance | Memory use |
41
+ |-----------------|--------------------------------------------------------------------------------------------------------------------------|-------------|----------|
42
+ | **GRPO with Gemma 3 (12B)** | [▶️ Start on Colab](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Gemma_3_(12B)-GRPO.ipynb) | 2x faster | 80% less |
43
+ | **Llama-3.2 (3B)** | [▶️ Start on Colab](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Llama3.2_(1B_and_3B)-Conversational.ipynb) | 2.4x faster | 58% less |
44
+ | **Llama-3.2 (11B vision)** | [▶️ Start on Colab](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Llama3.2_(11B)-Vision.ipynb) | 2x faster | 60% less |
45
+ | **Qwen2.5 (7B)** | [▶️ Start on Colab](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Qwen2.5_(7B)-Alpaca.ipynb) | 2x faster | 60% less |
46
+ | **Phi-4 (14B)** | [▶️ Start on Colab](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Phi_4-Conversational.ipynb) | 2x faster | 50% less |
47
+ | **Mistral (7B)** | [▶️ Start on Colab](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Mistral_v0.3_(7B)-Conversational.ipynb) | 2.2x faster | 62% less |
48
+
49
+ <br>
50
 
51
  # Gemma 3 model card
52
 
 
96
  question, analysis of image content, or a summary of a document
97
  - Total output context of 8192 tokens
98
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
99
  ### Citation
100
 
101
  ```none