Add files using upload-large-folder tool

README.md

@@ -1,4 +1,19 @@
 ---
+tags:
+- facebook
+- meta
+- pytorch
+- llama
+- llama-3
+- mlx
+- mlx
+- reasoning
+- llama
+- deepseek
+- ollama
+- chain-of-thoughts
+- small-llm
+- edge
 base_model: mlx-community/Llama-3.2-3B-Instruct
 language:
 - en
@@ -12,14 +27,6 @@ language:
 library_name: transformers
 license: llama3.2
 pipeline_tag: text-generation
-tags:
-- facebook
-- meta
-- pytorch
-- llama
-- llama-3
-- mlx
-- mlx
 extra_gated_prompt: "### LLAMA 3.2 COMMUNITY LICENSE AGREEMENT\n\nLlama 3.2 Version\
   \ Release Date: September 25, 2024\n\n“Agreement” means the terms and conditions\
   \ for use, reproduction, distribution  and modification of the Llama Materials set\
@@ -146,7 +153,7 @@ extra_gated_prompt: "### LLAMA 3.2 COMMUNITY LICENSE AGREEMENT\n\nLlama 3.2 Vers
   \ overburden, interfere with or impair the proper working, integrity, operation\
   \ or appearance of a website or computer system\n    7. Engage in any action, or\
   \ facilitate any action, to intentionally circumvent or remove usage restrictions\
-  \ or other safety measures, or to enable functionality disabled by Meta \n2. Engage\
+  \ or other safety measures, or to enable functionality disabled by Meta \n2. Engage\
   \ in, promote, incite, facilitate, or assist in the planning or development of activities\
   \ that present a risk of death or bodily harm to individuals, including use of Llama\
   \ 3.2 related to the following:\n    8. Military, warfare, nuclear industries or\
@@ -167,7 +174,7 @@ extra_gated_prompt: "### LLAMA 3.2 COMMUNITY LICENSE AGREEMENT\n\nLlama 3.2 Vers
   \ without consent, authorization, or legal right\n    18. Representing that the\
   \ use of Llama 3.2 or outputs are human-generated\n    19. Generating or facilitating\
   \ false online engagement, including fake reviews and other means of fake online\
-  \ engagement \n4. Fail to appropriately disclose to end users any known dangers\
+  \ engagement \n4. Fail to appropriately disclose to end users any known dangers\
   \ of your AI system 5. Interact with third party tools, models, or software designed\
   \ to generate unlawful content or engage in unlawful or harmful conduct and/or represent\
   \ that the outputs of such tools, models, or software are associated with Meta or\
@@ -207,31 +214,46 @@ extra_gated_description: The information you provide will be collected, stored,
   and shared in accordance with the [Meta Privacy Policy](https://www.facebook.com/privacy/policy/).
 extra_gated_button_content: Submit
 ---
+# ReasonableLlama-3B: A Fine-Tuned Reasoning Model
+
+HF: https://huggingface.co/adeelahmad/ReasonableLlama3-3B-Jr
+Ollama: https://ollama.com/adeelahmad/ReasonableLLAMA-Jr-3b
+
 
-# adeelahmad/ReasonableLlama3-3B-Jr
+Welcome to **ReasonableLlama-3B**, a cutting-edge reasoning model built on the foundation of LLaMA-3B. This model has been carefully fine-tuned to enhance its capabilities in logical
+thinking, problem-solving, and creative analysis.
 
-The Model [adeelahmad/ReasonableLlama3-3B-Jr](https://huggingface.co/adeelahmad/ReasonableLlama3-3B-Jr) was
-converted to MLX format from [mlx-community/Llama-3.2-3B-Instruct](https://huggingface.co/mlx-community/Llama-3.2-3B-Instruct)
-using mlx-lm version **0.21.4**.
+## Overview
+- **Model Name**: ReasonableLlama-3B
+- **Base Architecture**: LLaMA-3B (Large Language Model with 3B parameters)
+- **Purpose**: Designed for tasks requiring advanced reasoning, problem-solving, and creative thinking
 
-## Use with mlx
+## Features
+- **Advanced Reasoning**: Excels in logical analysis, problem-solving, and decision-making.
+- **Creative Thinking**: Generates innovative solutions and ideas.
+- **Curriculum-Based Fine-Tuning**: Trained on high-quality datasets to enhance reasoning abilities.
 
-```bash
-pip install mlx-lm
-```
+## Technical Details
+- **Parameter Count**: 3B parameters
+- **Training Process**: Fine-tuned using state-of-the-art techniques for reasoning tasks
+- **Specialization**: Optimized for specific reasoning workflows and scenarios
 
-```python
-from mlx_lm import load, generate
+## Use Cases
+- **Research**: Facilitates complex problem-solving and theoretical analysis.
+- **Education**: Assists in creating educational examples and problem sets.
+- **Problem Solving**: Helps generate innovative solutions across various domains.
 
-model, tokenizer = load("adeelahmad/ReasonableLlama3-3B-Jr")
+## Installation and Usage
+- **Integration**: Can be integrated into existing systems via APIs or local setup.
+- **Inputs**: Supports text and images, leveraging Ollama's versatile capabilities.
 
-prompt = "hello"
+## Limitations
+- **Scope**: Limited to single-step reasoning; multi-hop reasoning is a current focus area.
+- **Data Bias**: Caution with dataset provenance as it may reflect historical biases.
 
-if tokenizer.chat_template is not None:
-    messages = [{"role": "user", "content": prompt}]
-    prompt = tokenizer.apply_chat_template(
-        messages, add_generation_prompt=True
-    )
+## Contributing
+Contributions welcome! Fork the project, submit issues, and pull requests on GitHub. Your insights can help shape future improvements.
 
-response = generate(model, tokenizer, prompt=prompt, verbose=True)
-```
+## Citations
+- Special thanks to LLaMA's developers for providing a strong foundation.
+- Acknowledgments to the community contributing to open-source AI advancements.

model-00001-of-00002.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:2bbdd2a6974d2df44cd93567dbde3e72deed6651b49394bbd2535675002485a1
-size 5368424925
+oid sha256:1ff29640561515b67419537c05cc772061ccbcbd64a91a9253a7e26340e08cb4
+size 5368478677

model-00002-of-00002.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:ea7d43db459f43a7c7b6bf291ca5b41dd1dc61abdf922053cac06e759689f088
-size 2466389976
+oid sha256:06086cfa2c959311846c8f528db9264fccbf4fc389c236147ea5b6bfc878ef67
+size 1057050040

model.safetensors.index.json

@@ -1,6 +1,6 @@
 {
     "metadata": {
-        "total_size": 7834785792
+        "total_size": 6425499648
     },
     "weight_map": {
         "model.embed_tokens.weight": "model-00001-of-00002.safetensors",
@@ -94,24 +94,24 @@
         "model.layers.17.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
         "model.layers.17.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
         "model.layers.17.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
-        "model.layers.18.input_layernorm.weight": "model-00002-of-00002.safetensors",
-        "model.layers.18.mlp.down_proj.weight": "model-00002-of-00002.safetensors",
-        "model.layers.18.mlp.gate_proj.weight": "model-00002-of-00002.safetensors",
-        "model.layers.18.mlp.up_proj.weight": "model-00002-of-00002.safetensors",
-        "model.layers.18.post_attention_layernorm.weight": "model-00002-of-00002.safetensors",
+        "model.layers.18.input_layernorm.weight": "model-00001-of-00002.safetensors",
+        "model.layers.18.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
+        "model.layers.18.mlp.gate_proj.weight": "model-00001-of-00002.safetensors",
+        "model.layers.18.mlp.up_proj.weight": "model-00001-of-00002.safetensors",
+        "model.layers.18.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
         "model.layers.18.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
-        "model.layers.18.self_attn.o_proj.weight": "model-00002-of-00002.safetensors",
+        "model.layers.18.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
         "model.layers.18.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
-        "model.layers.18.self_attn.v_proj.weight": "model-00002-of-00002.safetensors",
-        "model.layers.19.input_layernorm.weight": "model-00002-of-00002.safetensors",
-        "model.layers.19.mlp.down_proj.weight": "model-00002-of-00002.safetensors",
-        "model.layers.19.mlp.gate_proj.weight": "model-00002-of-00002.safetensors",
-        "model.layers.19.mlp.up_proj.weight": "model-00002-of-00002.safetensors",
-        "model.layers.19.post_attention_layernorm.weight": "model-00002-of-00002.safetensors",
-        "model.layers.19.self_attn.k_proj.weight": "model-00002-of-00002.safetensors",
-        "model.layers.19.self_attn.o_proj.weight": "model-00002-of-00002.safetensors",
-        "model.layers.19.self_attn.q_proj.weight": "model-00002-of-00002.safetensors",
-        "model.layers.19.self_attn.v_proj.weight": "model-00002-of-00002.safetensors",
+        "model.layers.18.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
+        "model.layers.19.input_layernorm.weight": "model-00001-of-00002.safetensors",
+        "model.layers.19.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
+        "model.layers.19.mlp.gate_proj.weight": "model-00001-of-00002.safetensors",
+        "model.layers.19.mlp.up_proj.weight": "model-00001-of-00002.safetensors",
+        "model.layers.19.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
+        "model.layers.19.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
+        "model.layers.19.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
+        "model.layers.19.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
+        "model.layers.19.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
         "model.layers.2.input_layernorm.weight": "model-00001-of-00002.safetensors",
         "model.layers.2.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
         "model.layers.2.mlp.gate_proj.weight": "model-00001-of-00002.safetensors",
@@ -121,33 +121,33 @@
         "model.layers.2.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
         "model.layers.2.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
         "model.layers.2.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
-        "model.layers.20.input_layernorm.weight": "model-00002-of-00002.safetensors",
-        "model.layers.20.mlp.down_proj.weight": "model-00002-of-00002.safetensors",
-        "model.layers.20.mlp.gate_proj.weight": "model-00002-of-00002.safetensors",
-        "model.layers.20.mlp.up_proj.weight": "model-00002-of-00002.safetensors",
-        "model.layers.20.post_attention_layernorm.weight": "model-00002-of-00002.safetensors",
-        "model.layers.20.self_attn.k_proj.weight": "model-00002-of-00002.safetensors",
-        "model.layers.20.self_attn.o_proj.weight": "model-00002-of-00002.safetensors",
-        "model.layers.20.self_attn.q_proj.weight": "model-00002-of-00002.safetensors",
-        "model.layers.20.self_attn.v_proj.weight": "model-00002-of-00002.safetensors",
-        "model.layers.21.input_layernorm.weight": "model-00002-of-00002.safetensors",
-        "model.layers.21.mlp.down_proj.weight": "model-00002-of-00002.safetensors",
-        "model.layers.21.mlp.gate_proj.weight": "model-00002-of-00002.safetensors",
-        "model.layers.21.mlp.up_proj.weight": "model-00002-of-00002.safetensors",
-        "model.layers.21.post_attention_layernorm.weight": "model-00002-of-00002.safetensors",
-        "model.layers.21.self_attn.k_proj.weight": "model-00002-of-00002.safetensors",
-        "model.layers.21.self_attn.o_proj.weight": "model-00002-of-00002.safetensors",
-        "model.layers.21.self_attn.q_proj.weight": "model-00002-of-00002.safetensors",
-        "model.layers.21.self_attn.v_proj.weight": "model-00002-of-00002.safetensors",
+        "model.layers.20.input_layernorm.weight": "model-00001-of-00002.safetensors",
+        "model.layers.20.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
+        "model.layers.20.mlp.gate_proj.weight": "model-00001-of-00002.safetensors",
+        "model.layers.20.mlp.up_proj.weight": "model-00001-of-00002.safetensors",
+        "model.layers.20.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
+        "model.layers.20.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
+        "model.layers.20.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
+        "model.layers.20.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
+        "model.layers.20.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
+        "model.layers.21.input_layernorm.weight": "model-00001-of-00002.safetensors",
+        "model.layers.21.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
+        "model.layers.21.mlp.gate_proj.weight": "model-00001-of-00002.safetensors",
+        "model.layers.21.mlp.up_proj.weight": "model-00001-of-00002.safetensors",
+        "model.layers.21.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
+        "model.layers.21.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
+        "model.layers.21.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
+        "model.layers.21.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
+        "model.layers.21.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
         "model.layers.22.input_layernorm.weight": "model-00002-of-00002.safetensors",
-        "model.layers.22.mlp.down_proj.weight": "model-00002-of-00002.safetensors",
-        "model.layers.22.mlp.gate_proj.weight": "model-00002-of-00002.safetensors",
+        "model.layers.22.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
+        "model.layers.22.mlp.gate_proj.weight": "model-00001-of-00002.safetensors",
         "model.layers.22.mlp.up_proj.weight": "model-00002-of-00002.safetensors",
         "model.layers.22.post_attention_layernorm.weight": "model-00002-of-00002.safetensors",
-        "model.layers.22.self_attn.k_proj.weight": "model-00002-of-00002.safetensors",
-        "model.layers.22.self_attn.o_proj.weight": "model-00002-of-00002.safetensors",
-        "model.layers.22.self_attn.q_proj.weight": "model-00002-of-00002.safetensors",
-        "model.layers.22.self_attn.v_proj.weight": "model-00002-of-00002.safetensors",
+        "model.layers.22.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
+        "model.layers.22.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
+        "model.layers.22.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
+        "model.layers.22.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
         "model.layers.23.input_layernorm.weight": "model-00002-of-00002.safetensors",
         "model.layers.23.mlp.down_proj.weight": "model-00002-of-00002.safetensors",
         "model.layers.23.mlp.gate_proj.weight": "model-00002-of-00002.safetensors",

tokenizer_config.json

@@ -2053,6 +2053,7 @@
   "chat_template": "{{- bos_token }}\n{%- if custom_tools is defined %}\n    {%- set tools = custom_tools %}\n{%- endif %}\n{%- if not tools_in_user_message is defined %}\n    {%- set tools_in_user_message = true %}\n{%- endif %}\n{%- if not date_string is defined %}\n    {%- if strftime_now is defined %}\n        {%- set date_string = strftime_now(\"%d %b %Y\") %}\n    {%- else %}\n        {%- set date_string = \"26 Jul 2024\" %}\n    {%- endif %}\n{%- endif %}\n{%- if not tools is defined %}\n    {%- set tools = none %}\n{%- endif %}\n\n{#- This block extracts the system message, so we can slot it into the right place. #}\n{%- if messages[0]['role'] == 'system' %}\n    {%- set system_message = messages[0]['content']|trim %}\n    {%- set messages = messages[1:] %}\n{%- else %}\n    {%- set system_message = \"Cutting Knowledge Date: December 2023\n\nYou are a AI Assistant ReasonableLLaMa Junior, specialized in advanced reasoning and problem-solving. Break down the User Query, understand the context and what user needs, and address all constraints, challenges and gaps.\n            Instructions and Response template within [[RESPONSE-FORMAT]]...[[/RESPONSE-FORMAT]]:\n\n[[RESPONSE-FORMAT]]\n<think>\n                [Perform deep analytical thinking about the problem, thinking out loud when vocalizing your approch]\n                [- When Assistant is stuck, I will Frame it as \\\"I am considering approch A and approch B, I am leaning towards A because ...\\\"\n                - When needed I would ask clarification questions rather than heading down a wrong path]\n</think>\n\nFinal, response without any placeholders (including relevent reasoning) that directly addresses all aspects of the problem, further include verified implementation plan, cli commands or relevent code aginst the User's query validating that the response is complete and accurate.\n\n[[/RESPONSE-FORMAT]]\n\nRemember: DO NOT REPEAT THE TEMPLATE VARIABLES WITHIN [square-brackets] or [[RESPONSE-FORMAT]]/[[/RESPONSE-FORMAT]]. Your response start with the tag <think> and ends with the final response outside of the the think tag.\n\" %}\n{%- endif %}\n\n{#- System message #}\n{{- \"<|start_header_id|>system<|end_header_id|>\n\n\" }}\n{%- if tools is not none %}\n    {{- \"Environment: ipython\n\" }}\n{%- endif %}\n{{- \"Cutting Knowledge Date: December 2023\n\" }}\n{{- \"Today Date: \" + date_string + \"\n\n\" }}\n{%- if tools is not none and not tools_in_user_message %}\n    {{- \"You have access to the following functions. To call a function, please respond with JSON for a function call.\" }}\n    {{- 'Respond in the format {\"name\": function name, \"parameters\": dictionary of argument name and its value}.' }}\n    {{- \"Do not use variables.\n\n\" }}\n    {%- for t in tools %}\n        {{- t | tojson(indent=4) }}\n        {{- \"\n\n\" }}\n    {%- endfor %}\n{%- endif %}\n{{- system_message }}\n{{- \"<|eot_id|>\" }}\n\n{#- Custom tools are passed in a user message with some extra guidance #}\n{%- if tools_in_user_message and tools is not none %}\n    {#- Extract the first user message so we can plug it in here #}\n    {%- if messages | length != 0 %}\n        {%- set first_user_message = messages[0]['content']|trim %}\n        {%- set messages = messages[1:] %}\n    {%- else %}\n        {%- set first_user_message = \"\" %}\n    {%- endif %}\n    {{- '<|start_header_id|>user<|end_header_id|>\n\n' -}}\n    {{- \"Given the following functions, please respond with a JSON for a function call \" }}\n    {{- \"with its proper arguments that best answers the given prompt.\n\n\" }}\n    {{- 'Respond in the format {\"name\": function name, \"parameters\": dictionary of argument name and its value}.' }}\n    {{- \"Do not use variables.\n\n\" }}\n    {%- for t in tools %}\n        {{- t | tojson(indent=4) }}\n        {{- \"\n\n\" }}\n    {%- endfor %}\n    {{- first_user_message + \"<|eot_id|>\"}}\n{%- endif %}\n\n{%- for message in messages %}\n    {%- if not (message.role == 'ipython' or message.role == 'tool' or 'tool_calls' in message) %}\n        {{- '<|start_header_id|>' + message['role'] + '<|end_header_id|>\n\n'+ message['content'] | trim + '<|eot_id|>' }}\n    {%- elif 'tool_calls' in message %}\n        {%- if message.tool_calls|length != 1 %}\n            {%- for tool_call in message.tool_calls %}\n                {%- set function_call = tool_call.function %}\n                {{- '<|start_header_id|>assistant<|end_header_id|>\n\n' -}}\n                {{- '{\"name\": \"' + function_call.name + '\", ' }}\n                {{- '\"parameters\": ' }}\n                {{- function_call.arguments | tojson }}\n                {{- \"}\" }}\n                {{- \"<|eot_id|>\" }}\n            {%- endfor %}\n        {%- else %}\n            {%- set tool_call = message.tool_calls[0].function %}\n            {{- '<|start_header_id|>assistant<|end_header_id|>\n\n' -}}\n            {{- '{\"name\": \"' + tool_call.name + '\", ' }}\n            {{- '\"parameters\": ' }}\n            {{- tool_call.arguments | tojson }}\n            {{- \"}\" }}\n            {{- \"<|eot_id|>\" }}\n        {%- endif %}\n    {%- elif message.role == \"tool\" or message.role == \"ipython\" %}\n        {{- \"<|start_header_id|>ipython<|end_header_id|>\n\n\" }}\n        {%- if message.content is mapping or (message.content is iterable and message.content is not string) %}\n            {{- message.content | tojson }}\n        {%- else %}\n            {{- message.content }}\n        {%- endif %}\n        {{- \"<|eot_id|>\" }}\n    {%- endif %}\n{%- endfor %}\n{%- if add_generation_prompt %}\n    {{- '<|start_header_id|>assistant<|end_header_id|>\n\n' }}\n{%- endif %}",
   "clean_up_tokenization_spaces": true,
   "eos_token": "<|eot_id|>",
+  "extra_special_tokens": {},
   "model_input_names": [
     "input_ids",
     "attention_mask"