Add files using upload-large-folder tool

.gitattributes

@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+tokenizer.json filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,204 @@
+---
+library_name: mlx
+language:
+- ar
+- de
+- en
+- es
+- fr
+- hi
+- id
+- it
+- pt
+- th
+- tl
+- vi
+tags:
+- facebook
+- meta
+- pytorch
+- llama
+- llama-4
+- mlx
+extra_gated_prompt: '**LLAMA 4 COMMUNITY LICENSE AGREEMENT**
+
+  Llama 4 Version Effective Date: April 5, 2025
+
+  "**Agreement**" means the terms and conditions for use, reproduction, distribution
+  and modification of the Llama Materials set forth herein.
+
+  "**Documentation**" means the specifications, manuals and documentation accompanying
+  Llama 4 distributed by Meta at [https://www.llama.com/docs/overview](https://llama.com/docs/overview).
+
+  "**Licensee**" or "**you**" means you, or your employer or any other person or entity
+  (if you are entering into this Agreement on such person or entity’s behalf), of
+  the age required under applicable laws, rules or regulations to provide legal consent
+  and that has legal authority to bind your employer or such other person or entity
+  if you are entering in this Agreement on their behalf.
+
+  "**Llama 4**" means the foundational large language models and software and algorithms,
+  including machine-learning model code, trained model weights, inference-enabling
+  code, training-enabling code, fine-tuning enabling code and other elements of the
+  foregoing distributed by Meta at [https://www.llama.com/llama-downloads](https://www.llama.com/llama-downloads).
+
+  "**Llama Materials**" means, collectively, Meta’s proprietary Llama 4 and Documentation
+  (and any portion thereof) made available under this Agreement.
+
+  "**Meta**" or "**we**" means Meta Platforms Ireland Limited (if you are located
+  in or, if you are an entity, your principal place of business is in the EEA or Switzerland)
+  and Meta Platforms, Inc. (if you are located outside of the EEA or Switzerland). 
+
+  By clicking "I Accept" below or by using or distributing any portion or element
+  of the Llama Materials, you agree to be bound by this Agreement.
+
+  1\. **License Rights and Redistribution**.
+
+  a. Grant of Rights. You are granted a non-exclusive, worldwide, non-transferable
+  and royalty-free limited license under Meta’s intellectual property or other rights
+  owned by Meta embodied in the Llama Materials to use, reproduce, distribute, copy,
+  create derivative works of, and make modifications to the Llama Materials.  
+
+  b. Redistribution and Use.  
+
+  i. If you distribute or make available the Llama Materials (or any derivative works
+  thereof), or a product or service (including another AI model) that contains any
+  of them, you shall (A) provide a copy of this Agreement with any such Llama Materials;
+  and (B) prominently display "Built with Llama" on a related website, user interface,
+  blogpost, about page, or product documentation. If you use the Llama Materials or
+  any outputs or results of the Llama Materials to create, train, fine tune, or otherwise
+  improve an AI model, which is distributed or made available, you shall also include
+  "Llama" at the beginning of any such AI model name.
+
+  ii. If you receive Llama Materials, or any derivative works thereof, from a Licensee
+  as part of an integrated end user product, then Section 2 of this Agreement will
+  not apply to you. 
+
+  iii. You must retain in all copies of the Llama Materials that you distribute the
+  following attribution notice within a "Notice" text file distributed as a part of
+  such copies: "Llama 4 is licensed under the Llama 4 Community License, Copyright
+  © Meta Platforms, Inc. All Rights Reserved."
+
+  iv. Your use of the Llama Materials must comply with applicable laws and regulations
+  (including trade compliance laws and regulations) and adhere to the Acceptable Use
+  Policy for the Llama Materials (available at [https://www.llama.com/llama4/use-policy](https://www.llama.com/llama4/use-policy)),
+  which is hereby incorporated by reference into this Agreement.        2\. **Additional
+  Commercial Terms**. If, on the Llama 4 version release date, the monthly active
+  users of the products or services made available by or for Licensee, or Licensee’s
+  affiliates, is greater than 700 million monthly active users in the preceding calendar
+  month, you must request a license from Meta, which Meta may grant to you in its
+  sole discretion, and you are not authorized to exercise any of the rights under
+  this Agreement unless or until Meta otherwise expressly grants you such rights.
+
+  3**. Disclaimer of Warranty**. UNLESS REQUIRED BY APPLICABLE LAW, THE LLAMA MATERIALS
+  AND ANY OUTPUT AND RESULTS THEREFROM ARE PROVIDED ON AN "AS IS" BASIS, WITHOUT WARRANTIES
+  OF ANY KIND, AND META DISCLAIMS ALL WARRANTIES OF ANY KIND, BOTH EXPRESS AND IMPLIED,
+  INCLUDING, WITHOUT LIMITATION, ANY WARRANTIES OF TITLE, NON-INFRINGEMENT, MERCHANTABILITY,
+  OR FITNESS FOR A PARTICULAR PURPOSE. YOU ARE SOLELY RESPONSIBLE FOR DETERMINING
+  THE APPROPRIATENESS OF USING OR REDISTRIBUTING THE LLAMA MATERIALS AND ASSUME ANY
+  RISKS ASSOCIATED WITH YOUR USE OF THE LLAMA MATERIALS AND ANY OUTPUT AND RESULTS.
+
+  4\. **Limitation of Liability**. IN NO EVENT WILL META OR ITS AFFILIATES BE LIABLE
+  UNDER ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, TORT, NEGLIGENCE, PRODUCTS LIABILITY,
+  OR OTHERWISE, ARISING OUT OF THIS AGREEMENT, FOR ANY LOST PROFITS OR ANY INDIRECT,
+  SPECIAL, CONSEQUENTIAL, INCIDENTAL, EXEMPLARY OR PUNITIVE DAMAGES, EVEN IF META
+  OR ITS AFFILIATES HAVE BEEN ADVISED OF THE POSSIBILITY OF ANY OF THE FOREGOING.
+
+  5\. **Intellectual Property**.
+
+  a. No trademark licenses are granted under this Agreement, and in connection with
+  the Llama Materials, neither Meta nor Licensee may use any name or mark owned by
+  or associated with the other or any of its affiliates, except as required for reasonable
+  and customary use in describing and redistributing the Llama Materials or as set
+  forth in this Section 5(a). Meta hereby grants you a license to use "Llama" (the
+  "Mark") solely as required to comply with the last sentence of Section 1.b.i. You
+  will comply with Meta’s brand guidelines (currently accessible at [https://about.meta.com/brand/resources/meta/company-brand/](https://about.meta.com/brand/resources/meta/company-brand/)[)](https://en.facebookbrand.com/).
+  All goodwill arising out of your use of the Mark will inure to the benefit of Meta.
+
+  b. Subject to Meta’s ownership of Llama Materials and derivatives made by or for
+  Meta, with respect to any derivative works and modifications of the Llama Materials
+  that are made by you, as between you and Meta, you are and will be the owner of
+  such derivative works and modifications.
+
+  c. If you institute litigation or other proceedings against Meta or any entity (including
+  a cross-claim or counterclaim in a lawsuit) alleging that the Llama Materials or
+  Llama 4 outputs or results, or any portion of any of the foregoing, constitutes
+  infringement of intellectual property or other rights owned or licensable by you,
+  then any licenses granted to you under this Agreement shall terminate as of the
+  date such litigation or claim is filed or instituted. You will indemnify and hold
+  harmless Meta from and against any claim by any third party arising out of or related
+  to your use or distribution of the Llama Materials.
+
+  6\. **Term and Termination**. The term of this Agreement will commence upon your
+  acceptance of this Agreement or access to the Llama Materials and will continue
+  in full force and effect until terminated in accordance with the terms and conditions
+  herein. Meta may terminate this Agreement if you are in breach of any term or condition
+  of this Agreement. Upon termination of this Agreement, you shall delete and cease
+  use of the Llama Materials. Sections 3, 4 and 7 shall survive the termination of
+  this Agreement. 
+
+  7\. **Governing Law and Jurisdiction**. This Agreement will be governed and construed
+  under the laws of the State of California without regard to choice of law principles,
+  and the UN Convention on Contracts for the International Sale of Goods does not
+  apply to this Agreement. The courts of California shall have exclusive jurisdiction
+  of any dispute arising out of this Agreement.'
+extra_gated_fields:
+  First Name: text
+  Last Name: text
+  Date of birth: date_picker
+  Country: country
+  Affiliation: text
+  Job title:
+    type: select
+    options:
+    - Student
+    - Research Graduate
+    - AI researcher
+    - AI developer/engineer
+    - Reporter
+    - Other
+  geo: ip_location
+  ? By clicking Submit below I accept the terms of the license and acknowledge that
+    the information I provide will be collected stored processed and shared in accordance
+    with the Meta Privacy Policy
+  : checkbox
+extra_gated_description: The information you provide will be collected, stored, processed
+  and shared in accordance with the [Meta Privacy Policy](https://www.facebook.com/privacy/policy/).
+extra_gated_button_content: Submit
+extra_gated_heading: Please be sure to provide your full legal name, date of birth,
+  and full organization name with all corporate identifiers. Avoid the use of acronyms
+  and special characters. Failure to follow these instructions may prevent you from
+  accessing this model and others on Hugging Face. You will not have the ability to
+  edit this form after submission, so please ensure all information is accurate.
+license: other
+license_name: llama4
+base_model: meta-llama/Llama-4-Scout-17B-16E
+pipeline_tag: text-generation
+---
+
+# mlx-community/meta-llama-Llama-4-Scout-17B-16E-6bit
+
+This model [mlx-community/meta-llama-Llama-4-Scout-17B-16E-6bit](https://huggingface.co/mlx-community/meta-llama-Llama-4-Scout-17B-16E-6bit) was
+converted to MLX format from [meta-llama/Llama-4-Scout-17B-16E](https://huggingface.co/meta-llama/Llama-4-Scout-17B-16E)
+using mlx-lm version **0.22.3**.
+
+## Use with mlx
+
+```bash
+pip install mlx-lm
+```
+
+```python
+from mlx_lm import load, generate
+
+model, tokenizer = load("mlx-community/meta-llama-Llama-4-Scout-17B-16E-6bit")
+
+prompt = "hello"
+
+if tokenizer.chat_template is not None:
+    messages = [{"role": "user", "content": prompt}]
+    prompt = tokenizer.apply_chat_template(
+        messages, add_generation_prompt=True
+    )
+
+response = generate(model, tokenizer, prompt=prompt, verbose=True)
+```

config.json

@@ -0,0 +1,85 @@
+{
+    "architectures": [
+        "Llama4ForConditionalGeneration"
+    ],
+    "boi_token_index": 200080,
+    "eoi_token_index": 200081,
+    "image_token_index": 200092,
+    "model_type": "llama4",
+    "quantization": {
+        "group_size": 64,
+        "bits": 6
+    },
+    "quantization_config": {
+        "group_size": 64,
+        "bits": 6
+    },
+    "text_config": {
+        "attention_bias": false,
+        "attention_chunk_size": 8192,
+        "attention_dropout": 0.0,
+        "bos_token_id": 200000,
+        "eos_token_id": [
+            200001,
+            200007,
+            200008
+        ],
+        "for_llm_compressor": false,
+        "head_dim": 128,
+        "hidden_act": "silu",
+        "hidden_size": 5120,
+        "initializer_range": 0.02,
+        "interleave_moe_layer_step": 1,
+        "intermediate_size": 8192,
+        "intermediate_size_mlp": 16384,
+        "max_position_embeddings": 262144,
+        "model_type": "llama4_text",
+        "no_rope_layers": [],
+        "num_attention_heads": 40,
+        "num_experts_per_tok": 1,
+        "num_hidden_layers": 48,
+        "num_key_value_heads": 8,
+        "num_local_experts": 16,
+        "output_router_logits": false,
+        "pad_token_id": 200018,
+        "rms_norm_eps": 1e-05,
+        "rope_scaling": {
+            "factor": 8.0,
+            "high_freq_factor": 4.0,
+            "low_freq_factor": 1.0,
+            "original_max_position_embeddings": 8192,
+            "rope_type": "llama3"
+        },
+        "rope_theta": 500000.0,
+        "router_aux_loss_coef": 0.001,
+        "router_jitter_noise": 0.0,
+        "torch_dtype": "bfloat16",
+        "use_cache": true,
+        "use_qk_norm": true,
+        "vocab_size": 202048
+    },
+    "transformers_version": "4.51.0.dev0",
+    "vision_config": {
+        "attention_dropout": 0.0,
+        "hidden_act": "gelu",
+        "hidden_size": 1408,
+        "image_size": 336,
+        "initializer_range": 0.02,
+        "intermediate_size": 5632,
+        "model_type": "llama4_vision_model",
+        "multi_modal_projector_bias": false,
+        "norm_eps": 1e-05,
+        "num_attention_heads": 16,
+        "num_channels": 3,
+        "num_hidden_layers": 34,
+        "patch_size": 14,
+        "pixel_shuffle_ratio": 0.5,
+        "projector_dropout": 0.0,
+        "projector_input_dim": 4096,
+        "projector_output_dim": 4096,
+        "rope_theta": 10000,
+        "vision_feature_layer": -1,
+        "vision_feature_select_strategy": "default",
+        "vision_output_dim": 4096
+    }
+}

model-00001-of-00017.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5d46a8ab761c9815a7483bc388a001d3ff6201e6df6b947009f2947d79e4e3d9
+size 5015348964

model-00002-of-00017.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:293f4dec41fa614b33500da125e083e43958a41ca111df626a38ddb6373db42f
+size 5367674097

model-00003-of-00017.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ce6b63b309dfa5fee1a66a2eefff5bc57ecec443866ad4c13e380e9834146b9a
+size 5367674069

model-00004-of-00017.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6c09251946475da9309c05f8d4f0dba67cc31cabf12d00285b19cf971d2d773a
+size 5367674117

model-00005-of-00017.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:edce07ccbe1b55af0b01ab20092de437d1241368a1852da772117e3cb9981d38
+size 5367674088

model-00006-of-00017.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6a1e05440008b7781a40c6788b7440986fbc7b89a2a3077190f1bb89d5da4aef
+size 5367674170

model-00007-of-00017.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fd90ed602959f0f005a35f713f6c9fde3ccbab241f05af7dde1762fddc3402b5
+size 5367674172

model-00008-of-00017.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:52c7f2f937b04bc11c9206d26a03349300a5815caf56e475ed90d93f67295df6
+size 5367674170

model-00009-of-00017.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9178dc4626000a45ae6e9194855e40ad72b1cbc84dd3b847725d728c6b8afbe6
+size 5367674152

model-00010-of-00017.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c0c9cafb5c23aaeec0d4571cc47c19a4ed341572c6a26e314ee688dc9dc48abd
+size 5367674166

model-00011-of-00017.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0a4bd9a7cc16dd391158b047a696ef7755d1a5cfc983febe4840740d6d13bd06
+size 5367674180

model-00012-of-00017.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:04337c7fc005ca44012ec5f3b81354eb5dec7a7f389186eb9b37cd4052a8a47e
+size 5367674164

model-00013-of-00017.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f0f28a4ff5fb95f6c4dbb87bb7adb7cabf61fc0f467335af044546dda3c7fd00
+size 5367674168

model-00014-of-00017.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6a42a63a6a48d740fde7e7149866e25e5f5f29e860bb69404c0e87c50dcd55ef
+size 5367674172

model-00015-of-00017.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6595d25a806d76e86700ad8cf6a7cd2afc2aa97eb4eb6c7b4cd92b7e4783a6fb
+size 5367674106

model-00016-of-00017.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e54074d96a6675eed9428287ca821e3c07b2b739b02908b9d3b4038cbf9e21bd
+size 5367674160

model-00017-of-00017.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1823ef0b3fdc3b3f41b46a13fb2ee6c27d47eb64404730ac7331d112bbd3b48c
+size 2033375469

special_tokens_map.json

@@ -0,0 +1,23 @@
+{
+  "bos_token": {
+    "content": "<|begin_of_text|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "eos_token": {
+    "content": "<|eot|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": {
+    "content": "<|finetune_right_pad_id|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}

tokenizer.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:172c9eb4beafc72601690da3ccfcede5c2e6806a8d5ec1fca33e22acea8023a4
+size 27948578