Upload 2 files

LICENSE

@@ -0,0 +1,77 @@
+# Katanemo Labs, Inc. COMMUNITY LICENSE AGREEMENT  
+**Version Release Date:** September 30th, 2024  
+
+This Katanemo Labs, Inc. COMMUNITY LICENSE AGREEMENT is based on the Llama 3.2 Community License, Copyright © Meta Platforms, Inc. The terms and conditions have been adapted to reflect the proprietary nature of Katanemo Labs' materials.
+
+---
+
+1.Definitions
+  a. "Agreement": The terms and conditions for use, reproduction, distribution, and modification of the Katanemo Materials set forth herein.
+  b. "Documentation": The specifications, manuals, and documentation accompanying Katanemo LLMs v1.
+  c. "Licensee" or "you: The individual or entity entering into this Agreement, including your employer if you are acting on their behalf.
+  d. "Katanemo": The foundational large language models and software provided by Katanemo Labs, Inc., available at https://huggingface.co/katanemolabs.
+  e. "Katanemo Materials": Collectively, Katanemo's proprietary models and Documentation. Some Materials are derived from the Qwen language models licensed under the Qwen RESEARCH LICENSE AGREEMENT.
+  f. "Katanemo Labs" or "we": Katanemo Labs Inc., a Delaware, USA Corporation.
+
+---
+
+2. 
+By clicking "I Accept" or using any part of the Katanemo Materials, you agree to be bound by this Agreement.
+
+---
+
+3. License Rights and Redistribution
+  a. Grant of Rights  
+  You are granted a non-exclusive, worldwide, non-transferable, and royalty-free license to:
+- Use, reproduce, distribute, and modify the Katanemo Materials.
+- Create derivative works based on the Katanemo Materials.
+
+4. Redistribution and Use  
+  a. Distribution:  
+     If you distribute the Katanemo Materials or a derivative work:
+   - Include a copy of this Agreement.
+   - Prominently display "Built with Katanemo" on a related website or documentation.
+
+  b. Attribution:  
+   Include the following attribution notice:  
+   "Katanemo is licensed under the Katanemo Labs Community License, Copyright © Katanemo Labs, Inc. All Rights Reserved."_
+
+  c. Compliance:  
+   Your use must adhere to the Acceptable Use Policy, available at https://katanemolabs.com/katanemo/use-policy.
+
+---
+
+5. Additional Commercial Terms  
+If you are commercially using the Materials, you shall request a license from us.
+
+---
+
+6. Disclaimer of Warranty  
+The Katanemo Materials are provided "AS IS" without warranties of any kind, either express or implied, including but not limited to warranties of title, non-infringement, or fitness for a particular purpose.
+
+---
+
+7. Limitation of Liability  
+Katanemo Labs is not liable for any indirect, special, or consequential damages arising out of the use of the Katanemo Materials, even if advised of the possibility of such damages.
+
+---
+
+8. Intellectual Property
+  a. Trademarks  
+  No trademark licenses are granted, except as required for attribution as described in Section 1.b. You may use the “Katanemo” mark according to Katanemo Labs' brand guidelines.
+
+  b. Ownership  
+  You own any derivative works or modifications you create, except for portions owned by Katanemo Labs.
+
+  c. Litigation  
+  If you file a lawsuit against Katanemo Labs regarding intellectual property, your license under this Agreement terminates.
+
+---
+
+9. Term and Termination  
+This Agreement continues until terminated. Katanemo Labs may terminate the Agreement if you breach any terms. Upon termination, you must cease using the Katanemo Materials.
+
+---
+
+10. Governing Law and Jurisdiction  
+This Agreement is governed by the laws of the State of Washington, USA. Any disputes will be resolved in the courts of California.

README.md

@@ -19,7 +19,7 @@ The Arch-Function-Chat collection builds upon the Katanemo's [Arch-Function](htt
 In addition to function calling capabilities, this collection now offers:
 
 - **Clarify & refine**: Generates natural follow-up questions to collect missing information for function calling
-- **Result inerpretation**: Provides human-friendly responses based on function execution results
+- **Interpret & respond**: Provides human-friendly responses based on function execution results
 - **Context management**: Mantains context in complex multi-turn interactions
 
 # Requirements
@@ -60,69 +60,60 @@ FORMAT_PROMPT = (
 )
 
 # Define available tools
-get_weather_api = {
-    "type": "function",
-    "function": {
-        "name": "get_weather",
-        "description": "Get the current weather for a location",
-        "parameters": {
-            "type": "object",
-            "properties": {
-                "location": {
-                    "type": "str",
-                    "description": "The city and state, e.g. San Francisco, New York",
-                },
-                "unit": {
-                    "type": "str",
-                    "enum": ["celsius", "fahrenheit"],
-                    "description": "The unit of temperature to return",
+tools = [
+    {
+        "type": "function",
+        "function": {
+            "name": "get_weather",
+            "description": "Get the current weather for a location",
+            "parameters": {
+                "type": "object",
+                "properties": {
+                    "location": {
+                        "type": "str",
+                        "description": "The city and state, e.g. San Francisco, New York",
+                    },
+                    "unit": {
+                        "type": "str",
+                        "enum": ["celsius", "fahrenheit"],
+                        "description": "The unit of temperature to return",
+                    },
                 },
+                "required": ["location"],
             },
-            "required": ["location"],
         },
-    },
-}
-
-openai_format_tools = [get_weather_api]
-
+    }
+]
 
-def convert_tools(tools: List[Dict[str, Any]]):
-    converted = [json.dumps(tool["function"], ensure_ascii=False) for tool in tools]
-    return "\n".join(converted)
 
 # Helper function to create the system prompt for our model
 def format_prompt(tools: List[Dict[str, Any]]):
-    tools = convert_tools(tools)
-    return  TASK_PROMPT.format(tools=tools) + FORMAT_PROMPT
+    tools = "\n".join(
+        [json.dumps(tool["function"], ensure_ascii=False) for tool in tools]
+    )
+    return TASK_PROMPT.format(tools=tools) + FORMAT_PROMPT
+
 
-system_prompt = format_prompt(openai_format_tools)
+system_prompt = format_prompt(tools)
 
 messages = [
     {"role": "system", "content": system_prompt},
     {"role": "user", "content": "What is the weather in Seattle?"},
 ]
 
-inputs = tokenizer.apply_chat_template(
+model_inputs = tokenizer.apply_chat_template(
     messages, add_generation_prompt=True, return_tensors="pt"
 ).to(model.device)
 
-outputs = model.generate(
-    inputs,
-    max_new_tokens=512,
-    do_sample=False,
-    num_return_sequences=1,
-    eos_token_id=tokenizer.eos_token_id,
-)
+generated_ids = model.generate(**model_inputs, max_new_tokens=32768)
 
-response = tokenizer.decode(outputs[0][len(inputs[0]) :], skip_special_tokens=True)
-print(response)
-````
+generated_ids = [
+    output_ids[len(input_ids) :]
+    for input_ids, output_ids in zip(model_inputs.input_ids, generated_ids)
+]
 
-Then you should be able to see the following output string in JSON format:
-````python
-```json
-{"tool_calls": [{"name": "get_weather", "arguments": {"location": "Seattle"}}]}
-```
+response = tokenizer.batch_decode(generated_ids, skip_special_tokens=True)[0]
+print(response)
 ````
 
 # License