devopsforflops commited on
Commit
32bf06e
·
verified ·
1 Parent(s): 7fdb7b3

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +92 -0
README.md ADDED
@@ -0,0 +1,92 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ base_model: google/functiongemma-270m-it
4
+ tags:
5
+ - gemma
6
+ - function-calling
7
+ - tool-use
8
+ - gguf
9
+ - ollama
10
+ model-index:
11
+ - name: delia-functiongemma-270m-gguf
12
+ results: []
13
+ ---
14
+
15
+ # Delia FunctionGemma 270M - GGUF
16
+
17
+ This is the GGUF version of [delia-functiongemma-270m](https://huggingface.co/devopsforflops/delia-functiongemma-270m), fine-tuned for Delia MCP tool orchestration.
18
+
19
+ ## Quick Start with Ollama
20
+
21
+ ```bash
22
+ # Download the GGUF file
23
+ wget https://huggingface.co/devopsforflops/delia-functiongemma-270m-gguf/resolve/main/functiongemma-delia-f16.gguf
24
+
25
+ # Create Modelfile
26
+ cat > Modelfile << 'MODELFILE'
27
+ FROM ./functiongemma-delia-f16.gguf
28
+
29
+ TEMPLATE """{{ if .System }}<start_of_turn>developer
30
+ {{ .System }}
31
+ <end_of_turn>
32
+ {{ end }}<start_of_turn>user
33
+ {{ .Prompt }}
34
+ <end_of_turn>
35
+ <start_of_turn>model
36
+ """
37
+
38
+ PARAMETER stop <end_of_turn>
39
+ PARAMETER stop <start_of_turn>
40
+ PARAMETER temperature 0.1
41
+ PARAMETER num_ctx 2048
42
+ MODELFILE
43
+
44
+ # Import to Ollama
45
+ ollama create functiongemma-delia -f Modelfile
46
+
47
+ # Test it
48
+ ollama run functiongemma-delia "Hello!"
49
+ ```
50
+
51
+ ## Model Details
52
+
53
+ | Property | Value |
54
+ |----------|-------|
55
+ | Base Model | google/functiongemma-270m-it |
56
+ | Architecture | Gemma3 |
57
+ | Parameters | 268M |
58
+ | Quantization | F16 (full precision) |
59
+ | File Size | ~518 MB |
60
+ | Context Length | 2048 tokens |
61
+
62
+ ## Training
63
+
64
+ Fine-tuned using LoRA on Delia MCP tool calling examples:
65
+ - LoRA rank: 16
66
+ - LoRA alpha: 64
67
+ - Epochs: 20
68
+ - Dataset: 27 training examples from Delia test suite
69
+
70
+ ## Use with Delia
71
+
72
+ Add to your Delia `settings.json`:
73
+
74
+ ```json
75
+ {
76
+ "model_dispatcher": {
77
+ "name": "functiongemma-delia",
78
+ "num_ctx": 2048
79
+ }
80
+ }
81
+ ```
82
+
83
+ **Important:** The model name must contain "functiongemma" for Delia to apply the correct prompt formatting.
84
+
85
+ ## Related Models
86
+
87
+ - [delia-functiongemma-270m](https://huggingface.co/devopsforflops/delia-functiongemma-270m) - Full merged HuggingFace model
88
+ - [delia-functiongemma-270m-lora](https://huggingface.co/devopsforflops/delia-functiongemma-270m-lora) - LoRA adapter only
89
+
90
+ ## License
91
+
92
+ Apache 2.0