Commit 9ac4f87
ChidcGithub
Add local model support: Ollama and HuggingFace Transformers
- Add ProviderType.OLLAMA and ProviderType.HUGGINGFACE
- Implement OllamaProvider with HTTP API support
- Sync/async call and streaming
- list_models() to enumerate available models
- Tool calling via prompt simulation
- Implement TransformersProvider for local HuggingFace models
- Lazy model loading
- Sync/async call and streaming with TextIteratorStreamer
- Tool calling via prompt simulation
- Update ProviderFactory to register new providers
- Update create_provider() with ollama/huggingface support
- Add 11 new tests for local model providers
- Fix mypy type annotations with TYPE_CHECKING1 parent 170c780 commit 9ac4f87
File tree
5 files changed
+1361
-5
lines changed- codegnipy
- examples
- tests
5 files changed
+1361
-5
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
86 | 86 | | |
87 | 87 | | |
88 | 88 | | |
| 89 | + | |
| 90 | + | |
89 | 91 | | |
90 | 92 | | |
91 | 93 | | |
| |||
169 | 171 | | |
170 | 172 | | |
171 | 173 | | |
| 174 | + | |
| 175 | + | |
172 | 176 | | |
173 | 177 | | |
174 | 178 | | |
| |||
0 commit comments