Skip to content

Commit 9ac4f87

Browse files
author
ChidcGithub
committed
Add local model support: Ollama and HuggingFace Transformers
- Add ProviderType.OLLAMA and ProviderType.HUGGINGFACE - Implement OllamaProvider with HTTP API support - Sync/async call and streaming - list_models() to enumerate available models - Tool calling via prompt simulation - Implement TransformersProvider for local HuggingFace models - Lazy model loading - Sync/async call and streaming with TextIteratorStreamer - Tool calling via prompt simulation - Update ProviderFactory to register new providers - Update create_provider() with ollama/huggingface support - Add 11 new tests for local model providers - Fix mypy type annotations with TYPE_CHECKING
1 parent 170c780 commit 9ac4f87

File tree

5 files changed

+1361
-5
lines changed

5 files changed

+1361
-5
lines changed

codegnipy/__init__.py

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -86,6 +86,8 @@
8686
BaseProvider,
8787
OpenAIProvider,
8888
AnthropicProvider,
89+
OllamaProvider,
90+
TransformersProvider,
8991
ProviderFactory,
9092
create_provider
9193
)
@@ -169,6 +171,8 @@
169171
"BaseProvider",
170172
"OpenAIProvider",
171173
"AnthropicProvider",
174+
"OllamaProvider",
175+
"TransformersProvider",
172176
"ProviderFactory",
173177
"create_provider",
174178
# Validation

0 commit comments

Comments
 (0)