We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
1 parent 0844a68 commit 97768d2Copy full SHA for 97768d2
1 file changed
notebooks/tps/chatbot/.teacher/README-ollama.md
@@ -20,3 +20,22 @@ ollama pull gemma2:2b
20
ollama pull mistral:7b
21
ollama pull deepseek-r1:7b
22
```
23
+
24
+## testing
25
26
+Using `http` (from `pip install httpie`) you can reach both instances from the command line like so:
27
28
+```bash
29
30
+# the CPU
31
+http http://ollama.pl.sophia.inria.fr:8080/api/generate model=mistral:7b prompt="Hey"
32
33
+# the GPU
34
+http https://Bob:hiccup@ollama-sam.inria.fr/api/generate model=mistral:7b prompt="Hey"
35
36
+# in streaming mode: CPU
37
+http -S http://ollama.pl.sophia.inria.fr:8080/api/generate model=mistral:7b prompt="Hey" stream:=true
38
39
+# in streaming mode: GPU
40
+http -S https://Bob:hiccup@ollama-sam.inria.fr/api/generate model=mistral:7b prompt="Hey" stream:=true
41
+```
0 commit comments