Any examples using local models/OpenRouter?

[asmith26]

Hi there,

Just wondering if there are any example of using this library with local models e.g. via Ollama (or free offerings like OpenRouter.ai)?

Thanks!

[ultmaster]

If you are using APO, using local models via ollama is no different from using OpenAI models.

If you are using RL, vLLM is still the recommended approach to serve the model if trained with VERL. Ollama is not supported.