Route chat prompts to free LLMs with Agnes AI, NVIDIA, and Ollama

Go to Workflow
0 views
Built by Daniele Crupi Daniele Crupi
Created on August 13, 2026

Description

Quick overview
This workflow provides a simple AI playground where users can choose between several free LLM options—NVIDIA Integrate chat completions, Agnes AI chat completions, a local Ollama model, or an Ollama Cloud model via a LangChain agent with memory—enter a prompt, and receive the generated response directly in the form.

How it works
Choose an AI model from the n8n Form.
Enter your prompt and submit the form.
The workflow routes the prompt to the selected free AI model.
The generated response is displayed directly on the form completion page.
Sends the user prompt to NVIDIA, Agnes, Ollama local and Ollama cloud endpoint and returns the first completion back to the form.

Setup
Add an NVIDIA API bearer token credential and select it in the NVIDIA HTTP Request step.
Add an Agnes AI bearer token credential and select it in the Agnes AI HTTP Request step.
If using local Ollama, install Ollama, pull the referenced model (for example gemma4:latest), and update the Ollama base URL if your n8n instance cannot reach http://host.docker.internal:11434.
Add Ollama Cloud (Ollama API) credentials and ensure the selected model (gemma4:31b) is available to your account.

Nodes Used (3)

AI Agent
@n8n/n8n-nodes-langchain.agent
HTTP Request
n8n-nodes-base.httpRequest
Ollama Chat Model
@n8n/n8n-nodes-langchain.lmChatOllama