🚀 Local Multi-LLM Testing & Performance Tracker
Go to Workflow
Built by
Wildkick
Wildkick
Description
🚀 Local Multi-LLM Testing & Performance Tracker
This workflow is perfect for developers, researchers, and data scientists benchmarking multiple LLMs with LM Studio. It dynamically fetches active models, tests prompts, and tracks metrics like word count, readability, and response time, logging results into Google Sheets. Easily adjust temperature 🔥 and top P 🎯 for flexible model testing.
Level of Effort:
🟢 Easy – Minimal setup with customizable options.
Setup Steps:
Install LM Studio and configure models.
Update IP to connect to LM Studio.
Create a Google Sheet for result tracking.
Key Outcomes:
Benchmark LLM performance.
Automate results in Google Sheets for easy comparison.
Version 1.0
Nodes Used (5)
Basic LLM Chain
@n8n/n8n-nodes-langchain.chainLlm
Code
n8n-nodes-base.code
Google Sheets
n8n-nodes-base.googleSheets
HTTP Request
n8n-nodes-base.httpRequest
OpenAI Chat Model
@n8n/n8n-nodes-langchain.lmChatOpenAi