projects · msemino

Local AI, agents and observability.

Self-hosted systems that run in production, not demos: RAG in regulated domains, LLM-in-the-loop agents, an MCP server a team queries daily. On owned hardware — private, zero cloud egress, $0 per query. Each one states what the design cost, not only what it does.

Part of my production work lives under confidentiality agreements. These are the projects I can open end to end — architecture, code, and the measurements behind them.

16 projects self-hosted · $0 API github.com/msemino
Marcelo Semino AI Platform Engineer · AIOps & Agentic AI · LLM / RAG linkedin.com/in/marcelosemino github.com/msemino m_semino@hotmail.com

AI in production

netbox-mcp
An MCP server a whole team queries, with the token on the server
Engineers ask their AI assistant which IPs are free in a subnet and it answers from live IPAM — not from a stale copy in a wiki. Read-only by construction, served over HTTP so nobody installs anything and the API token never reaches a laptop.
netbox-mcp.vercel.app
Infra-Sentinel
From watchdog to infrastructure agent
AI infrastructure watchdog: it observes Zabbix + Prometheus, reasons with a local LLM and proposes the exact remediation (command, where to run it, escalation). Human-in-the-loop.
infra-sentinel.vercel.app
insight-rag
Regulated-domain RAG, end to end, on a single 24 GB GPU
RAG + knowledge graph + compliance-aligned prompting + observability + a LoRA adapter of its own + versioned deployment. All on one GPU.
insight-rag-fawn.vercel.app
private-clinical-rag
Local RAG with citations and a refusal gate
A fully local pipeline for high-stakes manuals: hierarchical chunking, transparent re-ranking, cited answers, and refusal when the retrieved context is not enough.
private-clinical-rag.vercel.app
persistent-agent-memory
Two-layer persistent memory for AI agents
A portable lean summary loaded every session plus a canonical deep store fetched on demand, tied together by the deep ⊇ lean invariant and local semantic search (Ollama + LanceDB). The agent never starts from zero.
persistent-agent-memory.vercel.app
llm-chat-gateway
Web chat for a self-hosted LLM, in ~230 lines of stdlib
A dependency-free chat gateway to a self-hosted LLM. One GPU, a whole team, zero cloud egress.
llm-chat-gateway.vercel.app
local-agent-orchestrator
398 s → 33 s on a single 24 GB GPU
A 24/7 agent orchestrator with a local LLM brain — no commercial alignment layer — running on a single 24 GB GPU. The tuning that took it from 398 s to 33 s per reply.
local-agent-orchestrator.vercel.app

Ops & observability

Lab & personal automation

self-hosted-ai-lab
A two-node personal AI system (brain / body)
A 24/7 assistant driven from a phone chat that transcribes voice notes — on owned hardware. A mini-PC is the body; a GPU workstation is the brain.
self-hosted-ai-lab.vercel.app
llm-council
An LLM arena: they answer, grade each other, a chairman synthesizes
Your question goes to several LLMs in parallel, they grade each other anonymously and a chairman model synthesizes the best answer. Free models only. Also ships as a one-click portable Windows .exe.
llm-council-amber.vercel.app
agente-book
A Booking.com price auditor, deterministic and LLM-free
Extracts the price for a given party size, classifies availability and stores visual proof in ~10 s. Fully local, $0 in API cost. A LangGraph agent that stopped using an LLM.
agente-book.vercel.app
analisis-comp
Competitive price auditor: 8 properties in parallel
Scans 8 Booking.com listings in parallel, extracts prices filtered by capacity and emits JSON plus a text report. ~20 s per date, no LLM.
analisis-comp.vercel.app
whatsapp-voice-transcriber
WhatsApp voice notes → local text, zero cloud STT
Every WhatsApp voice note transcribed with local whisper.cpp on your own GPU, and the text comes back as a message. Fully private.
whatsapp-voice-transcriber-eight.vercel.app
local-voice-recorder
Speak, transcribe on GPU, text to clipboard. Fully local
A Windows tray app: you record, it transcribes on your GPU with whisper.cpp and the text lands straight in the clipboard. One click to start, one click to stop.
local-voice-recorder.vercel.app