AI / Local LLM
Featured Project
UlterNet Local LLM Assistant
Private local AI stack using Llama 3.2, Whisper, an OpenAI-compatible API, and desktop assistant workflows.
Client
UlterNet Systems
Date
May 2026
Technologies
Llama 3.2
Python
FastAPI
PyTorch
Whisper
Electron
React
TypeScript
OpenAI-Compatible API
Project Overview
Built a local AI assistant stack around Llama 3.2 3B Instruct running on CPU with an OpenAI-compatible FastAPI server, plus optional Whisper transcription and an Electron desktop assistant. The system supports private local inference, model checkpoint management, runtime scripts, integrity verification, local chat completion endpoints, and application integrations that need AI without sending data to external providers. The desktop layer combines React, Electron, screenshots, OCR, local LLM providers, and workflow shortcuts for real-time support.
Project Details
Technologies Used
Llama 3.2
Python
FastAPI
PyTorch
Whisper
Electron
React
TypeScript
OpenAI-Compatible API
Working on something similar?
Tell us what systems you’re using and what you need them to do.
Talk to usMore work
Other systems and platforms we’ve built.
Education Systems & Moodle
Moodle LMS Integration
A Moodle 5.x integration connecting the LMS to student records, Business Central, timetable and workload systems, and results management.
View Project
Property Management Platform
Payserve Property Management
A property management platform for units, tenants, billing, payments and operational reporting.
View Project
Point of Sale System
UlterPOS
A point-of-sale system covering sales, inventory, purchasing, payments and reporting.
View Project
Open-Source Multi-Tenant CMS
Lyra CMS
A lightweight CMS for managing several websites from one place without rebuilding the same setup every time.
View Project