Gladius Thayalarajan

Gladius Thayalarajan

Platform & AI Infrastructure Engineer

14+ years building distributed systems and AI infrastructure. I specialize in self-hosted LLM runtimes, Kubernetes-native platforms, and production systems at scale.

What I work on

AI Infrastructure

Self-hosted LLMs, RAG pipelines, inference routing, multimodal systems (ASR/TTS/vision). Privacy-first, model-agnostic architectures.

Platform Engineering

Kubernetes, multi-tenant isolation, workflow orchestration, CI/CD, secrets management, observability at scale.

Distributed Systems

Event-driven architectures, message queues, database scaling, high-availability systems, and production reliability.

Experience

Reasyn AI
Creator & Lead Architect

Building a deterministic workflow orchestration engine in Rust with precompiled graphs for low-latency execution. Designing self-hosted, model-agnostic AI runtime with confidence-based routing.

Stateset
Head of Platform Infrastructure

Led architecture of Stateset Cloud, a Kubernetes-based multi-tenant platform for self-service deployment of backend services, workflows, and AI workloads.

Verizon
Software Solutions Architect

Architected AI-driven geospatial address correction pipeline. Led early Kubernetes adoption and cloud-native architecture initiatives across production systems.