Senior Software Engineer – ModelVault

ModelVault is building the world’s first fully-integrated, on-prem AI appliance — a plug-and-play AI server preloaded with software, models, and tools that let businesses (and eventually consumers) run powerful AI models locally, privately, and securely. We're looking for a Senior Software Engineer to help us build the core software stack that powers our on-prem systems.

• Design and build the software stack that ships with ModelVault’s on-prem AI systems
• Set up and manage integration with modern LLMs and vision models
• Build and maintain user-facing tooling: CLIs, lightweight GUIs, and APIs
• Make architecture decisions for system orchestration, hardware interfacing, remote update pipelines, and telemetry
• Help set up GPU drivers, OS configuration, and optimized inference runtimes
• Collaborate with the founding team to test and iterate with early business customers
• Contribute to hiring and scaling the engineering team over the next 12 months

• 5+ years of software engineering experience
• Experience working across the stack from OS-level setup and deployment to user-facing tools
• Experience with containerization, system packaging, deployment tooling, and managing model runtimes
• Experience with integrating LLMs and ML models in real-world systems
• Ability to drive architecture decisions and own large pieces of product infrastructure
• Thrive in ambiguity and are passionate about building great tools from scratch

• Help define a new category: secure, local AI for everyone
• Work on real, shipped hardware + software that users will touch
• Be part of the founding engineering team with high autonomy and deep ownership
• Fully remote, async-friendly environment