Senior Software Engineer - Infrastructure
Join to apply for the Senior Software Engineer - Infrastructure role at Julius AI.
Base pay range
$160,000/yr - $200,000/yr
About Julius
We're an applied AI lab building coding agents. Julius executes 1M lines of code every 36 hours for 1M+ users and has generated 3M+ visualizations. All code runs in isolated remote containers that we manage. We're revenue generating and backed by AI Grant and founders from Vercel, Notion, Perplexity, Palantir, Replit, Zapier, Intercom, and Dropbox.
The Role
Build and scale the code execution platform that powers Julius-across cloud and on prem environments. We orchestrate 500k+ containers/month and growing. You'll own reliability, performance, and security for multi tenant compute.
What You'll Do
- Design and operate secure, multi tenant container infrastructure with fast startup and smart autoscaling.
- Ship on prem/private cloud deployments (Helm/Terraform) with SSO, network controls, and audit logging.
- Drive observability (metrics, traces, logs) with clear SLOs; lead incident response.
- Optimize images, scheduling, networking, and cost; build fair use and rate limiting controls.
What You Bring
- Production Kubernetes and container internals (Docker/containerd); strong networking fundamentals.
- Cloud (AWS/GCP/Azure) and IaC (Terraform/Helm).
- Monitoring/Logging (Prometheus, Grafana, OpenTelemetry, ELK/Vector).
- Security best practices for containerized, multi tenant systems.
Nice to Have
- gVisor/Kata/Firecracker; Cilium/eBPF; GPU scheduling; serverless autoscaling (KEDA/Knative/Karpenter).
- Experience with on prem or air gapped enterprise software.
- Background in AI side projects and LLM tinkering.
Benefits
Health & dental, gym reimbursement, daily team lunches, 401(k).
Why Julius
Small senior team; massive impact surface; hard infra problems at meaningful scale.