Job Description
Job Title: AWS DevOps Engineer (Healthcare HIPAA/HL7 LLM)
Location: 100% Remote (U.S. Only No California) and Work Hours: EST Business Hours
Duration: 6-12+ Months
Rate: $Market/Hour
Required Skills:
AWS infrastructure at production scale: EKS or ECS, EC2 GPU instance families (G5/G6, P4d/P5) and their capacity realities, VPC design, IAM, KMS, Secrets Manager, ECR, CloudWatch, and Service Quotas.
Infrastructure as code: Terraform. No console-clicked production resources.
Model serving and inference optimization: Hands-on experience working with LLMs. Practical command of batching strategy, KV cache behavior, quantization tradeoffs, and multi-GPU sharding.
Container orchestration and GPU scheduling: ECS/EKS with GPU workloads, node autoscaling, and image build pipelines for CUDA-dependent stacks.
Reliability and cost engineering. SLOs, alerting, and a demonstrated track record of optimizing cloud spend without cutting capability.
Desirable Skills:
AWS SageMaker endpoints and Bedrock.
Hands-on experience with Python to contribute directly to the harness and the provider adapter layer.
Confidential computing fundamentals: Enclaves, remote attestation, sealed key release, and the security boundaries of TEEs.
Healthcare compliance posture: HIPAA-eligible service selection, BAA scope, audit logging, and the access-control mechanisms for PHI data.
Security hardening, including image scanning and network egress control for a closed-loop environment.
Nice to Have:
Prior experience hosting medical imaging or multimodal models.
Nitro Enclaves in production, or comparable TEE work.
Experience supporting self-service environments, clean tenancy boundaries, and fast credential provisioning.