HPC/Kubernetes System Engineer (Top Secret)

RedLine Performance Solutions (RedLine) has been in the HPC solutions engineering services business for over 26 years and is consistently determined to keep the "bar of excellence" quite high for new hires. This enables RedLine to accomplish what other firms cannot and promotes a high level of staff retention. We offer services ranging from full life cycle HPC systems engineering to remote managed services to HPC program analysis. We are looking for an Kubernetes System Engineer to join us.RedLine is looking for an HPC/Kubernetes System Engineer to join us. The successful candidate will be responsible for the architecture, operation, and maintenance of a critical High-Performance Computing (HPC) and Kubernetes infrastructure. This role requires a deep understanding of cloud-native technologies, robust security practices, and large-scale system administration to maintain a secure and reliable platform.An active DoD Top Secret security clearance is a requirement to apply, as are current Linux+ and Security+ (or equivalent) certifications. This position on-site at the customer location in Aberdeen, Maryland. Reloation may be considered. This full-time position offers a full benefits package including paid time off, 401k match, and health care benefits.Job Responsibilities:Kubernetes platform architecture and operationsDesign, deploy, and operate highly available RKE2 Kubernetes clusters, including multi-control-plane environments with stable etcd quorumManage Kubernetes versioning upgrades and compatibility, along with cluster certificate authorities and trust chainsOversee complete lifecycle of Kubernetes nodes (cordon, drain, replacement) and operate container runtimes like containerdTune kubelet behavior, manage resource pressure, and ensure consistent node configuration across all environmentsNetworking, security, and identityDesign and operate Kubernetes networking (CNI), implement network policies for workload isolation, and manage ingress controllers and DNS configurationsImplement and enforce security best practices, including RBAC, admission controls, pod security standards, secrets management, and audit loggingPerform routine systems administration and apply necessary STIGs and OS maintenance to ensure compliance for CUI-level operationsIntegrate Kubernetes with enterprise identity services (LDAP/FreeIPA) and implement SSO with support for CAC/MFAData, CI/CD, and ReliabilityDesign and operate Kubernetes storage solutions using CSI drivers (Lustre, Weka), manage persistent volumes, and integrate S3 object storageOperate and maintain CI/CD infrastructure, including GitLab and container registries (Harbor, Artifactory), to support developer workflowsImplement comprehensive monitoring, logging, and alerting. Lead incident response, perform capacity planning, and maintain operational runbooksArchitect for high availability, define RPO/RTO, and implement robust backup, restore, and failover procedures for all stateful servicesIntegrate Kubernetes workloads with HPC schedulers like Slurm/PBS and enable seamless, secure job submission and identity mapping between platforms. Required Skills:Proven experience in systems administration, particularly in Linux-based environmentsExtensive hands-on experience designing, building, and operating production Kubernetes clustersDeep understanding of Kubernetes networking, security principles (RBAC, Network Policy, Pod Security Standards), and storage (CSI)Strong knowledge of container runtimes (containers) and the full node lifecycleExperience integrating applications and platforms with identity management systems like LDAP or FreeIPAFamiliarity with operating CI/CD pipelines and associated tools (e.g., GitLab, Artifactory, Harbor). Preferred Skills:Specific experience with RKE2 is highly desirableExperience working in secure, compliance-driven environments (e.g., CUI, DoD)Knowledge of integrating Kubernetes with HPC schedulers (Slurm, PBS) and high-performance storage (Lustre, Weka)Proficiency with observability stacks for monitoring, logging, and alertingExperience with Infrastructure as Code (IaC) and configuration management toolsDemonstrated ability to design and test high-availability and disaster recovery plans. To learn more about what makes RedLine a great place to work, please visit our website at https://redlineperf.com/careers/Total Rewards:Competitive salary band: $140,000 – $180,000/year dependent on experience and relocation needsMedical, dental & vision coverage with substantial company contributionCompany funded Healthcare Reimbursement Account (HRA)Paid time off (PTO) + 11 paid holidaysCompany Match 100% immediately vested retirement savings (401k)Employee wellness programs & gym discountsEmployee assistance & concierge servicesProfessional development resources