Senior DevOps Engineer

<h1>About the role</h1> <p>The Senior DevOps Engineer will be responsible for enhancing and scaling the infrastructure powering Rhino’s Federated Computing Platform (Rhino FCP). This distributed infrastructure supports cutting-edge AI/ML research and development across highly regulated industries, including healthcare, finance, and life sciences, by enabling secure, privacy-preserving data collaboration around the world.</p> <p>You will oversee a fleet of installations deployed behind the firewalls of partner organizations, alongside a centralized cloud orchestration layer and advanced CI/CD pipelines, monitoring systems, and deployment tooling. You'll collaborate closely with backend engineers, as many infrastructure components are tightly integrated with the FCP’s core capabilities.</p> <p>This role involves end-to-end ownership: from architecture and design to implementation and support. It’s ideal for someone who thrives in fast-paced environments, loves working with modern infrastructure, and is excited to drive innovation in secure, distributed AI platforms.</p> <h3><strong>Key Responsibilities</strong></h3> <ul> <li><strong>End-to-End Infrastructure Ownership:</strong> Take full ownership of infrastructure components - from initial ideation and architectural design through implementation and automated deployment, across diverse technologies and geographically distributed environments.</li> <li><strong>Scalability and Enhancement:</strong> Continuously enhance and scale the platform’s underlying infrastructure by implementing updates, driving performance improvements, and integrating new platform capabilities to support product growth.</li> <li><strong>Maximize Development Velocity:</strong> Design, improve, and maintain DevOps tooling and workflows (CI/CD pipelines, configuration management) to significantly boost development velocity and streamline the engineering process.</li> <li><strong>Distributed Deployment Management:</strong> Oversee and manage all platform deployments, ensuring consistency and reliability across local installations at client sites and within the centralized cloud orchestration layer.</li> <li><strong>Product Development:</strong> Collaborate closely with Backend and Frontend Engineering teams to co-develop platform features that have significant infrastructure dependencies, ensuring new capabilities are designed and implemented with built-in scalability and operational tooling.</li> <li><strong>Establish Foundational Quality:</strong> Ensure observability, scalability, and security are deeply integrated and prioritized across the design, implementation, and operation of all infrastructure layers.</li> </ul> <h1>&nbsp;</h1> <h1>About the candidate</h1> <p>Candidates should have 5+ years of professional experience with a mix of the experiences described below:</p> <ul> <li>5+ years of experience in DevOps engineering with clouds, GCP/AWS preferred</li> <li>5+ years of experience designing and developing infrastructure components with Kubernetes (Including solid understanding of CRD on different Kubernetes platforms)</li> <li>Extensive experience with Linux, Docker/ContainerD</li> <li>5+ years of experience with Python</li> <li>5+ years of experience working with IaC and CM tools (Terraform, Terragrunt, Ansible)</li> <li>5+ years of experience implementing monitoring solutions (Prometheus/VictoriaMetrics, Grafana, GoAlert, etc) and logging systems (VictoriaLogs or similar, Filebeat/FluentBit/Vector, etc.)</li> <li>3+ years of experience with CI/CD tools like GitHub Actions</li> <li>3+ years of experience with GitOps tools (ArgoCD)</li> <li>Deep understanding of networking and experience developing infrastructure with non-trivial networking components (e.g. WireGuard VPN, NGINX passthrough, mTLS, gRPC, confidential computing environments, etc)</li> <li>Experience working in a startup environment</li> <li>Advantage for experience developing AI/ML-based products or platforms</li> <li>Advantage for experience developing distributed systems</li> <li>Advantage for experience developing products with a focus on data security and privacy (e.g., PII data protection)</li> <li>The role is open to candidates who are based in Israel (hybrid work environment)</li> </ul>