We are looking for a DevOps Engineer to own, scale, and secure our cloud and on-premise computing environments. You will work closely with ML researchers, data scientists, and software engineers to streamline model training, optimize GPU cluster utilization, and automate our continuous integration and deployment (CI/CD) pipelines.
Core Responsibilities AI & GPU Infrastructure Management: Provision, monitor, and scale high-performance GPU clusters (NVIDIA H100/A100, CUDA/ROCm setups) for heavy model training and inference workloads. MLOps & Model Serving Pipelines: Support model deployment, fine-tuning, and low-latency inference optimization using open LLM ecosystems (e.g., vLLM, Triton Inference Server, Llama, Mistral). CI/CD & Automation: Design, build, and maintain robust CI/CD pipelines for both software services and ML model artifacts using GitHub Actions, GitLab CI, or ArgoCD. Infrastructure as Code (IaC): Manage cloud resources (AWS, GCP, or Azure) repeatably using tools like Terraform or Pulumi. Containerization & Orchestration: Deploy, scale, and manage distributed containerized workloads using Kubernetes (K8s), Docker, and KubeFlow or Ray. Observability & Reliability: Implement logging, tracing, and metric dashboards (Prometheus, Grafana, OpenTelemetry) to track cluster health, GPU memory/utilization, and inference latency. Security & Governance: Enforce DevSecOps practices, secret management (HashiCorp Vault), container image scanning, and access controls tailored for sensitive AI datasets and models. Required Qualifications Experience: 3+ years of experience in DevOps, Site Reliability Engineering (SRE), or Cloud/Platform Engineering, with exposure to MLOps or AI/ML workloads. Cloud & Containers: Strong hands-on experience with AWS, GCP, or Azure, alongside production Kubernetes and Docker management. Scripting & Programming: Proficiency in Python, Bash/Shell, or Go for automation and tooling. IaC & CI/CD: Demonstrated mastery of Terraform, GitOps workflows, and automated testing/deployment pipelines. AI Ecosystem Knowledge: Familiarity with GPU node provisioning, distributed storage for massive datasets, and model serving runtimes. Preferred Qualifications Experience with LLM orchestration frameworks (LangChain, Ray Serve, vLLM). Bachelor's or Master’s degree in Computer Science, Computer Engineering, or a related technical field. Active cloud or Kubernetes certifications (e.g., CKA, AWS/GCP DevOps Engineer).
Apply: https://round1.work/listings/listing_tenant_a741427d-313d-41...
Flow Traders | C++ Senior Software Engineer | Hong Kong | Full Time | Visa | Relocation We are looking for a Senior C++ Software Engineer, you'll help design and optimize next-generation market data and execution platforms powering systematic trading across hundreds of venues. The role covers high performance market data ingestion and order execution, building and optimizing trading systems. To succeed you will need to have: - 5+ years of C++ experience in HFT/ financial sector -Strong knowledge in one or more APAC markets If you are interested, apply here: https://www.flowtraders.com/careers/job-description/8212740
Or if you'd like to see other roles at Flow Traders, please check our careers website: https://flowtraders.com/careers/