Job Title: Cloud Data Engineer (Kubernetes / Trino)
Location: EMEA
Type: Full Time
Job Summary and Technology Stack
Client intends to introduce Trino (open-source distributed SQL engine) as a shared service to provide teams with secure, scalable access to Azure Data Lake tables via a SQL TCP endpoint.
The deployment will be based on Azure Kubernetes Service (AKS), with high availability, modern authentication, multi-tenancy support, and strong workload isolation.
Integration with Azure DevOps will drive CI/CD automation. Observability and telemetry will be key focus areas, working closely with the SRE and observability teams to ensure production-grade reliability.
The service must successfully pass Client’s Service Launch Criteria process, including security, networking, and cloud cost reviews.
The selected engineers will be responsible for:
- Designing, deploying, and maintaining Trino clusters on AKS with HA and workload isolation.
- Implementing authentication, authorization, and tenancy features for multi-team usage.
- Ensuring seamless integration with Azure Data Lake and internal security standards.
- Collaborating with observability/telemetry teams to implement monitoring, alerting, and tracing.
- Working with the SRE team to troubleshoot production issues and maintain service SLAs.
- Driving compliance with internal Service Launch Criteria (security reviews, cost approvals, etc.).
Key Responsibilities of the selected candidate
- Deploy and scale Trino clusters on Azure AKS with HA setup.
- Configure secure access to Azure Data Lake via SQL endpoint.
- Implement multi-tenancy and workload isolation for multiple team use.
- Integrate Azure AD / modern auth for user and service identity management.
- Collaborate on observability: metrics, logs, distributed tracing.
- Troubleshoot and resolve production issues across networking, authentication, and workloads.
- Manage infrastructure automation using Azure DevOps pipelines.
- Contribute to internal governance, security review, and cost approval processes.
Skills and experience:
- 8+ years of experience in Cloud Infrastructure / DevOps Engineering.
- 5+ years of Kubernetes experience (AKS preferred) covering deployment, scaling, security, RBAC, and HA workloads.
- Strong knowledge of Azure services: AKS, Azure AD, Networking (VNet, NSG, Subnets), Storage, Key Vault, Monitoring, and Cost Management.
- Experience with SQL engines, preferably Trino, Presto, or similar distributed query engines.
- Hands-on experience with infrastructure as code (Terraform).
- Experience integrating with observability platforms (Prometheus, Grafana, Azure Monitor, or similar).
- Strong troubleshooting experience in production distributed systems.
- Experience in CI/CD pipelines with Azure DevOps.
Must to have skillsets:
- Kubernetes (AKS) HA deployment and operations.
- Strong Azure Cloud expertise (networking, auth, storage, monitoring).
- Infrastructure as Code (Terraform, Azure DevOps).
- Production troubleshooting skills (networking, auth, distributed systems).
Good to have skillsets
- Experience with SQL engines (Trino, Presto, or equivalent).
- Experience with multi-tenant service design.
- Observability / telemetry tooling expertise.
- Knowledge of data engineering / lakehouse patterns.
Soft skills:
- Strong problem-solving and troubleshooting abilities.
- Ability to work independently and collaborate across multiple teams (SRE, observability, data engineering).
- Clear communication and documentation skills for cross-team coordination.
- Flexibility to adapt in a dynamic environment with evolving requirements.
- Proactive mindset for automation, cost optimization, and security.
Technical evaluation – focused on
- Terraform
- Kubernetes
- Azure infrastructure knowledge
- Best practices in operations and maintainability