We are seeking experienced Data Engineers with strong expertise in Apache Spark, AWS, Kubernetes/EKS, and Big Data platforms.
About the RoleThe Data Engineer will be responsible for designing, building, and maintaining scalable data pipelines and architectures to support our data-driven initiatives.
Responsibilities- 5+ years of Data Engineering experience
- Strong hands-on experience with Apache Spark
- Experience with Amazon EKS / EMR on EKS
- Big Data technologies: Hadoop, Hive, Trino
- Strong Python or Scala development skills
- Advanced SQL (window functions, joins, complex queries)
- Kubernetes administration and troubleshooting
- AWS services: S3, EMR, Glue, Athena, Lambda
- Experience processing large-scale datasets and tuning Spark jobs
- Familiarity with AI tools such as GitHub Copilot, ChatGPT, Claude, or Amazon Q
Required Skills- 5+ years of Data Engineering experience
- Strong hands-on experience with Apache Spark
- Experience with Amazon EKS / EMR on EKS
- Big Data technologies: Hadoop, Hive, Trino
- Strong Python or Scala development skills
- Advanced SQL (window functions, joins, complex queries)
- Kubernetes administration and troubleshooting
- AWS services: S3, EMR, Glue, Athena, Lambda
- Experience processing large-scale datasets and tuning Spark jobs
- Familiarity with AI tools such as GitHub Copilot, ChatGPT, Claude, or Amazon Q
Preferred Skills- CI/CD (GitLab, Jenkins, GitHub Actions, ArgoCD)
- Terraform / Infrastructure as Code
- Docker, Prometheus, Grafana
- Spark on Kubernetes
- Financial Services experience