We are looking for Data Engineer with primary skills as Scala and AWS and secondary skills – Python, Spark, NoSQL, Kafka, Athena, Airflow
Location - London or Edinburg.
Please find below detailed JD:
Advanced knowledge and working experience of
- Hive
- Spark
- EMR
- DynamoDB
- S3
- DB migration service
- Redshift
- Data pipeline
- MySQL, Postgres, MS SQL 2016
- Glue
- Kinesis, Kafka
- Scala
- Expertise in Spark coding and Functional Programming
- Expertise in python coding
- Advanced knowledge of Linux tools
- Good understanding of AWS components e.g. Sagemaker, SecretsManager, dynamo, hive, GIT, Elasticbeanstalk, ECR / ECS, EC2, SQS, Lambda, cloudwatch, ELB, Elasticache, Step functions
- Advanced SQL coding