Role: Senior Streaming Data Engineer (AWS / Apache Flink)
Location: London
Duration: Contract (2-3 months)
Skills Requirements
1. MSF (Managed Service for Apache Flink)
2. Data analytics expertise
3. MSK (Managed Streaming for Apache Kafka), Amazon Redshift, Amazon Aurora
4. CI/CD expertise & CloudFormation
5. Machine Learning is good to have
6. Usage of Kiro IDE
- Analyze and organize raw, complex data
- Develop and maintain architectures such as databases and processing systems
- Implement systems for tracking data quality and consistency
- Collaborate with data scientists and architects on several projects
- Develop data set processes and use programming skills to build robust data pipelines
- Design, construct, install, test and maintain data management systems
- Build high-performance algorithms, predictive models, and prototypes
- Ensure the business uses the data responsibly and complies with data protection regulations
Qualifications:
- Bachelor’s degree in Computer Science, Software Engineering or related field
- At least 8 years of experience in data engineering or in a similar role
- Experience with big data tools: Hadoop, Spark, Kafka, etc.
- Experience with relational SQL and NoSQL databases, including Postgres and Cassandra
- Knowledge of programming languages including Java, Python, etc
- Experience with AWS cloud services: S3, EC2, EMR, RDS, Redshift
- Experience with stream-processing systems: Storm, Spark-Streaming, etc
- Strong organizational and communication skills
- Ability to work in a fast-paced, agile environment
Benefits:
- Innovative and dynamic work environment
- Continued professional development opportunities
- Competitive compensation package
- Comprehensive health and benefits package
- Flexible work hours and remote work options
- Team building and social activities
As a Streaming Data Engineer at N Consulting Ltd, you will have the opportunity to be part of a diverse and dedicated team, working at the forefront of data processing technologies. Our company culture is inclusive and innovative, where every employee is valued and has a tangible impact on the services we provide to our clients.