Role : Data Lead
Location : Knutsford
Contract Role
Job Description:
AWS Services : Glue, lambda, IAM, Service catalogue, Cloud formation, Lake formation, SNS, SQS, Event bridge
Language & scripting: Python and Spark
ETL : DBT
Good to have: Airflow, Snowflake, Big data(Hadoop) and Teradata
Responsibilities:
- Serve as the primary point of contact for all AWS related data initiatives and projects
- Responsible for leading a team of data engineers and analysts to design, implement, and maintain data solutions on the AWS platform
- Gather and analyze business requirements to develop scalable and efficient data solutions on AWS
- Design and implement data pipelines using various AWS services such as EMR, Glue, Kinesis, and Redshift
- Develop data models and ETL processes to efficiently transform and load data into AWS data lakes and data warehouses
- Work closely with cross-functional teams to identify opportunities for data-driven insights and optimize data processes
- Provide guidance and mentorship to junior team members on best practices for developing and deploying data solutions on AWS
- Stay up-to-date with the latest AWS data tools and technologies and make recommendations for their integration into existing processes
- Monitor and maintain data quality across all data systems and investigate any discrepancies or issues
- Collaborate with IT teams to ensure data security and compliance with relevant regulations and policies
- Participate in the development and implementation of data governance policies and procedures
Qualifications:
- Bachelor's or Master's degree in Computer Science, Information Systems, or a similar field
- Minimum of 8 years of experience in a data engineering or data management role, with at least 7 years of experience specifically in an AWS environment
- Strong proficiency in SQL and experience with designing and maintaining data warehouses and data lakes
- In-depth knowledge of AWS services such as EMR, Glue, Kinesis, and Redshift
- Hands-on experience with data pipeline development, ETL processes, and data modeling on AWS
- Strong leadership and project management skills with the ability to effectively lead a team and manage multiple projects simultaneously
- Excellent problem-solving and communication skills with the ability to collaborate with cross-functional teams and present complex technical information to non-technical stakeholders
- Experience with data visualization tools such as Tableau or Power BI is a plus
- AWS certifications (e.g. AWS Certified Big Data - Specialty) is a plus