Job Title: Azure Data Engineer
Experience: 3-8 years
Job Description:
As an Azure Data Engineer at Infosys, you will be responsible for designing, developing, and implementing scalable data solutions using Microsoft Azure. You will work closely with business stakeholders and technical teams to build modern data pipelines, optimize data storage, and ensure efficient data processing for analytics and reporting.
Roles & Responsibilities:
- Design, develop, and maintain data pipelines and ETL processes on Azure.
- Work with Azure Data Factory (ADF), Azure Synapse, Azure Databricks, and other Azure services to build scalable data solutions.
- Develop data models, warehouse solutions, and lakehouse architectures for structured and unstructured data.
- Optimize data storage and processing using Azure Blob Storage, Data Lake, and SQL databases.
- Implement data governance, security, and compliance best practices.
- Collaborate with business analysts, data scientists, and developers to ensure high-quality data availability.
- Monitor and troubleshoot performance issues in data pipelines.
Required Skills & Qualifications:
- 3+ years of experience in data engineering with expertise in Azure data services.
- Strong experience with Azure Data Factory (ADF), Azure Synapse, Databricks, and SQL Server.
- Proficiency in Python, SQL, or Spark for data transformation.
- Hands-on experience with ETL development, data warehousing, and data modeling.
- Knowledge of data governance, security, and compliance best practices.
- Experience with Azure DevOps and CI/CD pipelines is a plus.
- Strong analytical and problem-solving skills.
Preferred Skills:
- Experience with Big Data technologies (Hadoop, Spark).
- Knowledge of Machine Learning and AI on Azure.
- Azure certifications like Azure Data Engineer Associate (DP-203) are a plus.