Data Engineer (BA with Capital Market & SQL Knowledge) at N Consulting Ltd

Job description

As a Data Engineer, you will be responsible for the following duties:

- Designing, developing, and maintaining data pipelines and ETL processes
- Collaborating with cross-functional teams to gather requirements and understand data needs
- Building and optimizing data models and databases for efficient storage and retrieval
- Writing complex SQL queries to extract, transform, and load data from various sources
- Developing scripts and automation tools to support data integration and processing
- Implementing data quality checks and ensuring data integrity and accuracy
- Performing data analysis to identify trends, patterns, and insights
- Troubleshooting and resolving data-related issues in a timely manner

```Skills```
To excel in this role, you should possess the following skills:

- Strong proficiency in SQL for data manipulation and analysis
- Experience with programming languages such as Java or Python for scripting and automation
- Knowledge of ETL tools like Informatica for data integration and transformation
- Familiarity with data warehousing concepts and methodologies
- Understanding of big data technologies like Hadoop or Spark for large-scale data processing
- Hands-on experience with cloud platforms like AWS for deploying and managing data infrastructure
- Proficiency in Shell scripting for automating tasks and workflows
- Ability to analyze complex datasets and derive meaningful insights
- Strong problem-solving skills with attention to detail

- Capital markets experience must.