Job Title: Data Engineer
Location: [Weehawken – US]
Job Summary:
We're seeking a skilled Data Engineer to join our Data Engineering team, responsible for designing, building, and maintaining large-scale data systems. The ideal candidate will have expertise in Python, Unix scripting, SQL, and ETL processes. If you're passionate about working with data and building scalable solutions, we'd love to hear from you!
Key Responsibilities:
- Design, develop, and maintain large-scale data pipelines using Python, SQL, and ETL tools
- Write efficient and scalable code in Python, leveraging libraries like Pandas, NumPy, and PySpark
- Develop and maintain scripts in Unix shell scripting languages (e.g., Bash, Perl)
- Collaborate with data analysts and scientists to understand data requirements and deliver high-quality data solutions
- Optimize data processing workflows for performance, reliability, and scalability
- Ensure data quality, integrity, and security throughout the data pipeline
- Troubleshoot and resolve data-related issues in production environments
- Stay up to date with emerging trends and technologies in data engineering
Requirements:
- Bachelor's degree in computer science, Information Technology, or related field
- 5+ years of experience in data engineering, software development, or a related field
- Strong proficiency in:
- Python programming language
- Unix shell scripting languages (e.g., Bash, Perl)
- SQL and database design
- ETL tools and processes (e.g., Informatica, Talend)
- Experience with big data technologies (e.g., Hadoop, Spark) is a plus
- Strong problem-solving skills, attention to detail, and ability to work in a team environment
Nice to Have:
- Master's degree in computer science or related field
- Experience with cloud-based data platforms (e.g., AWS, GCP, Azure)
- Knowledge of data warehousing and business intelligence concepts
- Familiarity with agile development methodologies
- Certification in data engineering or related field