As a Data Engineer, you will design, develop, and maintain our data infrastructure, ensuring efficient data processing and analysis. You will work closely with data scientists and software engineers to deliver high-quality data solutions that drive business decisions.
Responsibilities:
- Design, build, and maintain scalable data pipelines using Python, Spark, and AWS services.
- Develop and implement data quality checks and monitoring systems.
- Collaborate with data scientists to understand data requirements and optimize data delivery.
- Work in an Agile environment and contribute to the continuous improvement of our data infrastructure.
Ideal Profile:
- 3+ years of experience as a Data Engineer or in a similar role.
- Strong programming skills in Python and experience with Spark.
- Hands-on experience with AWS services like S3, EC2, EMR, and Redshift.
- Proficiency in SQL and data modeling techniques.
- Excellent communication and collaboration skills.