Senior Data Engineer
Atlan
This job is no longer accepting applications
See open jobs at Atlan.See open jobs similar to "Senior Data Engineer" Unreasonable.Data Science
India
Posted on Aug 17, 2023
About the Role
- We are seeking a highly skilled Senior Data Engineer with expertise in Python and Airflow to join our team at Atlan. As a Senior Data Engineer, you will play a key role in driving the development and enhancement of our data management and workflow automation solutions using Python and Airflow.
What will you do?
- Lead the design, development, and implementation of Airflow packages and services
- Build and maintain the Python services related to data lineage and orchestration
- Work closely with the lineage and package team to implement the end-to-end needs of orchestration packages
- Do research and POC experiments on new orchestration and lineage-related products and libraries
- Mentor and guide junior team members, fostering a culture of technical excellence and continuous learning
- Collaborate with our orchestration partners for technical roadmap and implementation
- Contribute to open-source libraries and frameworks we use
- Work closely with design, product and Engineering Managers
What makes you a match for us?
- Strong experience as a Data Engineer with a focus on Python and Airflow.
- Proven expertise in designing and developing data pipelines and workflow automation using Apache Airflow.
- Solid understanding of data management concepts and data processing frameworks.
- Proficiency in Python programming and experience with related libraries and frameworks.
- Familiarity with database systems, both SQL and NoSQL, and experience with data modeling and database design.
- Experience in cloud platforms like AWS, Azure, or GCP is a plus.
- Strong problem-solving skills and the ability to tackle complex technical challenges.
- Excellent communication and collaboration skills, with the ability to work effectively in a team environment.
- Passion for delivering high-quality, scalable, and reliable software solutions.
- Bachelor's or Master's degree in Computer Science, Software Engineering, or a related field.
This job is no longer accepting applications
See open jobs at Atlan.See open jobs similar to "Senior Data Engineer" Unreasonable.