Senior Data Engineer
Atlan
This job is no longer accepting applications
See open jobs at Atlan.See open jobs similar to "Senior Data Engineer" Unreasonable.Data Science
India
Posted 6+ months ago
About the Role
- We are seeking a highly skilled Senior Data Engineer with expertise in Python and Airflow to join our team at Atlan. As a Senior Data Engineer, you will play a key role in driving the development and enhancement of our data management and workflow automation solutions using Python and Airflow.
What will you do?
- Lead the design, development, and implementation of Airflow packages and services
- Build and maintain the Python services related to data lineage and orchestration
- Work closely with the lineage and package team to implement the end-to-end needs of orchestration packages
- Do research and POC experiments on new orchestration and lineage-related products and libraries
- Mentor and guide junior team members, fostering a culture of technical excellence and continuous learning
- Collaborate with our orchestration partners for technical roadmap and implementation
- Contribute to open-source libraries and frameworks we use
- Work closely with design, product and Engineering Managers
What makes you a match for us?
- Strong experience as a Data Engineer with a focus on Python and Airflow.
- Proven expertise in designing and developing data pipelines and workflow automation using Apache Airflow.
- Solid understanding of data management concepts and data processing frameworks.
- Proficiency in Python programming and experience with related libraries and frameworks.
- Familiarity with database systems, both SQL and NoSQL, and experience with data modeling and database design.
- Experience in cloud platforms like AWS, Azure, or GCP is a plus.
- Strong problem-solving skills and the ability to tackle complex technical challenges.
- Excellent communication and collaboration skills, with the ability to work effectively in a team environment.
- Passion for delivering high-quality, scalable, and reliable software solutions.
- Bachelor's or Master's degree in Computer Science, Software Engineering, or a related field.
This job is no longer accepting applications
See open jobs at Atlan.See open jobs similar to "Senior Data Engineer" Unreasonable.