Data Engineer

2 weeks ago

Pune, India Rapsys Technologies Full time

We're Hiring : Data Engineer (Python + Airflow + Snowflake)

We are seeking an experienced Data Engineer to design, build, and maintain robust data pipelines and infrastructure.

The ideal candidate will have expertise in Python, Apache Airflow, and Snowflake to support our data-driven initiatives and ensure seamless data flow across the organization.

Location : Pune, India.

Work Mode : Work From Office.

Role : Data You'll Do :

Python + Airflow + Snowflake Data Engineer.

We are seeking a highly skilled Python / Airflow Data Engineer with 7 to 8 years of experience, specifically with a strong background in AWS technologies.

The ideal candidate will have a deep understanding of Apache Airflow and its integration within AWS ecosystem, enabling efficient data pipeline orchestration and management.

Responsibilities :


- Design, develop, and maintain complex data pipelines using Python for efficient data processing and orchestration.

- Collaborate with cross-functional teams to understand data requirements and architect robust solutions within the AWS environment.

- Implement data integration and transformation processes to ensure optimal performance and reliability of data pipelines.

- Optimize and fine-tune existing data pipelines / Airflow to improve efficiency, scalability, and maintainability.

- Troubleshoot and resolve issues related to data pipelines, ensuring smooth operation and minimal downtime.

- Work closely with AWS services like S3, Glue, EMR, Redshift, and other related technologies to design and optimize data infrastructure.

- Develop and maintain documentation for data pipelines, processes, and system architecture.

- Stay updated with the latest industry trends and best practices related to data engineering and AWS services.

Requirements :


- Bachelors degree in Computer Science, Engineering, or a related field.

- Proficiency in Python, PySpark and SQL for data processing and manipulation.

- Min 5 years of experience in data engineering, specifically working with Apache Airflow and AWS technologies.

- Strong knowledge of AWS services, particularly S3, Glue, EMR, Redshift, and AWS Lambda.

- Understanding of Snowflake Data Lake is preferred.

- Experience with optimizing and scaling data pipelines for performance and efficiency.

- Good understanding of data modeling, ETL processes, and data warehousing concepts.

- Excellent problem-solving skills and ability to work in a fast-paced, collaborative environment.

- Effective communication skills and the ability to articulate technical concepts to non-technical stakeholders.

Preferred Qualifications :


- AWS certification(s) related to data engineering or big data.

- Experience working with big data technologies like Snowflake, Spark, Hadoop, or related frameworks.

- Familiarity with other data orchestration tools in addition to Apache Airflow.

- Knowledge of version control systems like Bitbucket, Git.


(ref:hirist.tech)

  • Data Engineer

    2 weeks ago

    Pune, India Data Axle Full time

    About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging...

  • Data Engineer

    2 weeks ago

    Pune, India Jash Data Sciences Full time

    Do you love solving real-world data problems with the latest and best techniques? And having fun while solving them in a team Then come join our high-energy team of passionate data people. Jash Data Sciences is the right place for you. We are a cutting-edge Data Sciences and Data Engineering startup based in Pune, India. We believe in continuous learning and...

  • Data Engineer

    4 days ago

    Pune, Maharashtra, India Jash Data Sciences Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Do you love solving real-world data problems with the latest and best techniques? And having fun while solving them in a team Then come join our high-energy team of passionate data people. Jash Data Sciences is the right place for you.We are a cutting-edge Data Sciences and Data Engineering startup based in Pune, India.We believe in continuous learning and...

  • Senior Data Engineer

    17 hours ago

    Pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • Data Engineer

    2 weeks ago

    Pune, Maharashtra, India NTT DATA Full time

    Req ID 324612NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Data Engineer to join our team in Pune Mahxc4x81rxc4x81shtra IN-MH India IN Key Responsibilities Design and...

  • Data Operations Engineer

    2 weeks ago

    Pune, India Mars Data Insights Full time

    Title: Data Operations Engineer & RUN Support Skills: Data Operations Engineering, data manipulation, Python, Talend, GCP, Bigquery, DataIku, ITSM/ticketing tools, Helix, Jira, task management, data pipelines,  RUN Service, data infrastructure, data quality  Job Location: Pune  Job Type: Fulltime/Hybrid  Work Experience: 5+ years  We are seeking a...

  • Data Operations Engineer

    4 days ago

    Pune, Maharashtra, India Mars Data Insights Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Title: Data Operations Engineer & RUN SupportSkills:Data Operations Engineering, data manipulation, Python, Talend, GCP, Bigquery, DataIku, ITSM/ticketing tools, Helix, Jira, task management, data pipelines,  RUN Service, data infrastructure, data quality Job Location:Pune Job Type:Fulltime/Hybrid Work Experience:5+ years We are seeking a highly...

  • Mid Data Science

    20 hours ago

    Pune, India NTT DATA Full time

    Job Description Req ID:     NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Mid Data Science & AIML, GenAI Lead/Engineer to join our team in Pune, Mahārāshtra (IN-MH), India...

  • Mid Data Science

    12 hours ago

    Pune, India NTT DATA Full time

    Job Description Req ID:     NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Mid Data Science & AIML, GenAI Lead/Engineer to join our team in Pune, Mahārāshtra (IN-MH),...

  • Data Dynamics

    2 weeks ago

    Pune, India Data Dynamics Full time

    About the Role : We are seeking a Senior Software Engineer to join our team in Pune. As a key member of our engineering group, you will play a crucial role in the entire software development lifecycle, from initial design to hands-on development. You will work with cross-functional teams to create innovative solutions that are scalable and reliable. This...