Senior Data Engineer

3 weeks ago

Pune, India Techno Wise Full time

Job Title : Senior Data Engineer

Experience : 8+ years


Roles & Responsibilities :

- Design, develop, and maintain scalable and efficient data integration solutions using PySpark, Python, Hive, and Hadoop.

- Develop, schedule, and monitor workflows using Apache Airflow to ensure timely and reliable data processing.

- Optimize performance of ETL processes to handle high-volume data efficiently.

- Collaborate with cross-functional teams to design ETL architecture and data integration pipelines aligned with business needs.

- Analyze complex data sets and troubleshoot issues related to data extraction, transformation, and loading.

- Implement best practices for data quality, data governance, and data security in data integration processes.

- Document development processes, workflows, and architecture designs for team knowledge sharing.

- Communicate effectively with stakeholders to gather requirements and provide regular updates on project progress.

- Mentor junior developers and provide technical guidance to the team.

Must-Have Skills :

- Minimum 5+ years hands-on development experience in: Pyspark, Python, Hive, Hadoop

- At least 1 year experience working with Apache Airflow for workflow orchestration.

- Proven expertise in optimizing performance for large-scale data integration workflows.

- Strong experience handling high volume data processing.

- Solid understanding of ETL architecture design and data integration best practices.

- Excellent problem-solving skills and attention to detail.

- Strong verbal and written communication skills.

Good-to-Have Skills :

- Experience with cloud platforms (AWS, Azure, GCP) for data processing.

- Knowledge of containerization and orchestration tools (Docker, Kubernetes).


- Familiarity with additional data processing tools like Kafka, Spark Streaming, or Flink.

- Experience in data modeling and working with structured/unstructured data.

- Exposure to CI/CD pipelines and DevOps practices for data engineering.

- Prior experience mentoring or leading a team.


(ref:hirist.tech)

  • Senior Data Engineer

    1 week ago

    Pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • Data Engineer

    3 weeks ago

    Pune, India Data Axle Full time

    About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging...

  • Data Engineer

    1 week ago

    Pune, Maharashtra, India Data Axle Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    About Data Axle:Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging proprietary...

  • Data Dynamics

    4 weeks ago

    Pune, India Data Dynamics Full time

    About the Role : We are seeking a Senior Software Engineer to join our team in Pune. As a key member of our engineering group, you will play a crucial role in the entire software development lifecycle, from initial design to hands-on development. You will work with cross-functional teams to create innovative solutions that are scalable and reliable. This...

  • Data Engineer

    3 weeks ago

    Pune, India Jash Data Sciences Full time

    Do you love solving real-world data problems with the latest and best techniques? And having fun while solving them in a team Then come join our high-energy team of passionate data people. Jash Data Sciences is the right place for you. We are a cutting-edge Data Sciences and Data Engineering startup based in Pune, India. We believe in continuous learning and...

  • Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Jash Data Sciences Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Do you love solving real-world data problems with the latest and best techniques? And having fun while solving them in a team Then come join our high-energy team of passionate data people. Jash Data Sciences is the right place for you.We are a cutting-edge Data Sciences and Data Engineering startup based in Pune, India.We believe in continuous learning and...

  • Senior QE Engineer

    2 weeks ago

    Pune, Maharashtra, India NTT DATA Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Req ID: 330974NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Senior QE Engineer to join our team in Pune, Mahārāshtra (IN-MH), India (IN). Senior Quality Engineer I (JavaScript)...

  • Senior Data Engineer

    6 days ago

    Pune, India Dataceria Full time

    Company: Dataceria software solutions Pvt ltd.Job Position: Senior Data engineer _snowflakeLocation: PuneTimings to align with UK and USA timingsHybrid: 3 days in NT office PuneInterview stages: 1, initial screening, 2 stages client technical interviewStart date: asapDataceria is looking for a Senior Data Engineer to join our growing Data Delivery team.This...

  • Senior Data Engineer

    6 days ago

    pune, India Dataceria Full time

    Company: Dataceria software solutions Pvt ltd.Job Position: Senior Data engineer _snowflakeLocation: PuneTimings to align with UK and USA timingsHybrid: 3 days in NT office PuneInterview stages: 1, initial screening, 2 stages client technical interviewStart date: asapDataceria is looking for a Senior Data Engineer to join our growing Data Delivery team.This...

  • Senior Data Engineer

    6 days ago

    Pune, India Dataceria Full time

    Company: Dataceria software solutions Pvt ltd.Job Position: Senior Data engineer _snowflakeLocation: PuneTimings to align with UK and USA timingsHybrid: 3 days in NT office PuneInterview stages: 1, initial screening, 2 stages client technical interviewStart date: asapDataceria is looking for a Senior Data Engineer to join our growing Data Delivery team.This...