Data Engineer

4 days ago

Pune, Maharashtra, India Go Digital Technology Consulting LLP Full time ₹ 6,00,000 - ₹ 12,00,000 per year

Job Title: Python Data Engineer
Location:
Pune / Remote

Experience Level:
3–8 years

Role Overview
We are looking for a Python-centric Data Engineer who can design and maintain scalable, high-performance data pipelines for large and complex datasets. The ideal candidate brings strong object-oriented Python programming skills, experience with distributed data systems (like Hadoop or Spark) and a mindset for building modular, reusable, and testable data solutions. While exposure to cloud technologies (AWS preferred) is valuable, this role emphasizes deep Python-based data engineering over platform administration.

Roles & Responsibilities
Design, develop, and optimize data ingestion and transformation pipelines using Python.

Apply OOP principles to build modular, maintainable, and reusable data components.

Work with distributed systems (e.g., Hadoop/Spark) for processing large-scale datasets.

Develop and enforce data quality, testing, and validation frameworks.

Collaborate with analysts, data scientists, and product teams to ensure data availability and reliability.

Participate in code reviews, CI/CD workflows, and infrastructure automation to maintain high engineering standards.

Contribute to ongoing evolution of data architecture and help integrate with cloud-based data ecosystems.

Technical Skills
Core Expertise
Python Programming
Strong grasp of object-oriented design, modular code practices, and design patterns.

Experience with libraries/frameworks such as pandas, PySpark, dask, or custom ETL frameworks.

Proficiency in writing unit-tested, well-documented, and scalable code (pytest, unittest).

Data Engineering & Ecosystem
Experience in building and maintaining ETL/ELT pipelines using Python.

Exposure to Hadoop or Spark ecosystems for distributed data processing.

Solid understanding of SQL and working with relational or analytical databases (e.g., PostgreSQL, Redshift).

Familiarity with CI/CD pipelines (Jenkins, GitHub Actions) and Infrastructure as Code (Terraform).

Basic exposure to AWS data services like S3, Lambda, Step Functions, Glue, or DynamoDB.

Qualifications
Bachelor's or master's degree in engineering or technology or related field.

3–6 years of hands-on experience in data engineering or backend development.

Proven track record of Python-based pipeline development and distributed data processing.

Strong foundation in data modeling, data quality, and pipeline orchestration concepts.

Excellent problem-solving and communication skills, with an ownership-driven mindset.

Desired Qualifications
Experience with Apache Airflow, Luigi, or Prefect for workflow orchestration.

Exposure to real-time data streaming (Kafka, Kinesis).

Familiarity with containerization tools (Docker, Kubernetes).

Knowledge of data governance, cataloguing and metadata management.

  • Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Jash Data Sciences Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Do you love solving real-world data problems with the latest and best techniques? And having fun while solving them in a team Then come join our high-energy team of passionate data people. Jash Data Sciences is the right place for you.We are a cutting-edge Data Sciences and Data Engineering startup based in Pune, India.We believe in continuous learning and...

  • Tech Lead Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Data Axle Full time ₹ 15,00,000 - ₹ 30,00,000 per year

    About Data Axle:Data Axle Inc.  has been an industry leader in data, marketing solutions, sales, and research for over 50 years in the USA. Data Axle now as an established strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and...

  • Business Consulting-Data Engineer with Power BI

    2 weeks ago

    Pune, Maharashtra, India NTT DATA Full time

    Req ID: 345385NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Business Consulting-Data Engineer with Power BI to join our team in Pune, Mahārāshtra (IN-MH), India (IN).Job...

  • Data Scientist

    2 weeks ago

    Pune, Maharashtra, India Data Axle Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About Data Axle:Data Axle Inc.  has been an industry leader in data, marketing solutions, sales and research for over 45 years in the USA. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and by...

  • Data Scientist

    2 weeks ago

    Pune, Maharashtra, India Data Axle Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About Data Axle:Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for over 45 years in the USA. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and by leveraging...

  • Data Scientist

    2 days ago

    Pune, Maharashtra, India Jash Data Sciences Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We are a fast-growing startup based in Pune, India, specializing in cutting-edge Data Science and Data Engineering solutions. Our team of dedicated professionals is committed to solving complex data challenges for companies worldwide.Our CultureWe foster a vibrant startup culture that values:Intellectual curiosityContinuous learningPositive work...

  • Data Science Specialist

    32 minutes ago

    Pune, Maharashtra, India Data Direct Networks Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    OverviewThis is an incredible opportunity to be part of a company that has been at the forefront of AI and high-performance data storage innovation for over two decades. DataDirect Networks (DDN) is a global market leader renowned for powering many of the world's most demanding AI data centers, in industries ranging from life sciences and healthcare to...

  • Software Engineer

    2 weeks ago

    Pune, Maharashtra, India Data Axle Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    About Data Axle:Data Axle Inc.  has been an industry leader in data, marketing solutions, sales and research for over 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging...

  • Software Engineer

    2 weeks ago

    Pune, Maharashtra, India Data Axle Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging proprietary business &...

  • Sr Software Engineer

    2 weeks ago

    Pune, Maharashtra, India Data Axle Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About Data Axle:Data Axle Inc.  has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging...