Data Engineer

4 days ago

Pune, Maharashtra, India Go Digital Technology Consulting LLP Full time ₹ 6,00,000 - ₹ 12,00,000 per year

Job Title: Python Data Engineer
Location:
Pune / Remote

Experience Level:
3–8 years

Role Overview
We are looking for a Python-centric Data Engineer who can design and maintain scalable, high-performance data pipelines for large and complex datasets. The ideal candidate brings strong object-oriented Python programming skills, experience with distributed data systems (like Hadoop or Spark) and a mindset for building modular, reusable, and testable data solutions. While exposure to cloud technologies (AWS preferred) is valuable, this role emphasizes deep Python-based data engineering over platform administration.

Roles & Responsibilities
Design, develop, and optimize data ingestion and transformation pipelines using Python.

Apply OOP principles to build modular, maintainable, and reusable data components.

Work with distributed systems (e.g., Hadoop/Spark) for processing large-scale datasets.

Develop and enforce data quality, testing, and validation frameworks.

Collaborate with analysts, data scientists, and product teams to ensure data availability and reliability.

Participate in code reviews, CI/CD workflows, and infrastructure automation to maintain high engineering standards.

Contribute to ongoing evolution of data architecture and help integrate with cloud-based data ecosystems.

Technical Skills
Core Expertise
Python Programming
Strong grasp of object-oriented design, modular code practices, and design patterns.

Experience with libraries/frameworks such as pandas, PySpark, dask, or custom ETL frameworks.

Proficiency in writing unit-tested, well-documented, and scalable code (pytest, unittest).

Data Engineering & Ecosystem
Experience in building and maintaining ETL/ELT pipelines using Python.

Exposure to Hadoop or Spark ecosystems for distributed data processing.

Solid understanding of SQL and working with relational or analytical databases (e.g., PostgreSQL, Redshift).

Familiarity with CI/CD pipelines (Jenkins, GitHub Actions) and Infrastructure as Code (Terraform).

Basic exposure to AWS data services like S3, Lambda, Step Functions, Glue, or DynamoDB.

Qualifications
Bachelor's or master's degree in engineering or technology or related field.

3–6 years of hands-on experience in data engineering or backend development.

Proven track record of Python-based pipeline development and distributed data processing.

Strong foundation in data modeling, data quality, and pipeline orchestration concepts.

Excellent problem-solving and communication skills, with an ownership-driven mindset.

Desired Qualifications
Experience with Apache Airflow, Luigi, or Prefect for workflow orchestration.

Exposure to real-time data streaming (Kafka, Kinesis).

Familiarity with containerization tools (Docker, Kubernetes).

Knowledge of data governance, cataloguing and metadata management.

  • Data Engineer

    1 week ago

    Pune, Maharashtra, India Data Axle Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    About Data Axle:Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging proprietary...

  • Business Consulting-Data Engineer with Power BI

    2 weeks ago

    Pune, Maharashtra, India NTT DATA Full time

    Req ID: 345385NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Business Consulting-Data Engineer with Power BI to join our team in Pune, Mahārāshtra (IN-MH), India (IN).Job...

  • Data Engineer with Power BI

    6 days ago

    Pune, Maharashtra, India NTT DATA Global Delivery Services Ltd Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Business Consulting-Data Engineer with Power BI Req ID: 345385 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Business Consulting-Data Engineer with Power BI to join our team...

  • Data Scientist

    4 days ago

    Pune, Maharashtra, India Jash Data Sciences Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We are a fast-growing startup based in Pune, India, specializing in cutting-edge Data Science and Data Engineering solutions. Our team of dedicated professionals is committed to solving complex data challenges for companies worldwide.Our CultureWe foster a vibrant startup culture that values:Intellectual curiosityContinuous learningPositive work...

  • Data Science Specialist

    7 hours ago

    Pune, Maharashtra, India Data Direct Networks Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    OverviewThis is an incredible opportunity to be part of a company that has been at the forefront of AI and high-performance data storage innovation for over two decades. DataDirect Networks (DDN) is a global market leader renowned for powering many of the world's most demanding AI data centers, in industries ranging from life sciences and healthcare to...

  • Senior Software Engineer

    6 days ago

    Pune, Maharashtra, India Crest Data Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    We are looking for a strong ReactJS Lead Engineers to join our engineering team in Ahmedabad. The primary responsibility will be to lead the design and develop Enterprise Software for our Global Fortune 500 clients in Data Center and Big Data segments.Location: PUNE / AHMEDABAD ( WFO Only)Key ResponsibilitiesResponsible for providing expertise in software...

  • Senior Software Engineer

    4 days ago

    Pune, Maharashtra, India Data Axle Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About Data Axle:Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging...

  • Sr Quality Engineer

    6 days ago

    Pune, Maharashtra, India NTT DATA Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Req ID: 339009NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Sr Quality Engineer to join our team in Pune, Mahārāshtra (IN-MH), India (IN). Senior Quality Engineer I Who we...

  • Data Engineer

    7 days ago

    Pune, Maharashtra, India Opus Technologies Full time ₹ 4,00,000 - ₹ 12,00,000 per year

    Job Title: Data Engineer/Spark EngineerLocation: India(Pune)About the RoleWe are looking for a passionate and experienced Data Engineer to join our growing data team. This is a hands-on role for someone who thrives in building scalable data platforms from the ground up. Youll work with cutting-edge technologies including Apache Spark, Google Cloud Platform...

  • Data Engineer

    6 days ago

    Pune, Maharashtra, India Vi (Vodafone Idea) Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    Assistant Manager - Data Engineer - PuneThe Assistant Manager - Data Engineer role in Pune involves working on data engineering projects and collaborating with cross-functional teams to develop and maintain data pipelines, ETL processes, and data warehousing solutions. The role requires strong analytical and problem-solving skills, as well as the ability to...