Data Engineer

4 weeks ago

Pune India Go Digital Technology Consulting LLP Full time

Job Description Job Title: Python Data Engineer Location: Pune / Remote Experience Level: 38 years Role Overview We are looking for a Python-centric Data Engineer who can design and maintain scalable, high-performance data pipelines for large and complex datasets. The ideal candidate brings strong object-oriented Python programming skills, experience with distributed data systems (like Hadoop or Spark) and a mindset for building modular, reusable, and testable data solutions. While exposure to cloud technologies (AWS preferred) is valuable, this role emphasizes deep Python-based data engineering over platform administration. Roles & Responsibilities Design, develop, and optimize data ingestion and transformation pipelines using Python. Apply OOP principles to build modular, maintainable, and reusable data components. Work with distributed systems (e.g., Hadoop/Spark) for processing large-scale datasets. Develop and enforce data quality, testing, and validation frameworks. Collaborate with analysts, data scientists, and product teams to ensure data availability and reliability. Participate in code reviews, CI/CD workflows, and infrastructure automation to maintain high engineering standards. Contribute to ongoing evolution of data architecture and help integrate with cloud-based data ecosystems. Technical Skills Core Expertise Python Programming Strong grasp of object-oriented design, modular code practices, and design patterns. Experience with libraries/frameworks such as pandas, PySpark, dask, or custom ETL frameworks. Proficiency in writing unit-tested, well-documented, and scalable code (pytest, unittest). Data Engineering & Ecosystem Experience in building and maintaining ETL/ELT pipelines using Python. Exposure to Hadoop or Spark ecosystems for distributed data processing. Solid understanding of SQL and working with relational or analytical databases (e.g., PostgreSQL, Redshift). Familiarity with CI/CD pipelines (Jenkins, GitHub Actions) and Infrastructure as Code (Terraform). Basic exposure to AWS data services like S3, Lambda, Step Functions, Glue, or DynamoDB. Qualifications Bachelor's or master's degree in engineering or technology or related field. 36 years of hands-on experience in data engineering or backend development. Proven track record of Python-based pipeline development and distributed data processing. Strong foundation in data modeling, data quality, and pipeline orchestration concepts. Excellent problem-solving and communication skills, with an ownership-driven mindset. Desired Qualifications Experience with Apache Airflow, Luigi, or Prefect for workflow orchestration. Exposure to real-time data streaming (Kafka, Kinesis). Familiarity with containerization tools (Docker, Kubernetes). Knowledge of data governance, cataloguing and metadata management.

  • Azure Data Engineer

    4 weeks ago

    Pune, India Fragma Data Systems Full time

    Job Description Technology Skills - Building and operationalizing large scale enterprise data solutions and applications using one or more of AZURE data and analytics services in combination with custom solutions - Azure Synapse/Azure SQL DWH, Azure Data Lake, Azure Blob Storage, Spark, HDInsights, Databricks, CosmosDB, EventHub/IOTHub. - Experience in...

  • Data Engineer Senior Consultant

    5 days ago

    Pune, India NTT Data Full time

    Job Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer Senior Consultant to join our team in Pune, Mahrshtra (IN-MH), India (IN). Location: | Experience: 5+...

  • Data Engineer

    7 days ago

    India NTT DATA Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Req ID: 343254NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in Remote, Karnātaka (IN-KA), India (IN). "Key Responsibilities: Design and implement...

  • Data Engineer

    1 week ago

    Pune, Maharashtra, India Data Axle Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    About Data Axle:Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging proprietary...

  • Data Engineer

    4 weeks ago

    india, IN Data-Hat AI Full time

    Department: Data Engineering & AI Solutions Reports To: Lead Data Solutions Architect Travel: International travel required (up to 30–40%) Position Summary: We are hiring a senior-level Data Engineer to lead the design, development, and optimization of high-performance data infrastructure that underpins mission-critical AI systems. With 12+ years of...

  • Data Engineer

    5 days ago

    Mumbai, India NTT Data Full time

    Job Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in Mumbai, Mahrshtra (IN-MH), India (IN). Job Duties: Key Responsibilities: . Design...

  • Data Engineer

    4 weeks ago

    Bengaluru, India NTT Data Full time

    Job Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in Bangalore, Karntaka (IN-KA), India (IN). Design and implement tailored data...

  • Data Engineer

    3 days ago

    Mumbai, India NTT Data Full time

    Job Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in Mumbai, Mahrshtra (IN-MH), India (IN). Job Duties: Key Responsibilities: . Design...

  • Data Engineer

    3 weeks ago

    India CX Data Labs Full time

    Job Description Hi Role - Azure Data Engineer Location - Chennai, Gurugram (5days Office) Full time Shift timing 2pm to 11pm Key Responsibilities: Develop, maintain, and optimize scalable ETL/ELT pipelines using PySpark and Databricks. Collaborate with cross-functional teams to design and implement data models and data integration solutions. Create and...

  • Data Engineer Advisor

    3 days ago

    Hyderabad, India NTT Data Full time

    Job Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer Advisor to join our team in Hyderabad, Telangana (IN-TG), India (IN). Job Requirements - 6-8 Yrs. of...