Data Engineer

3 days ago

Pune India Go Digital Technology Consulting LLP Full time

Job Description Job Title: Python Data Engineer Location: Pune / Remote Experience Level: 38 years Role Overview We are looking for a Python-centric Data Engineer who can design and maintain scalable, high-performance data pipelines for large and complex datasets. The ideal candidate brings strong object-oriented Python programming skills, experience with distributed data systems (like Hadoop or Spark) and a mindset for building modular, reusable, and testable data solutions. While exposure to cloud technologies (AWS preferred) is valuable, this role emphasizes deep Python-based data engineering over platform administration. Roles & Responsibilities Design, develop, and optimize data ingestion and transformation pipelines using Python. Apply OOP principles to build modular, maintainable, and reusable data components. Work with distributed systems (e.g., Hadoop/Spark) for processing large-scale datasets. Develop and enforce data quality, testing, and validation frameworks. Collaborate with analysts, data scientists, and product teams to ensure data availability and reliability. Participate in code reviews, CI/CD workflows, and infrastructure automation to maintain high engineering standards. Contribute to ongoing evolution of data architecture and help integrate with cloud-based data ecosystems. Technical Skills Core Expertise Python Programming Strong grasp of object-oriented design, modular code practices, and design patterns. Experience with libraries/frameworks such as pandas, PySpark, dask, or custom ETL frameworks. Proficiency in writing unit-tested, well-documented, and scalable code (pytest, unittest). Data Engineering & Ecosystem Experience in building and maintaining ETL/ELT pipelines using Python. Exposure to Hadoop or Spark ecosystems for distributed data processing. Solid understanding of SQL and working with relational or analytical databases (e.g., PostgreSQL, Redshift). Familiarity with CI/CD pipelines (Jenkins, GitHub Actions) and Infrastructure as Code (Terraform). Basic exposure to AWS data services like S3, Lambda, Step Functions, Glue, or DynamoDB. Qualifications Bachelor's or master's degree in engineering or technology or related field. 36 years of hands-on experience in data engineering or backend development. Proven track record of Python-based pipeline development and distributed data processing. Strong foundation in data modeling, data quality, and pipeline orchestration concepts. Excellent problem-solving and communication skills, with an ownership-driven mindset. Desired Qualifications Experience with Apache Airflow, Luigi, or Prefect for workflow orchestration. Exposure to real-time data streaming (Kafka, Kinesis). Familiarity with containerization tools (Docker, Kubernetes). Knowledge of data governance, cataloguing and metadata management.

  • Azure Data Engineer

    3 days ago

    Pune, India Fragma Data Systems Full time

    Job Description Technology Skills - Building and operationalizing large scale enterprise data solutions and applications using one or more of AZURE data and analytics services in combination with custom solutions - Azure Synapse/Azure SQL DWH, Azure Data Lake, Azure Blob Storage, Spark, HDInsights, Databricks, CosmosDB, EventHub/IOTHub. - Experience in...

  • Data Engineer

    7 days ago

    India NTT DATA Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Req ID: 343254NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in Remote, Karnātaka (IN-KA), India (IN). "Key Responsibilities: Design and implement...

  • Data engineer

    1 week ago

    India Data-Hat AI Full time

    Department: Data Engineering & AI Solutions  Reports To: Lead Data Solutions Architect  Travel: International travel required (up to 30–40%)   Position Summary:   We are hiring a senior-level Data Engineer to lead the design, development, and optimization of high-performance data infrastructure that underpins mission-critical AI systems. With 12+...

  • Data Engineer

    3 weeks ago

    Pune, India Data Axle Full time

    About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging...

  • Data Engineer

    1 week ago

    Pune, Maharashtra, India Data Axle Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    About Data Axle:Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging proprietary...

  • Data Engineer

    1 week ago

    India Data-Hat AI Full time

    Department: Data Engineering & AI Solutions Reports To: Lead Data Solutions Architect Travel: International travel required (up to 30–40%)  Position Summary: We are hiring a senior-level Data Engineer to lead the design, development, and optimization of high-performance data infrastructure that underpins mission-critical AI systems. With 12+ years of...

  • Data Engineer

    1 week ago

    India Data-Hat AI Full time

    Department: Data Engineering & AI Solutions  Reports To: Lead Data Solutions Architect  Travel: International travel required (up to 30–40%)  Position Summary:   We are hiring a senior-level Data Engineer to lead the design, development, and optimization of high-performance data infrastructure that underpins mission-critical AI systems. With 12+...

  • Data Engineer

    7 days ago

    India Data-Hat AI Full time

    Department: Data Engineering & AI Solutions  Reports To: Lead Data Solutions Architect  Travel: International travel required (up to 30–40%)  Position Summary:   We are hiring a senior-level Data Engineer to lead the design, development, and optimization of high-performance data infrastructure that underpins mission-critical AI systems....

  • Data Engineer

    6 days ago

    india, IN Data-Hat AI Full time

    Department: Data Engineering & AI Solutions Reports To: Lead Data Solutions Architect Travel: International travel required (up to 30–40%) Position Summary: We are hiring a senior-level Data Engineer to lead the design, development, and optimization of high-performance data infrastructure that underpins mission-critical AI systems. With 12+ years of...

  • Data Engineer

    3 weeks ago

    Pune, India Jash Data Sciences Full time

    Do you love solving real-world data problems with the latest and best techniques? And having fun while solving them in a team Then come join our high-energy team of passionate data people. Jash Data Sciences is the right place for you. We are a cutting-edge Data Sciences and Data Engineering startup based in Pune, India. We believe in continuous learning and...