Data Engineer

2 weeks ago

Pune, Maharashtra, India Net Connect Full time ₹ 6,00,000 - ₹ 18,00,000 per year

Job Summary

We are seeking a skilled Data Engineer to design, develop, and optimize data pipelines and data warehouse solutions. The ideal candidate will have hands-on expertise in ETL development, Databricks, Python, PySpark, SQL, and AWS. This role involves working closely with business stakeholders to gather requirements, build scalable data solutions, perform data exploration, and ensure high-quality data delivery through proper testing and documentation.

Key Responsibilities

  • Design, develop, and maintain ETL pipelines for structured and unstructured data.
  • Work extensively with Databricks, PySpark, Python, and SQL for data integration, transformation, and processing.
  • Build and optimize data models for reporting, analytics, and advanced use cases.
  • Develop and manage data warehouse solutions leveraging PostgreSQL and AWS services (e.g., S3, Redshift, Glue, Lambda).
  • Perform data exploration, profiling, and quality checks to identify gaps and anomalies.
  • Collaborate with business and technical teams to gather, analyze, and document data requirements.
  • Implement unit testing (UT cases) and validation frameworks to ensure data accuracy and reliability.
  • Maintain technical documentation, including data flow diagrams, design specifications, and metadata.
  • Support data governance and ensure compliance with organizational and security standards.
  • Track and manage tasks, issues, and progress using JIRA or similar tools.

Required Skills & Qualifications

  • Proven experience in ETL development and data engineering projects.
  • Strong programming skills in Python and PySpark.
  • Proficiency in SQL (including performance tuning and complex queries).
  • Hands-on experience with Databricks and AWS Cloud ecosystem.
  • Solid understanding of data warehousing concepts, data modelling techniques, and database design.
  • Experience with PostgreSQL or similar relational databases.
  • Strong knowledge of data exploration, profiling, and debugging large datasets.
  • Familiarity with unit testing and test automation for data pipelines.
  • Excellent skills in preparing technical documentation.
  • Experience with Agile methodologies and tools like JIRA.
  • Strong communication and collaboration skills for cross-functional teamwork.

Preferred Qualifications

  • Experience with big data ecosystems (Spark, Hive, Kafka).
  • Exposure to CI/CD pipelines for data workflows.
  • Knowledge of data governance, security, and compliance practices.
  • Familiarity with BI/Visualization tools (e.g., Power BI, Tableau).

  • Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Jash Data Sciences Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Do you love solving real-world data problems with the latest and best techniques? And having fun while solving them in a team Then come join our high-energy team of passionate data people. Jash Data Sciences is the right place for you.We are a cutting-edge Data Sciences and Data Engineering startup based in Pune, India.We believe in continuous learning and...

  • Tech Lead Data Engineer

    1 week ago

    Pune, Maharashtra, India Data Axle Full time ₹ 15,00,000 - ₹ 30,00,000 per year

    About Data Axle:Data Axle Inc.  has been an industry leader in data, marketing solutions, sales, and research for over 50 years in the USA. Data Axle now as an established strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and...

  • Business Consulting-Data Engineer with Power BI

    1 week ago

    Pune, Maharashtra, India NTT DATA Full time

    Req ID: 345385NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Business Consulting-Data Engineer with Power BI to join our team in Pune, Mahārāshtra (IN-MH), India (IN).Job...

  • Data Scientist

    1 week ago

    Pune, Maharashtra, India Data Axle Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About Data Axle:Data Axle Inc.  has been an industry leader in data, marketing solutions, sales and research for over 45 years in the USA. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and by...

  • Data Scientist

    2 weeks ago

    Pune, Maharashtra, India Data Axle Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About Data Axle:Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for over 45 years in the USA. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and by leveraging...

  • Software Engineer

    1 week ago

    Pune, Maharashtra, India Data Axle Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    About Data Axle:Data Axle Inc.  has been an industry leader in data, marketing solutions, sales and research for over 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging...

  • Software Engineer

    1 week ago

    Pune, Maharashtra, India Data Axle Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging proprietary business &...

  • Data Scientist Specialist

    2 weeks ago

    Pune, Maharashtra, India Optimum Data Analytics Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Role Overview:We are looking for a Data Scientist Specialist to join our growing AI & Data team. The ideal candidate will have hands-on experience designing and deploying AI/ML solutions with Azure Cloud, LLMOps, Containerized environments, and Generative AI technologies. This is an onsite role based in Pune, offering you the opportunity to collaborate...

  • Sr Software Engineer

    1 week ago

    Pune, Maharashtra, India Data Axle Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About Data Axle:Data Axle Inc.  has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging...

  • Software Engineer

    2 weeks ago

    Pune, Maharashtra, India Data Direct Networks Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    OverviewThis is an incredible opportunity to be part of a company that has been at the forefront of AI and high-performance data storage innovation for over two decades. DataDirect Networks (DDN) is a global market leader renowned for powering many of the world's most demanding AI data centers, in industries ranging from life sciences and healthcare to...