Data Engineer

4 days ago

Pune, Maharashtra, India Datametica Full time ₹ 8,00,000 - ₹ 24,00,000 per year

Job Title: Senior Data Engineer/Module Lead

Location: Pune, Maharashtra, India

Experience Level: 5-8 Years

Work Model: Full-time

About the Role:

We are seeking a highly skilled and experienced Senior Data Engineer to join our growing team in Pune. The ideal candidate will have a strong background in data engineering, with a particular focus on Google Cloud Platform (GCP) data services and Apache Airflow. You will be responsible for designing, developing, and maintaining robust and scalable data pipelines, ensuring data quality, and optimizing data solutions for performance and cost. This role requires a hands-on approach and the ability to work independently and collaboratively within an agile environment.

Responsibilities:

  • Design, develop, and deploy scalable and efficient data pipelines using Google Cloud Platform (GCP) data services, specifically BigQuery, Cloud Composer (Apache Airflow), and Cloud Storage.
  • Develop, deploy, and manage complex DAGs in Apache Airflow for orchestrating data workflows.
  • Write complex SQL and PL/SQL queries, stored procedures, and functions for data manipulation, transformation, and analysis.
  • Optimize BigQuery queries for performance, cost efficiency, and scalability.
  • Ensure data quality, integrity, and reliability across all data solutions.
  • Collaborate with cross-functional teams including data scientists, analysts, and other engineers to understand data requirements and deliver effective solutions.
  • Participate in code reviews and contribute to best practices for data engineering.
  • Troubleshoot and resolve data-related issues in a timely manner.
  • Manage and maintain version control for data engineering projects using Git.
  • Stay up-to-date with the latest industry trends and technologies in data engineering and GCP.

Required Skills and Qualifications:

  • 5-8 years of hands-on experience in Data Engineering roles.
  • Strong hands-on experience with Google Cloud Platform (GCP) data services, specifically BigQuery, Cloud Composer (Apache Airflow), and Cloud Storage.
  • Mandatory expertise in Apache Airflow, including designing, developing, and deploying complex DAGs.
  • Mandatory strong proficiency in SQL and PL/SQL for data manipulation, stored procedures, functions, and complex query writing.
  • Experience with Informatica.
  • Proven ability to optimize BigQuery queries for performance and cost.
  • Familiarity with version control systems (e.g., Git).
  • Excellent problem-solving, analytical, and communication skills.
  • Ability to work independently and collaboratively in an agile environment.
  • Bachelor's degree in Computer Science, Engineering, or a related field.

  • Data Engineer

    4 days ago

    Pune, Maharashtra, India Jash Data Sciences Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Do you love solving real-world data problems with the latest and best techniques? And having fun while solving them in a team Then come join our high-energy team of passionate data people. Jash Data Sciences is the right place for you.We are a cutting-edge Data Sciences and Data Engineering startup based in Pune, India.We believe in continuous learning and...

  • Tech Lead Data Engineer

    3 days ago

    Pune, Maharashtra, India Data Axle Full time ₹ 15,00,000 - ₹ 30,00,000 per year

    About Data Axle:Data Axle Inc.  has been an industry leader in data, marketing solutions, sales, and research for over 50 years in the USA. Data Axle now as an established strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and...

  • Business Consulting-Data Engineer with Power BI

    2 days ago

    Pune, Maharashtra, India NTT DATA Full time

    Req ID: 345385NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Business Consulting-Data Engineer with Power BI to join our team in Pune, Mahārāshtra (IN-MH), India (IN).Job...

  • Data Scientist

    3 days ago

    Pune, Maharashtra, India Data Axle Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About Data Axle:Data Axle Inc.  has been an industry leader in data, marketing solutions, sales and research for over 45 years in the USA. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and by...

  • Data Scientist

    4 days ago

    Pune, Maharashtra, India Data Axle Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About Data Axle:Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for over 45 years in the USA. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and by leveraging...

  • Data Science Specialist

    2 weeks ago

    Pune, Maharashtra, India Data Direct Networks Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    OverviewThis is an incredible opportunity to be part of a company that has been at the forefront of AI and high-performance data storage innovation for over two decades. DataDirect Networks (DDN) is a global market leader renowned for powering many of the world's most demanding AI data centers, in industries ranging from life sciences and healthcare to...

  • Software Engineer

    2 days ago

    Pune, Maharashtra, India Data Axle Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    About Data Axle:Data Axle Inc.  has been an industry leader in data, marketing solutions, sales and research for over 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging...

  • Software Engineer

    2 days ago

    Pune, Maharashtra, India Data Axle Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging proprietary business &...

  • Data Scientist Specialist

    6 days ago

    Pune, Maharashtra, India Optimum Data Analytics Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Role Overview:We are looking for a Data Scientist Specialist to join our growing AI & Data team. The ideal candidate will have hands-on experience designing and deploying AI/ML solutions with Azure Cloud, LLMOps, Containerized environments, and Generative AI technologies. This is an onsite role based in Pune, offering you the opportunity to collaborate...

  • Sr Software Engineer

    2 days ago

    Pune, Maharashtra, India Data Axle Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About Data Axle:Data Axle Inc.  has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging...