Senior Data Engineer

5 days ago

Pune, India Right Move Staffing Solutions Private Limited Full time

Job Summary :

We are looking for a highly skilled and experienced Senior Data Engineer to join our data team.

The ideal candidate will have over 4 years of experience in building and maintaining robust data pipelines and infrastructure.

This role requires expertise in cloud data services, big data processing frameworks, and a strong understanding of data warehousing and lakehouse concepts.

The Senior Data Engineer will be crucial in ensuring our data architecture is scalable, reliable, and secure.

Key Responsibilities :

- Design, develop, and optimize scalable ETL (Extract, Transform, Load) processes to ingest, transform, and load data from various sources into data warehouses and data lakes.

- Lead the development of data processing jobs using Azure Databricks, PySpark, and Apache Spark.

- Architect and manage data infrastructure on major cloud platforms including Azure, AWS, and GCP.

- Collaborate with data scientists and analysts to build and maintain the data foundation necessary for advanced analytics and machine learning initiatives.

- Implement and enforce DevOps practices for data pipelines, including CI/CD, monitoring, and automated testing.

- Contribute to the design of the overall data architecture, including data lakes, lakehouses, and traditional data warehouses.

- Write clean, well-documented, and efficient code primarily in Python for data manipulation and automation tasks.

- Troubleshoot and resolve complex data-related issues, ensuring data quality and system performance.

Required Technical Skills :

- Cloud Platforms: Extensive experience with at least one major cloud provider (Azure, AWS, GCP), including their data-specific services.

- Big Data Frameworks: Deep knowledge of Apache Spark and hands-on experience with PySpark and Azure Databricks.

- Data Architecture: Strong understanding of data lakes, data warehouses, and the modern lakehouse architecture.

- ETL/ELT: Expertise in designing and building efficient and scalable data pipelines.

- Programming Languages: Proficiency in Python for scripting, data engineering, and automation.

- DevOps: Familiarity with DevOps principles and tools for deploying and managing data solutions.

Qualifications and Experience :

- A minimum of 4 years of professional experience in a Data Engineering role.

- Bachelor's degree in Computer Science, Engineering, or a related quantitative field.

- Proven ability to work with large-scale datasets and complex data pipelines.

- Strong analytical, problem-solving, and communication skills.

- Experience with relational and NoSQL databases is a plus.

Notice Period - Immediate


(ref:hirist.tech)

  • Data Engineer

    1 week ago

    Pune, Maharashtra, India Data Axle Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    About Data Axle:Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging proprietary...

  • Data Engineer

    3 days ago

    Pune, India Data Axle Full time

    About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging...

  • Data Dynamics

    5 days ago

    Pune, India Data Dynamics Full time

    About the Role : We are seeking a Senior Software Engineer to join our team in Pune. As a key member of our engineering group, you will play a crucial role in the entire software development lifecycle, from initial design to hands-on development. You will work with cross-functional teams to create innovative solutions that are scalable and reliable. This...

  • Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Jash Data Sciences Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    Do you love solving real-world data problems with the latest and best techniques? And having fun while solving them in a team Then come join our high-energy team of passionate data people. Jash Data Sciences is the right place for you.We are a cutting-edge Data Sciences and Data Engineering startup based in Pune, India.We believe in continuous learning and...

  • Data Engineer

    3 days ago

    Pune, India Jash Data Sciences Full time

    Do you love solving real-world data problems with the latest and best techniques? And having fun while solving them in a team Then come join our high-energy team of passionate data people. Jash Data Sciences is the right place for you. We are a cutting-edge Data Sciences and Data Engineering startup based in Pune, India. We believe in continuous learning and...

  • Senior QE Engineer

    3 weeks ago

    Pune, Maharashtra, India NTT Data Full time

    Job DescriptionReq ID:330974NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior QE Engineer to join our team in Pune, Mahrshtra (IN-MH), India (IN).Senior Quality Engineer I...

  • Senior GenAI Engineers

    5 days ago

    Pune, India NTT Data Full time

    Job Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Senior GenAI Engineers to join our team in Pune, Mahrshtra (IN-MH), India (IN). Location: | Experience: 8+...

  • Data Engineer

    3 days ago

    Pune, Maharashtra, India NTT DATA Full time

    Req ID 324612NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Data Engineer to join our team in Pune Mahxc4x81rxc4x81shtra IN-MH India IN Key Responsibilities Design and...

  • Senior Data Engineer

    2 weeks ago

    Pune, Maharashtra, India beBeeData Full time ₹ 15,00,000 - ₹ 20,10,000

    Job Title: Senior Data Engineer">Job Description:As a senior data engineer, you will be responsible for designing and building robust data pipelines that process and transform data from diverse sources.Key Responsibilities:Design and build efficient data pipelines that ensure data quality, reliability, and availability across the pipeline...

  • Senior Data Engineer

    2 weeks ago

    Pune, Maharashtra, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior Data Engineer PositionAbout the Role:We are seeking an experienced Senior Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, implementing and maintaining large-scale data warehouses that support our analytics and intelligence platform.Design and develop advanced SQL queries, stored...