Senior Data Engineer

3 weeks ago

Pune, Maharashtra, India Right Move Staffing Solutions Private Limited Full time

Job Summary :

We are looking for a highly skilled and experienced Senior Data Engineer to join our data team.

The ideal candidate will have over 4 years of experience in building and maintaining robust data pipelines and infrastructure.

This role requires expertise in cloud data services, big data processing frameworks, and a strong understanding of data warehousing and lakehouse concepts.

The Senior Data Engineer will be crucial in ensuring our data architecture is scalable, reliable, and secure.

Key Responsibilities :

- Design, develop, and optimize scalable ETL (Extract, Transform, Load) processes to ingest, transform, and load data from various sources into data warehouses and data lakes.

- Lead the development of data processing jobs using Azure Databricks, PySpark, and Apache Spark.

- Architect and manage data infrastructure on major cloud platforms including Azure, AWS, and GCP.

- Collaborate with data scientists and analysts to build and maintain the data foundation necessary for advanced analytics and machine learning initiatives.

- Implement and enforce DevOps practices for data pipelines, including CI/CD, monitoring, and automated testing.

- Contribute to the design of the overall data architecture, including data lakes, lakehouses, and traditional data warehouses.

- Write clean, well-documented, and efficient code primarily in Python for data manipulation and automation tasks.

- Troubleshoot and resolve complex data-related issues, ensuring data quality and system performance.

Required Technical Skills :

- Cloud Platforms: Extensive experience with at least one major cloud provider (Azure, AWS, GCP), including their data-specific services.

- Big Data Frameworks: Deep knowledge of Apache Spark and hands-on experience with PySpark and Azure Databricks.

- Data Architecture: Strong understanding of data lakes, data warehouses, and the modern lakehouse architecture.

- ETL/ELT: Expertise in designing and building efficient and scalable data pipelines.

- Programming Languages: Proficiency in Python for scripting, data engineering, and automation.

- DevOps: Familiarity with DevOps principles and tools for deploying and managing data solutions.

Qualifications and Experience :

- A minimum of 4 years of professional experience in a Data Engineering role.

- Bachelor's degree in Computer Science, Engineering, or a related quantitative field.

- Proven ability to work with large-scale datasets and complex data pipelines.

- Strong analytical, problem-solving, and communication skills.

- Experience with relational and NoSQL databases is a plus.

Notice Period - Immediate

(ref:hirist.tech)

  • Senior QE Engineer

    2 weeks ago

    Pune, Maharashtra, India NTT Data Full time

    Job DescriptionReq ID:330977NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior QE Engineer to join our team in Pune, Mahrshtra (IN-MH), India (IN).Senior Quality Engineer I...

  • Senior QE Engineer

    11 hours ago

    Pune, Maharashtra, India NTT Data Full time

    Job DescriptionReq ID:330974NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior QE Engineer to join our team in Pune, Mahrshtra (IN-MH), India (IN).Senior Quality Engineer I...

  • Senior Software Engineer

    3 weeks ago

    Pune, Maharashtra, India Data Dynamics Full time

    About the Role : We are seeking a Senior Software Engineer to join our team in Pune. As a key member of our engineering group, you will play a crucial role in the entire software development lifecycle, from initial design to hands-on development. You will work with cross-functional teams to create innovative solutions that are scalable and reliable. This...

  • Senior Data Engineer

    5 days ago

    Pune, Maharashtra, India SPIRO Full time

    Position: Senior Data EngineerLocation: PuneExperience: 5+ yearsJob Summary:We are seeking an experienced Senior Data Engineer with a strong background in PySpark, Spark, and Big Data technologies. The ideal candidate will have over five years of hands-on experience designing, building, and optimizing large-scale data processing systems and pipelines.Key...

  • Senior Data Engineer

    4 weeks ago

    Pune, Maharashtra, India Kivor Full time

    Company Description Kivor is revolutionizing enterprise application support with Gen AI-powered autonomous agents. Our platform transforms data from logs, tickets, source code, and documentation into an application-specific knowledge graph, enabling faster issue detection and seamless autonomous resolutions. This innovation reduces support costs by over 50%...

  • Senior Data Engineer

    4 weeks ago

    Pune, Maharashtra, India Kivor Full time

    Company DescriptionKivor is revolutionizing enterprise application support with Gen AI-powered autonomous agents. Our platform transforms data from logs, tickets, source code, and documentation into an application-specific knowledge graph, enabling faster issue detection and seamless autonomous resolutions. This innovation reduces support costs by over 50%...

  • Senior Data Engineer

    3 weeks ago

    Pune, Maharashtra, India One Click AI Full time

    Senior Data Engineer (Snowflake)Employment Type : Full-Time | PayrollExperience : 5+ YearsAbout Agivant :Agivant is a new-age, AI-first digital and cloud engineering services company. We partner with enterprises to deliver scalable, secure, and high-performance data solutions that power business growth. We are now seeking a Senior Data Engineer to join our...

  • Senior Data Engineer

    4 days ago

    Pune, Maharashtra, India beBeeData Full time ₹ 9,00,000 - ₹ 12,00,000

    Job Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team. As a senior member of our engineering team, you will be responsible for designing and implementing scalable data processing pipelines using PySpark.Your primary focus will be on developing high-quality code that integrates, cleanses, and processes large...

  • Senior Data Engineer

    1 week ago

    Pune, Maharashtra, India Expleo Full time US$ 90,000 - US$ 1,20,000 per year

    OverviewSenior Data Engineer Years of experience - 4 to 6 yearsAWS Data Engineer with strong python experience. Helping in defining the data architecture within our Snowflake install. Working with Data Analysts to help them upskill and create a gold-tier data structures with best practices. Help technically with data pipeline buildout within Snowflake....

  • Senior Data Engineer

    6 days ago

    Pune, Maharashtra, India InfoBeans Full time

    Greetings from Infobeans ( Title: Senior Data EngineerSkills: Python, Data EngineeringExperience Required: 5- 7 YearsLocation: PuneNotice Period: Immediate Joiners PreferredAbout the RoleWe are seeking a Senior Data Engineer with a passion for building scalable data infrastructure, fluent Python skills, and a sharp analytical mindset. You will design,...