Engineering Manager – Big Data

8 hours ago

india, IN DataE2E Technologies Full time

Job Title: Engineering Manager – Big Data, Azure & Databricks

Location: Remote

Employment Type: Full-time

Department: Data Engineering / Technology

Experience: 8+ years (3+ years in a managerial role)

Salary - 30 LPA


About the Role:

We are seeking a highly experienced and strategic Engineering Manager with deep expertise in Big Data platforms, Microsoft Azure, and Databricks. The ideal candidate will lead a team of talented data engineers to design and deliver scalable data pipelines and analytics platforms, ensuring high performance, reliability, and security in a cloud-native environment.

Key Responsibilities:

  • Lead, mentor, and grow a team of data engineers working on large-scale distributed data systems.
  • Architect and oversee the development of end-to-end data solutions using Azure Data Services and Databricks.
  • Collaborate with cross-functional teams including data science, analytics, product, and business stakeholders to understand requirements and deliver impactful data products.
  • Drive best practices in data engineering, coding standards, version control, CI/CD, and monitoring.
  • Ensure high data quality, governance, and compliance with internal and external policies.
  • Optimize performance and cost efficiency of data infrastructure in the cloud.
  • Stay current with industry trends, emerging technologies, and apply them to improve system architecture and team capabilities.

Required Skills & Qualifications:

  • Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
  • 8+ years of experience in software/data engineering with at least 3 years in a leadership or managerial role.
  • Proven hands-on experience with:
  • Big Data ecosystems (Spark, Hive, Hadoop)
  • Azure Cloud Services (Data Lake, Data Factory, Synapse Analytics, Blob Storage)
  • Databricks (including Delta Lake, MLFlow, Unity Catalog)
  • Strong programming experience in Python, Scala, or Java.
  • Deep understanding of data modeling, ETL/ELT processes, and performance tuning.
  • Experience managing Agile teams and delivering complex projects on time.
  • Excellent problem-solving, leadership, and communication skills.

Preferred Qualifications:

  • Certification in Azure Data Engineer or Azure Solutions Architect.
  • Experience with data governance, security, and compliance (e.g., GDPR, HIPAA).
  • Familiarity with ML/AI workflows and collaboration with data science teams.

  • Senior Big Data Engineer

    8 hours ago

    india, IN Veltris Full time

    Veltris is a Digital Product Engineering Services partner committed to driving technology-enabled transformation across enterprises, businesses, and industries. We specialize in delivering next-generation solutions for sectors including healthcare, technology, communications, manufacturing, and finance. With a focus on innovation and acceleration, Veltris...

  • Senior Engineering Manager-Big Data, Generative AI

    8 hours ago

    india, IN Extreme Networks Full time

    Over 50,000 customers globally trust our end-to-end, cloud-driven networking solutions. They rely on our top-rated services and support to accelerate their digital transformation efforts and deliver unprecedented progress. With double-digit growth year over year, no provider is better positioned to deliver scalable outcomes than Extreme.Inclusion is one of...

  • Big Data with Quantexa-Pan India

    8 hours ago

    , India, IN Tata Consultancy Services Full time

    Dear Candidates,Greetings from TCS TAG team,We are looking for Big data developer with Quantexa as mandatory skill.Location-Pan IndiaExperience Range- 5 to 12 yearsData Engineer - Big Data Hadoop, Spark and ScalaSpark, Scala, Hadoop, HIVE, Oozie, Shell Script, Quantexa(Mandatory)Please hit apply button and fill details for the job application.Desired...

  • Data Engineer

    8 hours ago

    india, IN Data-Hat AI Full time

    Department: Data Engineering & AI Solutions Reports To: Lead Data Solutions Architect Travel: International travel required (up to 30–40%) Position Summary: We are hiring a senior-level Data Engineer to lead the design, development, and optimization of high-performance data infrastructure that underpins mission-critical AI systems. With 12+ years of...

  • Senior Data Engineer

    8 hours ago

    india, IN Infogain Full time

    Job Summary:Big Data Engineer (Lead): As a Big Data Engineer (Lead), you will be responsible for leading a team of big data engineers. You will work closely with clients and team members to understand their requirements and develop architectures that meet their needs. You will also be responsible for providing technical leadership and guidance to your...

  • Data Engineering Azure databricks

    8 hours ago

    india, IN EXL Full time

    Data Engineer (DE) Consultant is responsible for designing, developing, and maintaining data assets and data related products by liaising with multiple stakeholders.Responsibilities:Work with stakeholders to understand the data requirements to design, develop, and maintain complex ETL processes.Create the data integration and data diagram documentation.Lead...

  • Senior Data Engineer

    8 hours ago

    india, IN CareerXperts Consulting Full time

    We are looking for a highly skilled Senior Data Engineer to design, build, and optimize scalable data pipelines and infrastructure. The ideal candidate will have strong expertise in modern data engineering tools and frameworks, along with the ability to collaborate closely with data scientists, analysts, and product teams to deliver reliable and efficient...

  • GCP Data Engineer

    8 hours ago

    Bangalore Urban, Karnataka, India, IN Impetus Full time

    About ImpetusImpetus Technologies is a digital engineering company focused on delivering expert services and products to help enterprises achieve their transformation goals. We solve the analytics, AI, and cloud puzzle, enabling businesses to drive unmatched innovation and growth.Founded in 1991, we are cloud and data engineering leaders providing solutions...

  • Lead Data Engineer

    8 hours ago

    , India, IN Searce Inc Full time

    Who we are?Searce means ‘a fine sieve’ & indicates ‘to refine, to analyze, to improve’. It signifies our way of working: To improve to the finest degree of excellence, ‘solving for better’ every time. Searcians are passionate improvers & solvers who love to question the status quo.The primary purpose of all of us, at Searce, is driving...

  • Senior Principal Data Engineer

    8 hours ago

    Bangalore Urban, Karnataka, India, IN MakeMyTrip Full time

    Position: Senior Principal Data EngineerExperience: Must have 10+ years of experienceAbout Role:We are looking for experienced Data engineers with excellent problem-solving skills to develop machine-learning powered Data Products design to enhance customer experiences.About us:Nurtured from the seed of a single great idea - to empower the traveler -...