Engineering Manager – Big Data, Azure

4 weeks ago

India DataE2E Technologies Full time

Job Title: Engineering Manager – Big Data, Azure & Databricks

Location: Remote

Employment Type: Full-time

Department: Data Engineering / Technology

Experience: 8+ years (3+ years in a managerial role)

About the Role:

We are seeking a highly experienced and strategic Engineering Manager with deep expertise in Big Data platforms, Microsoft Azure, and Databricks. The ideal candidate will lead a team of talented data engineers to design and deliver scalable data pipelines and analytics platforms, ensuring high performance, reliability, and security in a cloud-native environment.

Key Responsibilities:

  • Lead, mentor, and grow a team of data engineers working on large-scale distributed data systems.
  • Architect and oversee the development of end-to-end data solutions using Azure Data Services and Databricks.
  • Collaborate with cross-functional teams including data science, analytics, product, and business stakeholders to understand requirements and deliver impactful data products.
  • Drive best practices in data engineering, coding standards, version control, CI/CD, and monitoring.
  • Ensure high data quality, governance, and compliance with internal and external policies.
  • Optimize performance and cost efficiency of data infrastructure in the cloud.
  • Stay current with industry trends, emerging technologies, and apply them to improve system architecture and team capabilities.

Required Skills & Qualifications:

  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
  • 8+ years of experience in software/data engineering with at least 3 years in a leadership or managerial role.
  • Proven hands-on experience with:
  • Big Data ecosystems (Spark, Hive, Hadoop)
  • Azure Cloud Services (Data Lake, Data Factory, Synapse Analytics, Blob Storage)
  • Databricks (including Delta Lake, MLFlow, Unity Catalog)
  • Strong programming experience in Python, Scala, or Java.
  • Deep understanding of data modeling, ETL/ELT processes, and performance tuning.
  • Experience managing Agile teams and delivering complex projects on time.
  • Excellent problem-solving, leadership, and communication skills.

Preferred Qualifications:

  • Certification in Azure Data Engineer or Azure Solutions Architect.
  • Experience with data governance, security, and compliance (e.g., GDPR, HIPAA).
  • Familiarity with ML/AI workflows and collaboration with data science teams.

  • Big Data

    3 weeks ago

    India Technomech Placements Full time

    Job Title Big Data DeveloperExperience 4 to 10 yearsLocation Pune Bangalore Gurgaon Develop optimize and maintain big data solutions Work with Hadoop Spark Hive and other big data technologies Design and implement scalable data pipelines Collaborate with cross-functional teams for data-driven solutions Strong programming skills in Java Scala...

  • Senior Azure Databricks Engineer

    4 weeks ago

    India Quant-data Full time

    We're Hiring: Senior Azure Databricks Engineer (Remote | Full-Time) Join us to build scalable, cloud-native data solutions using cutting-edge technologiesWe're looking for an experienced and driven Senior Azure Databricks Engineer to join our growing team. This role is ideal for professionals with 6–10 years of experience in the data engineering space,...

  • Sr Azure Data Engineer

    4 weeks ago

    India Techolution Full time

    We are seeking a skilled Sr Azure Data Engineer with hands-on experience in modern data engineering tools and platforms within the Azure ecosystem .The ideal candidate will have a strong foundation in data integration, transformation, and migration , along with a passion for working on complex data migration projects . Job Title: Sr.Azure Data Engineer...

  • Azure Data Engineer

    3 weeks ago

    India MindBrain Full time

    Position: Azure Data Engineer Location: Remote Experience: 4+ Years Notice Period: Immediate Joiners Only Overview: We are looking for an experienced Azure Data Engineer to work in a hybrid Developer + Support role.The position involves enhancing and supporting existing Data & Analytics solutions using Azure technologies, ensuring performance, scalability,...

  • Big Data Architect

    1 day ago

    India Kyndryl Full time

    542663BR **Why Kyndryl** - Our world has never been more alive with opportunities and, at Kyndryl, we’re ready to seize them. We design, build, manage and modernize the mission-critical technology systems that the world depends on every day. Kyndryl is at the heart of progress — dedicated to helping companies and people grow strong. Our people are...

  • Azure Data Engineer

    3 weeks ago

    India MindBrain Full time

    Position: Azure Data Engineer Location: Remote Experience: 4+ Years Notice Period: Immediate Joiners OnlyOverview: We are looking for an experienced Azure Data Engineer to work in a hybrid Developer + Support role. The position involves enhancing and supporting existing Data & Analytics solutions using Azure technologies, ensuring performance, scalability,...

  • Sr Azure Data Engineer

    3 weeks ago

    India Techolution Full time

    We are seeking a skilled Sr Azure Data Engineer with hands-on experience in modern data engineering tools and platforms within the Azure ecosystem.The ideal candidate will have a strong foundation in data integration, transformation, and migration, along with a passion for working on complex data migration projects.Job Title: Sr.Azure Data Engineer Location:...

  • Azure Data Engineer

    3 weeks ago

    India Bloom Consulting Services Full time

    Module Lead Experience Range 6 Years Primary Must have skills - To be Screened by TA Team 3 years of experience in Azure Databricks with PySpark 2 years of experience in Databricks workflow Unity catalog 2 years of experience in ADF Azure Data Factory 2 years of experience in ADLS Gen 22 years of experience in Azure SQL 3 years of...

  • Big Data Engineer

    2 weeks ago

    India Amazon Music Full time

    Job DescriptionDESCRIPTIONProfit Intelligence team in Amazon Retail is seeking a seasoned and talented Senior Data Engineer to join the Historical Contribution Profit (HCP) team. HCP is a fast growing team with a mandate to build tools to automate profit-and-loss forecasting and planning for the Physical Consumer business. We are building the next generation...

  • Azure Data Engineer

    4 weeks ago

    India Sourcebae Full time

    Job Title: Azure Data Engineer (Developer + Support) Shift: 11 AM–8 PM / 2 PM–11 PM / 5 PM–2 AM (Rotational) Overview: We're hiring an Azure Data Engineer with 6 years of experience to support and enhance Azure-based data and analytics solutions.The ideal candidate will work in a hybrid development + support role, ensuring high performance,...