Senior Data Engineer

1 day ago

Lucknow, Uttar Pradesh, India EXL Full time

About the Role

We are seeking a highly skilled Data Engineer with deep expertise in Microsoft Azure to design, build, and optimize scalable data pipelines and Lakehouse architectures. You will work closely with cross-functional teams to provide thought leadership deliver robust, secure, and high-performance data solutions that empower analytics and data science initiatives.

Key Responsibilities

  • Design, develop, and maintain scalable data pipelines using Azure Data Factory and Azure Synapse Analytics.
  • Build and optimize lakehouse architectures on Azure using Delta Lake.
  • Work closely with client stakeholders to understand their requirements and provide thought leadership to translate the same into technical scripts.
  • Implement data ingestion, transformation, and orchestration workflows from diverse sources (APIs, databases, cloud storage).
  • Ensure data quality, consistency, and security across the data lifecycle.
  • Leverage Azure services such as Data Lake Storage Gen2, Event Hubs, Azure Functions, and Key Vault.
  • Implement Infrastructure as Code (IaC) using Terraform or Bicep for automated provisioning and configuration.
  • Optimize cloud resource usage for performance and cost-efficiency.
  • Design and implement star schema and other data modeling techniques to support analytical workloads.
  • Collaborate with analysts and data scientists to deliver advanced analytics solutions.
  • Conduct data quality assessments and contribute to data governance initiatives.
  • Participate in design reviews, code reviews, and cross-functional planning sessions.

Required Technical Skills

  • Expert-level experience with Azure Data Services: Azure Data Factory, Azure Databricks, Azure Synapse, Azure Data Lake Storage.
  • Strong proficiency in SQL for complex transformations and performance tuning.
  • Advanced Python skills for data pipeline development and orchestration.
  • Experience with Terraform or similar IaC tools for Azure.
  • Familiarity with CI/CD pipelines and DevOps practices.
  • Experience with containerization (Docker, Kubernetes) is a plus.
  • Strong understanding of data governance, security (RBAC, VNETs, Managed Identities), and compliance in Azure.
  • Experience with batch and streaming data processing using tools like Structured Streaming or Event Hubs.

Soft Skills & Mindset

  • Growth mindset with a passion for continuous learning and innovation.
  • Strong collaboration skills across engineering, analytics, and business teams.
  • Robust client management skills
  • Structured problem-solving approach with a focus on scalability and maintainability.
  • Resilient under pressure with a solution-oriented attitude.
  • Excellent communication and documentation skills.

Preferred Qualifications

  • Microsoft Certified: Azure Data Engineer Associate or equivalent.
  • Experience with Delta Live Tables, Unity Catalog, or MLflow is a plus.
  • Familiarity with GCP or AWS is a bonus.

  • Leading Data Engineer

    7 days ago

    Lucknow, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Senior Data EngineerAre you a data engineering expert looking to leverage your skills in designing, developing and optimizing scalable data pipelines? Do you have experience with Dataiku for data preparation, visualization and building end-to-end data pipelines and applications?As a Senior Data Engineer, you will lead data engineering initiatives focusing on...

  • Senior Data Engineer

    6 days ago

    Lucknow, Uttar Pradesh, India Infogain Full time

    Job Summary:Big Data Engineer (Lead): As a Big Data Engineer (Lead), you will be responsible for leading a team of big data engineers. You will work closely with clients and team members to understand their requirements and develop architectures that meet their needs. You will also be responsible for providing technical leadership and guidance to your...

  • High-Performance Data Engineer

    2 days ago

    Lucknow, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Senior Databricks Data Engineer Job OverviewAt our organization, we are seeking a highly skilled Senior Databricks Data Engineer to join our dynamic data engineering team.We need someone who can design, develop, and maintain scalable and high-performance data pipelines using Databricks and PySpark.Key responsibilities include implementing and managing data...

  • Cloud-Native Data Engineering Expert

    7 days ago

    Lucknow, Uttar Pradesh, India beBeeDataEngineer Full time US$ 1,00,000 - US$ 1,50,000

    Senior Data Engineer OpportunityWe are seeking a seasoned data professional to lead the design, development, and optimization of our data platforms.The ideal candidate will have deep expertise in building scalable data pipelines, implementing enterprise-grade data governance, security, and AI-powered engineering automation.This role will play a pivotal part...

  • Senior Data Architect

    2 days ago

    Lucknow, Uttar Pradesh, India beBeeSeniorDataEngineer Full time ₹ 1,20,00,000 - ₹ 1,50,00,000

    Job Title: Senior Data EngineerWe are seeking a highly skilled individual to join our team as a Senior Data Engineer, responsible for designing, building, and maintaining our modern data platform.This role is perfect for someone with deep technical expertise in ETL pipeline design, data modeling, and data infrastructure who thrives in a fast-paced,...

  • Senior Data Center Engineer

    13 hours ago

    Lucknow, Uttar Pradesh, India beBeeNetwork Full time ₹ 1,00,00,000 - ₹ 1,50,00,000

    Job OverviewWe are seeking a highly skilled Senior Network Specialist to assume key responsibilities within our network engineering team.Design and implement enterprise data center networks using Cisco ACI and Nexus platformsTroubleshoot complex network issues and provide root cause analysisCollaborate with cross-functional teams to deliver scalable and...

  • Senior Data Architect

    2 days ago

    Lucknow, Uttar Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Join a dynamic team as a Data Engineer.Mumbai, India, is the ideal location for this role.Job Description:This is a data engineering position that requires designing, developing, and maintaining scalable data pipelines using PySpark.The ideal candidate will have strong experience in PySpark and hands-on expertise in building scalable data pipelines.Key...

  • Senior Data Systems Specialist

    3 days ago

    Lucknow, Uttar Pradesh, India beBeeData Full time ₹ 12,00,000 - ₹ 15,00,000

    Job Title: Data EngineerWe are seeking a Senior Data Engineer to help implement an application for large retailer.The ideal candidate will have hands-on coding expertise in Python and Pyspark.Required Skills and Qualifications:5+ years of experience as a Data Engineer with strong Big Data experience, GCP preferred.Expertise in Python, Pyspark and SQL with...

  • Data Engineer

    4 weeks ago

    Lucknow, Uttar Pradesh, India Bizdeed HR Solutions Pvt Full time

    Role : Data EngineerJob Location : Lucknow (On-Site)Experience : Min.4+ yrs as Data engineer with Python, SQL and pipeline experienceIMMEDIATE JOINERS ARE PREFERREDRole Responsibilities :- Analyze and organize raw data - Build data systems and pipelines- Prepare data for prescriptive and predictive modeling- Combine raw information from different sources-...

  • Chief Data Engineering Officer

    10 hours ago

    Lucknow, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,04,000 - ₹ 1,30,878

    Senior Data Engineering RoleThis is a challenging and rewarding role that requires strong technical skills in data engineering, including proficiency in tools such as Dataiku.The successful candidate will lead data engineering initiatives and be responsible for designing, developing, and optimizing scalable and robust data pipelines to support business...