Senior Data Engineer

3 weeks ago

Lucknow, Uttar Pradesh, India EXL Full time

About the Role

We are seeking a highly skilled Data Engineer with deep expertise in Microsoft Azure to design, build, and optimize scalable data pipelines and Lakehouse architectures. You will work closely with cross-functional teams to provide thought leadership deliver robust, secure, and high-performance data solutions that empower analytics and data science initiatives.

Key Responsibilities

  • Design, develop, and maintain scalable data pipelines using Azure Data Factory and Azure Synapse Analytics.
  • Build and optimize lakehouse architectures on Azure using Delta Lake.
  • Work closely with client stakeholders to understand their requirements and provide thought leadership to translate the same into technical scripts.
  • Implement data ingestion, transformation, and orchestration workflows from diverse sources (APIs, databases, cloud storage).
  • Ensure data quality, consistency, and security across the data lifecycle.
  • Leverage Azure services such as Data Lake Storage Gen2, Event Hubs, Azure Functions, and Key Vault.
  • Implement Infrastructure as Code (IaC) using Terraform or Bicep for automated provisioning and configuration.
  • Optimize cloud resource usage for performance and cost-efficiency.
  • Design and implement star schema and other data modeling techniques to support analytical workloads.
  • Collaborate with analysts and data scientists to deliver advanced analytics solutions.
  • Conduct data quality assessments and contribute to data governance initiatives.
  • Participate in design reviews, code reviews, and cross-functional planning sessions.

Required Technical Skills

  • Expert-level experience with Azure Data Services: Azure Data Factory, Azure Databricks, Azure Synapse, Azure Data Lake Storage.
  • Strong proficiency in SQL for complex transformations and performance tuning.
  • Advanced Python skills for data pipeline development and orchestration.
  • Experience with Terraform or similar IaC tools for Azure.
  • Familiarity with CI/CD pipelines and DevOps practices.
  • Experience with containerization (Docker, Kubernetes) is a plus.
  • Strong understanding of data governance, security (RBAC, VNETs, Managed Identities), and compliance in Azure.
  • Experience with batch and streaming data processing using tools like Structured Streaming or Event Hubs.

Soft Skills & Mindset

  • Growth mindset with a passion for continuous learning and innovation.
  • Strong collaboration skills across engineering, analytics, and business teams.
  • Robust client management skills
  • Structured problem-solving approach with a focus on scalability and maintainability.
  • Resilient under pressure with a solution-oriented attitude.
  • Excellent communication and documentation skills.

Preferred Qualifications

  • Microsoft Certified: Azure Data Engineer Associate or equivalent.
  • Experience with Delta Live Tables, Unity Catalog, or MLflow is a plus.
  • Familiarity with GCP or AWS is a bonus.

  • Senior Data Engineering Manager

    2 weeks ago

    Lucknow, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 35,00,000

    Job Title: Senior Data Engineering ManagerOur company is looking for an experienced and skilled Data Engineering Manager to lead our team of data engineers.Key Responsibilities:Develop and implement data integration solutions using ETL tools and databases.Design and maintain data warehouses using Oracle, Netezza, Snowflake, Azure SQL, and Hive.Collaborate...

  • Senior Cloud Data Engineer

    2 weeks ago

    Lucknow, Uttar Pradesh, India beBeeCloud Full time ₹ 2,40,00,000 - ₹ 2,60,00,000

    As a Senior Cloud Data Engineer, you will be responsible for designing, developing and maintaining scalable data pipelines using Google Cloud Platform (GCP) tools. This is a unique opportunity to work on challenging projects and leverage your expertise in GCP services.ResponsibilitiesDesign and implement efficient data processing workflows using Big Query,...

  • Senior Data Architect

    2 weeks ago

    Lucknow, Uttar Pradesh, India beBeeData Full time ₹ 18,43,200 - ₹ 25,12,000

    Job Title: Senior Data EngineerA career opportunity has arisen for a seasoned professional to join our dynamic team as a Senior Data Engineer.Design, develop, and implement large-scale data architectures using Azure Data Factory (ADF), Databricks, and Synapse Analytics.Collaborate with cross-functional teams to understand business requirements and design...

  • Senior Data Engineer

    4 weeks ago

    Lucknow, Uttar Pradesh, India Infogain Full time

    Job Summary:Big Data Engineer (Lead): As a Big Data Engineer (Lead), you will be responsible for leading a team of big data engineers. You will work closely with clients and team members to understand their requirements and develop architectures that meet their needs. You will also be responsible for providing technical leadership and guidance to your...

  • Data Engineering Specialist

    2 weeks ago

    Lucknow, Uttar Pradesh, India beBeeAzure Full time ₹ 20,00,000 - ₹ 25,00,000

    Senior Azure Data EngineerWe are seeking a seasoned Data Engineer to join our team, specializing in designing and implementing data solutions on the Azure platform.Design and develop efficient data pipelines using Azure Data Factory, Databricks, and PySpark to process large datasets.Collaborate with cross-functional teams to implement data integration, ETL...

  • Chief Data Engineer

    2 weeks ago

    Lucknow, Uttar Pradesh, India beBeeDataDriven Full time ₹ 20,00,000 - ₹ 25,00,000

    Unlock the Power of Data with Our TeamAs a senior data engineer, you play a pivotal role in driving digital success by empowering businesses to transform data into actionable insights.Lead end-to-end migrations and design efficient pipelines to optimize workflows and ensure data quality, governance, and security standards.Develop best practices for data...

  • Data Engineering Leadership Position

    2 weeks ago

    Lucknow, Uttar Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Senior Data Engineer RoleWe seek a skilled professional to lead our data engineering initiatives at Coforge.The ideal candidate will have a passion for crafting robust data pipelines and strong leadership abilities.Key Responsibilities:Develop and refine intricate ETL pipelines for processing high data volumes.Ensure data precision, coherence, and system...

  • Senior Data Engineer Position

    2 weeks ago

    Lucknow, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Data Engineer Opportunity We are seeking a skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems. Key Responsibilities: Design, implement, and maintain data pipelines for structured and unstructured data.Develop and deploy scalable data processing systems using...

  • Data Engineering Project Manager

    2 weeks ago

    Lucknow, Uttar Pradesh, India beBeeProject Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior Technical Project LeadAbout the Role:We are seeking an experienced Senior Technical Project Lead to manage and deliver technical projects in data engineering and analytics, collaborating with cross-functional teams.The ideal candidate will plan, execute, and deliver projects on time, within scope, and with efficient resource allocation.Key...

  • Chief Data Engineering Operations Leader

    2 weeks ago

    Lucknow, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,02,50,000

    Senior Data Engineering Project ManagerThe ideal candidate will have hands-on experience in managing data engineering, analytics, or AI/ML projects from start to finish.Key Responsibilities:Develop and implement comprehensive project plans, roadmaps, and timelines for data ingestion, transformation, governance, AI/ML models, and analytics deliverables.Lead...