Senior Data Engineer

3 days ago

India EXL Full time

About the Role

We are seeking a highly skilled Data Engineer with deep expertise in Microsoft Azure to design, build, and optimize scalable data pipelines and Lakehouse architectures. You will work closely with cross-functional teams to provide thought leadership deliver robust, secure, and high-performance data solutions that empower analytics and data science initiatives.

Key Responsibilities

- Design, develop, and maintain scalable data pipelines using Azure Data Factory and Azure Synapse Analytics.
- Build and optimize lakehouse architectures on Azure using Delta Lake.
- Work closely with client stakeholders to understand their requirements and provide thought leadership to translate the same into technical scripts.
- Implement data ingestion, transformation, and orchestration workflows from diverse sources (APIs, databases, cloud storage).
- Ensure data quality, consistency, and security across the data lifecycle.
- Leverage Azure services such as Data Lake Storage Gen2, Event Hubs, Azure Functions, and Key Vault.
- Implement Infrastructure as Code (IaC) using Terraform or Bicep for automated provisioning and configuration.
- Optimize cloud resource usage for performance and cost-efficiency.
- Design and implement star schema and other data modeling techniques to support analytical workloads.
- Collaborate with analysts and data scientists to deliver advanced analytics solutions.
- Conduct data quality assessments and contribute to data governance initiatives.
- Participate in design reviews, code reviews, and cross-functional planning sessions.

Required Technical Skills

- Expert-level experience with Azure Data Services: Azure Data Factory, Azure Databricks, Azure Synapse, Azure Data Lake Storage.
- Strong proficiency in SQL for complex transformations and performance tuning.
- Advanced Python skills for data pipeline development and orchestration.
- Experience with Terraform or similar IaC tools for Azure.
- Familiarity with CI/CD pipelines and DevOps practices.
- Experience with containerization (Docker, Kubernetes) is a plus.
- Strong understanding of data governance, security (RBAC, VNETs, Managed Identities), and compliance in Azure.
- Experience with batch and streaming data processing using tools like Structured Streaming or Event Hubs.

Soft Skills & Mindset

- Growth mindset with a passion for continuous learning and innovation.
- Strong collaboration skills across engineering, analytics, and business teams.
- Robust client management skills
- Structured problem-solving approach with a focus on scalability and maintainability.
- Resilient under pressure with a solution-oriented attitude.
- Excellent communication and documentation skills.

Preferred Qualifications

- Microsoft Certified: Azure Data Engineer Associate or equivalent.
- Experience with Delta Live Tables, Unity Catalog, or MLflow is a plus.
- Familiarity with GCP or AWS is a bonus.

  • Senior data engineer

    5 days ago

    India Beige Bananas Full time

    Company Description Beige Bananas is a rapidly growing pure play AI consulting firm that focuses on building hyper custom AI products for Fortune 500 Retail, CPG, and Media companies. The company embraces an outcome-driven mindset to help clients accelerate value realization from their analytics investments. Role Description This is a full-time remote...

  • Senior Associate Data Engineer

    1 week ago

    Bengaluru, India NTT DATA, Inc. Full time

    Job Description Make an impact with NTT DATA Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion its a place where you can grow, belong and thrive. Your day at NTT...

  • Senior Data Engineer

    5 days ago

    India Beige Bananas Full time

    Company DescriptionBeige Bananas is a rapidly growing pure play AI consulting firm that focuses on building hyper custom AI products for Fortune 500 Retail, CPG, and Media companies. The company embraces an outcome-driven mindset to help clients accelerate value realization from their analytics investments.Role DescriptionThis is a full-time remote role for...

  • Senior GenAI Engineers

    1 week ago

    Pune, India NTT Data Full time

    Job Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Senior GenAI Engineers to join our team in Pune, Mahrshtra (IN-MH), India (IN). Location: | Experience: 8+...

  • Senior GenAI Engineers

    1 week ago

    Mumbai, India NTT Data Full time

    Job Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Senior GenAI Engineers to join our team in Mumbai, Mahrshtra (IN-MH), India (IN). Location: | Experience: 8+...

  • Senior Azure Stack Engineer

    3 weeks ago

    Remote, India NTT Data Full time

    Job DescriptionNTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Azure Stack Engineer to join our team in Remote, Uttar Pradesh (IN-UP), India (IN).Job Title: Senior Azure Stack...

  • Lead Data Engineer

    5 days ago

    India Eucloid Data Solutions Full time

    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which may include starting from up- stream and down-stream technology selection to designing and building of...

  • Lead Data Engineer

    5 days ago

    India Eucloid Data Solutions Full time

    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which may include starting from up- stream and down-stream technology selection to designing and building of...

  • Lead Data Engineer

    3 days ago

    India Eucloid Data Solutions Full time

    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which may include starting from up- stream and down-stream technology selection to designing and building of...

  • Lead Data Engineer

    4 days ago

    India Eucloid Data Solutions Full time

    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which may include starting from up- stream and down-stream technology selection to designing and building of...