Data Engineer- Azure Databricks

2 weeks ago


Chennai, India InfoCepts Full time

Position: Data Engineer ? Azure Databricks

Purpose of the Position:

To design, build, and optimize scalable data pipelines and solutions using Azure Databricks and related technologies, enabling Zodiac Maritime to make faster, data-driven decisions as part of its data transformation journey.

Proficiency in data integration techniques, ETL processes and data pipeline architectures. Well versed in Data Quality rules, principles and implementation.

Location: Nagpur/ Pune/ Chennai/ Bangalore

Type of Employment: FTE

Key Result Areas and Activities:

  • Data Pipeline Development: Design and implement robust batch and streaming data pipelines using Azure Databricks and Spark.

  • Data Architecture Implementation: Apply Medallion Architecture to structure data layers (raw, enriched, curated).

  • Data Quality & Governance: Ensure data accuracy, consistency, and governance using tools like Azure Purview and Unity Catalog.

  • Performance Optimization: Optimize Spark jobs, Delta Lake tables, and SQL queries for efficiency and cost-effectiveness.

  • Collaboration & Delivery: Work closely with analysts, architects, and business teams to deliver end-to-end data solutions.

Technical Experience:

Must Have:

  • Hands-on experience with Azure Databricks, Delta Lake, Data Factory.

  • Proficiency in Python, PySpark, and SQL with strong query optimization skills.

  • Deep understanding of Lakehouse architecture and Medallion design patterns.

  • Experience building scalable ETL/ELT pipelines and data transformations.

  • Familiarity with Git, CI/CD pipelines, and Agile methodologies.

Good To Have:

  • Knowledge of data quality frameworks and monitoring practices.

  • Experience with Power BI or other data visualization tools.

  • Understanding of IoT data pipelines and streaming technologies like Kafka/Event Hubs.

  • Awareness of emerging technologies such as Knowledge Graphs.

Qualifications:

  • Education: Likely a degree in Computer Science, Data Engineering, Information Systems, or a related field.

  • Experience:

  • Proven hands-on experience with Azure data stack (Databricks, Data Factory, Delta Lake).

  • Experience in building scalable ETL/ELT pipelines.

  • Familiarity with data governance and DevOps practices.

Qualities:

  • Strong problem-solving and analytical skills

  • Attention to detail and commitment to data quality

  • Collaborative mindset and effective communication

  • Proactive and self-driven

  • Passion for learning and staying updated with emerging data technologies

Years Of Exp

5 to 7 years

Location

India


  • Azure DataBricks

    2 weeks ago


    Chennai, India Hexaware Technologies Full time

    We're on the lookout for passionate Azure Data Engineers who want to redefine the future of data with Databricks & Azure. Role: ADB – Data Engineer (Azure, Databricks, ADF, PySpark/Python) Date: Saturday, 13/09/2025 Mode: F2F Discussion at Hexaware Technologies , Siruseri ,Chennai , Bring your expertise in: Datawarehousing & ETL (10+ yrs) Azure, ADF,...

  • Azure DataBricks

    21 hours ago


    Chennai, Tamil Nadu, India Hexaware Technologies Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    We're on the lookout for passionate Azure Data Engineers who want to redefine the future of data with Databricks & Azure.Role: ADB – Data Engineer (Azure, Databricks, ADF, PySpark/Python)Date: Saturday, 13/09/2025Mode: F2F Discussion at Hexaware Technologies , Siruseri ,Chennai ,Bring your expertise in:Datawarehousing & ETL (10+ yrs)Azure, ADF, Synapse,...


  • Chennai, Tamil Nadu, India InfoCepts Full time ₹ 6,00,000 - ₹ 12,00,000 per year

    Position: Data Engineer ? Azure DatabricksPurpose of the Position:To design, build, and optimize scalable data pipelines and solutions using Azure Databricks and related technologies, enabling Zodiac Maritime to make faster, data-driven decisions as part of its data transformation journey.Proficiency in data integration techniques, ETL processes and data...

  • Data Engineer

    2 weeks ago


    Chennai, India One Degree North HR Services Full time

    We are looking for a Data Engineer with hands-on experience in Azure Data Factory, Azure Databricks, PySpark, and .NET Framework to design and maintain efficient, scalable data pipelines and analytics platforms. The ideal candidate will be responsible for application integration, workflow automation, and leveraging Azure Synapse for advanced data warehousing...


  • Chennai, Indore, Pune, India Infobeans Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    What will your role look likeDesign, develop, and optimize data solutions for risk, regulatory, and compliance projects on the Azure platform.Lead on-prem to cloud migration initiatives, ensuring scalability, performance, and security.Administer, configure, and optimize the Azure Databricks platform, including clusters and Unity Catalog repository.Build...


  • Chennai, India Randomtrees Full time

    Roles and Responsibilities Design, implement, and maintain Azure Databricks clusters for data engineering workloads. Configure and manage Azure DevOps pipelines for CI/CD processes using Python scripts. Migrate on-premises databases to Azure platforms using Data Bricks migration tools. Troubleshoot issues related to Azure Databricks cluster performance,...


  • Bengaluru, Chennai, Hyderabad, India Cognizant Full time ₹ 12,00,000 - ₹ 25,00,000 per year

    ***We are hiring for Azure Databricks Cognizant technology solution***Skill - Azure DatabricksExperience YearsLocation- IndiaInterview mode - Video discussion followed by F2FJob Description:Minimum 7+ years of experience in Databricks would be preferable.Must have hands on Databricks experience on design, and development of the batch and real-time...

  • Azure Data Engineer

    2 days ago


    Chennai, Tamil Nadu, India Qrata Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Position : Azure Data EngineerExperience : 3 to 5 YearsJob Type : Full-timeJob Summary : We are seeking a skilled Azure Data Engineer with 35 years of experience to design, develop, and maintain scalable data pipelines within the Microsoft Azure ecosystem. The ideal candidate will have strong expertise in Azure Data Factory, Azure Databricks,...


  • Chennai, India Capgemini Full time

    Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you'd like, where you'll be supported and inspired by a collaborative community of colleagues around the world, and where you'll be able to reimagine what's possible. Join us and help the world's leading organizations unlock the value of technology and...


  • Chennai, Tamil Nadu, India Cognizant Full time

    **Skill: Cloud Data Architect - Azure Databricks** **Role: Solution Architect** Solutioning lead for NA Data Engineering - Azure and Databicks as primary stack **Roles and responsibilities**: 1) Architecture and Solutioning on Azure, databricks data platforms, expertise on architecture patterns - data warehosue, lakehouse, data fabric and datamesh 2)...