Data Engineer- Azure Databricks

1 day ago

Chennai, Tamil Nadu, India InfoCepts Full time ₹ 6,00,000 - ₹ 8,00,000 per year

Position: Data Engineer ? Azure Databricks

Purpose of the Position:

To design, build, and optimize scalable data pipelines and solutions using Azure Databricks and related technologies, enabling Zodiac Maritime to make faster, data-driven decisions as part of its data transformation journey.

Proficiency in data integration techniques, ETL processes and data pipeline architectures. Well versed in Data Quality rules, principles and implementation.

Location: Nagpur/ Pune/ Chennai/ Bangalore

Type of Employment: FTE

Key Result Areas and Activities:

  • Data Pipeline Development: Design and implement robust batch and streaming data pipelines using Azure Databricks and Spark.

  • Data Architecture Implementation: Apply Medallion Architecture to structure data layers (raw, enriched, curated).

  • Data Quality & Governance: Ensure data accuracy, consistency, and governance using tools like Azure Purview and Unity Catalog.

  • Performance Optimization: Optimize Spark jobs, Delta Lake tables, and SQL queries for efficiency and cost-effectiveness.

  • Collaboration & Delivery: Work closely with analysts, architects, and business teams to deliver end-to-end data solutions.

Technical Experience:

Must Have:

  • Hands-on experience with Azure Databricks, Delta Lake, Data Factory.

  • Proficiency in Python, PySpark, and SQL with strong query optimization skills.

  • Deep understanding of Lakehouse architecture and Medallion design patterns.

  • Experience building scalable ETL/ELT pipelines and data transformations.

  • Familiarity with Git, CI/CD pipelines, and Agile methodologies.

Good To Have:

  • Knowledge of data quality frameworks and monitoring practices.

  • Experience with Power BI or other data visualization tools.

  • Understanding of IoT data pipelines and streaming technologies like Kafka/Event Hubs.

  • Awareness of emerging technologies such as Knowledge Graphs.

Qualifications:

  • Education: Likely a degree in Computer Science, Data Engineering, Information Systems, or a related field.

  • Experience:

  • Proven hands-on experience with Azure data stack (Databricks, Data Factory, Delta Lake).

  • Experience in building scalable ETL/ELT pipelines.

  • Familiarity with data governance and DevOps practices.

Qualities:

  • Strong problem-solving and analytical skills

  • Attention to detail and commitment to data quality

  • Collaborative mindset and effective communication

  • Proactive and self-driven

  • Passion for learning and staying updated with emerging data technologies

Years Of Exp

5 to 7 years

Location

India

  • Azure DataBricks

    24 hours ago

    Chennai, Tamil Nadu, India Hexaware Technologies Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    We're on the lookout for passionate Azure Data Engineers who want to redefine the future of data with Databricks & Azure.Role: ADB – Data Engineer (Azure, Databricks, ADF, PySpark/Python)Date: Saturday, 13/09/2025Mode: F2F Discussion at Hexaware Technologies , Siruseri ,Chennai ,Bring your expertise in:Datawarehousing & ETL (10+ yrs)Azure, ADF, Synapse,...

  • Azure Databricks Administrator

    5 hours ago

    Chennai, Tamil Nadu, India Randomtrees Full time ₹ 1,50,000 - ₹ 28,00,000 per year

    Roles and ResponsibilitiesDesign, implement, and maintain Azure Databricks clusters for data engineering workloads.Configure and manage Azure DevOps pipelines for CI/CD processes using Python scripts.Migrate on-premises databases to Azure platforms using Data Bricks migration tools.Troubleshoot issues related to Azure Databricks cluster performance,...

  • Databricks Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India NRM Analytix Full time

    We are hiring a Databricks Data Engineer for a remote, full-time role. The ideal candidate should meet the following requirements:1 to 5 years of overall experience in data engineering.At least 1 year of hands-on experience with Databricks technology.Strong working knowledge of Databricks Delta Lake and PySpark.Experience on cloud platforms like AWS or...

  • Azure Databricks Engineer

    3 hours ago

    Chennai, Tamil Nadu, India Capgemini Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you'd like, where you'll be supported and inspired by a collaborative community of colleagues around the world, and where you'll be able to reimagine what's possible. Join us and help the world's leading organizations unlock the value of technology and...

  • Azure Data Engineer

    2 days ago

    Chennai, Tamil Nadu, India Colan Infotech Private Limited Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Job descriptionRole: Azure Data EngineerExperience: 3-5 YearsSkill set:Pyspark / Scala Spark, Python, Azure Databricks and Azure Data Factory Roles and Responsibilities: Should have programming skills with the ability to write optimized and reusable high-quality code. Design, develop and maintain scalable data pipelines using Pyspark / Scala Spark,...

  • Databricks Data Engineer 6+ years

    2 days ago

    Chennai, Tamil Nadu, India Raah Techservices Full time ₹ 4,69,000 - ₹ 18,17,548 per year

    Position OverviewWe are looking for an experienced Databricks Data Engineer with 6+ years of expertise in building and managing large-scale data platforms. The ideal candidate will have strong hands-on experience with Databricks, Spark, and Cloud Data Engineering practices. This role involves designing, developing, and optimizing data pipelines, enabling...

  • Databricks Engineer

    4 weeks ago

    Chennai, Tamil Nadu, India HIMFLAX INFORMATION TECHNOLOGIES PRIVATE LIMITED Full time

    Job Description :We are seeking an experienced contractor with strong expertise in Databricks and Python to support data engineering and analytics initiatives. The role involves working on data pipelines, transformations, and integrations using Databricks, with Python as a supporting skill. The ideal candidate should have a minimum of 8 years of overall IT...

  • Azure Data Engineer Specialist

    2 days ago

    Chennai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Job OverviewWe are seeking a skilled Data Engineer to design, build, and maintain robust data pipelines on the Microsoft Azure platform. The ideal candidate will be responsible for integrating, transforming, and consolidating data from various sources to enable business intelligence and analytics.Key Responsibilities:Data Pipeline Development: Design and...

  • Azure Data Engineer

    22 hours ago

    Chennai, Tamil Nadu, India Kovan Technology Solutions Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Hi Professionals,Apply :  Hiring: Data Engineer (Azure Data Platform, ADF, Python, PySpark) Location: Hyderabad, Bangalore, ChennaiMode of Work: Work from OfficeExperience: YearsJob Description:Bachelor's or master's degree in Computer Science, IT, or related field.5+ years of data engineering experience, including 1+ years on Azure Data Platform.Strong...

  • Data Engineer

    2 days ago

    Chennai, Tamil Nadu, India NTT DATA Full time US$ 80,000 - US$ 1,20,000 per year

    Req ID: 336026NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer - Azure to join our team in Chennai, Tamil Nādu (IN-TN), India (IN). "Job Duties: Key Responsibilities:...