Senior Data Engineer- Azure Databricks

22 hours ago

Chennai, Tamil Nadu, India InfoCepts Full time ₹ 12,00,000 - ₹ 36,00,000 per year

Position: Data Engineer- Azure Databricks

Purpose of the Position:

To design, build, and optimize scalable data pipelines and solutions using Azure Databricks and related technologies, enabling Zodiac Maritime to make faster, data-driven decisions as part of its data transformation journey.

Proficiency in data integration techniques, ETL processes and data pipeline architectures. Well versed in Data Quality rules, principles and implementation.

Location: Nagpur/ Pune/ Chennai/ Bangalore

Type of Employment: FTE

Key Result Areas and Activities:

  • Data Pipeline Development: Design and implement robust batch and streaming data pipelines using Azure Databricks and Spark.

  • Data Architecture Implementation: Apply Medallion Architecture to structure data layers (raw, enriched, curated).

  • Data Quality & Governance: Ensure data accuracy, consistency, and governance using tools like Azure Purview and Unity Catalog.

  • Performance Optimization: Optimize Spark jobs, Delta Lake tables, and SQL queries for efficiency and cost-effectiveness.

  • Collaboration & Delivery: Work closely with analysts, architects, and business teams to deliver end-to-end data solutions.

Technical Experience:

Must Have:

  • Hands-on experience with Azure Databricks, Delta Lake, Data Factory.

  • Proficiency in Python, PySpark, and SQL with strong query optimization skills.

  • Deep understanding of Lakehouse architecture and Medallion design patterns.

  • Experience building scalable ETL/ELT pipelines and data transformations.

  • Familiarity with Git, CI/CD pipelines, and Agile methodologies.

Good To Have:

  • Knowledge of data quality frameworks and monitoring practices.

  • Experience with Power BI or other data visualization tools.

  • Understanding of IoT data pipelines and streaming technologies like Kafka/Event Hubs.

  • Awareness of emerging technologies such as Knowledge Graphs.

Qualifications:

  • Education: Likely a degree in Computer Science, Data Engineering, Information Systems, or a related field.
  • Proven hands-on experience with Azure data stack (Databricks, Data Factory, Delta Lake).

  • Experience in building scalable ETL/ELT pipelines.

  • Familiarity with data governance and DevOps practices.

Qualities:

  • Strong problem-solving and analytical skills.

  • Attention to detail and commitment to data quality.

  • Collaborative mindset and effective communication.

Years Of Exp

5 to 9 years

Location

India

  • Senior Data Engineer – Databricks

    18 hours ago

    Chennai, Tamil Nadu, India Zillion Technologies Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Senior Data Engineer – DatabricksLocation: Hyderabad/ChennaiWork Schedule: Timings 2:30 PM to 11:30 PMRole Overview:We are seeking a highly skilled Senior Data Engineer with deep expertise in Databricks to design, build, and optimize scalable data pipelines and architectures. You will collaborate with cross-functional teams including data scientists,...

  • Senior Data Engineer – Azure

    1 week ago

    Chennai, Tamil Nadu, India Systech Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Senior Data Engineer – AzureAbout the CompanySystech is a modern Data and Analytics consulting firm, helping clients embed data-driven capabilities into their business operations. We offer end-to-end data engineering services and outcomes-based analytics solutions, to drive your business forward in the digital age. Systech has over 30 years of experience,...

  • Azure Data Engineer

    6 days ago

    Chennai, Tamil Nadu, India D2KSS SOFTWARE SERVICES PRIVATE LIMITED Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Industry & Sector:IT services and enterprise data engineering — delivering cloud-native analytics, ETL/ELT pipelines, and modern data platform implementations on Microsoft Azure for large enterprise customers. This is an on-site, hands-on engineering role supporting strategic data modernization initiatives across business domains.Primary Job TitleSenior...

  • Azure Databricks Engineer

    4 days ago

    Chennai, Tamil Nadu, India Capgemini Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you'd like, where you'll be supported and inspired by a collaborative community of colleagues around the world, and where you'll be able to reimagine what's possible. Join us and help the world's leading organizations unlock the value of technology and...

  • Azure Data Engineer

    1 week ago

    Chennai, Tamil Nadu, India ResourceTree Global Services Pvt Ltd Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Years of Experience: 5Job Description: We are seeking a skilled and experienced Senior Azure Developer to join our team As part of the team, you will be involved in implementing ongoing and new initiatives for our company. If you love learning, thinking strategically, innovating,and helping others, this job is for youPrimary Skills: ADF,DatabricksSecondary...

  • Azure Data Engineer

    15 hours ago

    Chennai, Tamil Nadu, India DataEngine Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Hiring for Azure Data EngineerExperience: 8+ yearsLocation: Chennai, Hyderabad, BangaloreNotice Period: Immediate to 30 daysKey ResponsibilitiesData Pipelines: Build pipelines for raw data ingestion and orchestration using Azure Data Factory (ADF) and DatabricksData Transformation: Develop and maintain innovative Azure solutions, perform transformation using...

  • Data Engineer – Databricks

    2 weeks ago

    Chennai, Tamil Nadu, India Tata Consultancy Services Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Role Summary:We are looking for aData Engineerwith expertise inAzure Databricks,data transformation, andintegration pipelinesto support forecasting, scheduling, and analytics flows in the WFM Re-Platform program.Key ResponsibilitiesDesign and implement data pipelines in Azure Databricks for ingesting and transforming data from upstream systems (SAP, PIPS,...

  • Data Engineer

    2 days ago

    Chennai, Tamil Nadu, India CX Data Labs Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    HiRole - Azure Data EngineerLocation - Chennai, Gurugram (5days Office)Full timeShift timing 2pm to 11pmKey Responsibilities:· Develop, maintain, and optimize scalable ETL/ELT pipelines using PySpark and Databricks.· Collaborate with cross-functional teams to design and implement data models and data integration solutions.· Create and maintain robust SQL...

  • Azure Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India Colan Infotech Private Limited Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Job descriptionRole: Azure Data EngineerExperience: 3-5 YearsSkill set:Pyspark / Scala Spark, Python, Azure Databricks and Azure Data Factory Roles and Responsibilities: Should have programming skills with the ability to write optimized and reusable high-quality code. Design, develop and maintain scalable data pipelines using Pyspark / Scala Spark,...

  • Data Engineer

    2 days ago

    Chennai, Tamil Nadu, India CX Data Labs Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    HiRole - Azure Data engineerLocation - Chennai, GurugramWork from officeFull timeImmediate joiner Only (15days Notice period only)Candidates with Certification in Databricks is good to haveTechnical Skills:o Proficiency in SQL for complex queries, database design, and optimization.o Strong experience with PySpark for data transformation and processing.o...