Senior Data Engineer – Databricks

3 days ago


Chennai, Tamil Nadu, India Zillion Technologies Full time ₹ 8,00,000 - ₹ 24,00,000 per year

Senior Data Engineer – Databricks

Location: Hyderabad/Chennai

Work Schedule: Timings 2:30 PM to 11:30 PM

Role Overview:

We are seeking a highly skilled Senior Data Engineer with deep expertise in Databricks to design, build, and optimize scalable data pipelines and architectures. You will collaborate with cross-functional teams including data scientists, analysts, and platform engineers to deliver high-quality, reliable, and secure data solutions.

Key Responsibilities:

  • Design, develop, and maintain robust batch and streaming data pipelines using Databricks, Apache Spark, Delta Lake, and PySpark.
  • Build and optimize ETL/ELT workflows to transform and integrate data from diverse sources.
  • Implement Delta Live Tables (DLT) and Databricks Workflows for pipeline orchestration and automation.
  • Ensure data quality, observability, and monitoring across all pipelines.
  • Collaborate with cloud platform teams (AWS/Azure) to ensure proper setup of storage, networking, and security.
  • Work within Agile teams, participating in sprint planning, code reviews, and deployments.
  • Document pipeline processes, technical specifications, and architectural decisions.
  • Stay current with emerging technologies and best practices in data engineering and cloud-native solutions.

Required Qualifications:

  • Bachelor's or Master's degree in Computer Science, Engineering, or related field.
  • Around 5 years of experience in data engineering, with 3+ years hands-on in Databricks.
  • Strong proficiency in PySpark, SQL, and Apache Spark.
  • Experience with cloud platforms (Azure or AWS) and big data technologies (e.g., Kafka, Hadoop).
  • Solid understanding of data warehousing, data modeling, and ETL processes.
  • Familiarity with data governance, security, and compliance frameworks.

Preferred Skills:

  • Experience with Delta Live Tables (DLT) and Unity Catalog.
  • Knowledge of CI/CD pipelines, Git, and DevOps practices.
  • Certifications in Databricks, AWS, or Azure are an added advantage.

Soft Skills:

  • Excellent communication and collaboration skills.
  • Strong problem-solving and analytical mindset.
  • Ability to work independently and lead initiatives.

Job Types: Full-time, Permanent

Work Location: In person



  • Chennai, Tamil Nadu, India, Tamil Nadu Tata Consultancy Services Full time

    About the RoleThe Databricks Data Engineer will play a crucial role in migrating and optimizing data workflows, ensuring high performance and reliability in our data operations.Experience- 3 to 6 yearsLocation - Kolkata /Chennai/TrivandrumRequired Technical Skill Set ------ Databricks, AWS, Python & PySparkGood to have- Experience in AWS platform (S3, EC2,...

  • Data Engineer

    3 days ago


    Chennai, Tamil Nadu, India CX Data Labs Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    HiRole - Azure Data EngineerLocation - Chennai, Gurugram (5days Office)Full timeShift timing 2pm to 11pmKey Responsibilities:· Develop, maintain, and optimize scalable ETL/ELT pipelines using PySpark and Databricks.· Collaborate with cross-functional teams to design and implement data models and data integration solutions.· Create and maintain robust SQL...


  • Chennai, Tamil Nadu, India Grethena Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Company Description:Company:  Grethena Private LimitedLocation:  ChennaiExperience:5+ yearsSalary:   As per market standardsJob Title:Senior Data EngineerAbout us:Grethena - Shaping The Digital Landspace Our team of experts has years of experience in App, AI, OTT Platform and Booking App Development. We are passionate about helping our clients succeed...


  • Chennai, Tamil Nadu, India Zorba Consulting Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Experience : 8-15 years. Primary Roles And Responsibilities : Developing Modern Data Warehouse solutions using Databricks and AWS/ Azure Stack. Ability to provide solutions that are forward-thinking in data engineering and analytics space. Collaborate with DW/BI leads to understand new ETL pipeline development requirements. Triage issues to find gaps in...


  • Chennai, Tamil Nadu, India ixceed Full time ₹ 30,00,000 - ₹ 35,00,000 per year

    Role: Senior Data Engineer (Scala Specialist)Location: ChennaiWork Mode: HybridEmployment Type: Full-time PermanentOverview:We are seeking an experienced Senior Data Engineer with deep expertise in Scala and big data technologies to contribute to a cutting-edge project. This role focuses on designing and implementing high-performance data pipelines and...

  • Senior Data Engineer

    2 weeks ago


    Chennai, Tamil Nadu, India Sightspectrum Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Hi All,We are hiring for Sr Data Engineer position, who can join immediately. If you are interested, drop your resume at Primary Skills: Advanced SQL Server, ETL development using SSIS, Azure Data Factory, and Databricks, Power BI, Data warehousing, Data quality and validation, General Microsoft technology stackJob Summary:We are seeking a highly skilled and...


  • Chennai, Tamil Nadu, India C1X Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    As a Senior Data Engineer, you will design, build, and scale data platforms and pipelines that power our AdTech ecosystem. You will collaborate closely with product, analytics, and engineering teams to ensure data is accurate, reliable, and actionable for business and product decision-making. This role requires strong technical expertise, problem-solving...


  • Chennai, Tamil Nadu, India NotionMindz Technology LLP Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Role:Databricks ArchitectDesignation:Data ArchitectExperience:7–10 yearsLocation:ChennaiAbout the role:We're looking for aDatabricks Architectto design, build, and optimize data pipelines and large-scale integrations for enterprise-grade data environments. The ideal candidate will bring strong experience inAzure Databricks, Data Factory, and SQL-based data...

  • Senior Data Engineer

    2 weeks ago


    Chennai, Tamil Nadu, India Orion Systems Integrators Inc Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Orion Innovation is a premier, award-winning, global business and technology services firm. Orion delivers game-changing business transformation and product development rooted in digital strategy, experience design, and engineering, with a unique combination of agility, scale, and maturity. We work with a wide range of clients across many industries...

  • Data Engineer

    5 days ago


    Chennai, Tamil Nadu, India ixceed Full time ₹ 30,00,000 - ₹ 35,00,000 per year

    Role: Data Engineer (Scala)Location: ChennaiWork Mode: HybridEmployment Type: Full-time PermanentOverview:We are seeking an experienced Senior Data Engineer with deep expertise in Scala and big data technologies to contribute to a cutting-edge project. This role focuses on designing and implementing high-performance data pipelines and processing frameworks,...