Data Engineer – Databricks

13 hours ago


Chennai Tamil Nadu India, Tamil Nadu Tata Consultancy Services Full time

Role Summary:

We are looking for a Data Engineer with expertise in Azure Databricks, data transformation, and integration pipelines to support forecasting, scheduling, and analytics flows in the WFM Re-Platform program.


Key Responsibilities

  • Design and implement data pipelines in Azure Databricks for ingesting and transforming data from upstream systems (SAP, PIPS, POS) into WFM and UKG.
  • Optimize ETL/ELT workflows for performance and scalability.
  • Collaborate with Java/API developers to integrate event-driven triggers into data pipelines.
  • Implement data quality checks, schema validation, and error handling.
  • Support batch and near-real-time data flows for operational and analytics use cases.
  • Work with Boomi and WFM teams to ensure data contracts and canonical models are enforced.


Required Skills

  • Strong experience with Azure Databricks (PySpark, Delta Lake).
  • Proficiency in SQL and data modeling.
  • Experience with Azure Data Lake, and Event Hub.
  • Familiarity with data governance and security best practices.
  • Ability to work with large datasets and optimize for performance.
  • Familiarity with CI/CD (Jenkins and Terraform preferred).
  • Knowledge of JSON, XML.

Nice-to-Have

  • Experience with UKG Data Hub or similar HR/payroll data platforms.
  • Knowledge of API integration and microservices.
  • Familiarity with Power BI or other reporting tools.



  • Chennai, Tamil Nadu, India, Tamil Nadu Tata Consultancy Services Full time

    Role**Databricks Engineer (Individual Contributor)Required Technical Skill Set**Azure Databricks, PysparkExperience: 4 to 10 YearsLocation: Hyd,Kolkata, Noida, Chennai, BangaloreDesired Competencies (Technical/Behavioral Competency)Must-Have**1. Azure Data Bricks (Python)2. Pyspark3. ADLS4. complex problem-solving skillGood-to-HaveAzure DevopsAzure Data...


  • Chennai, Tamil Nadu, India InfoCepts Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Position: Data Engineer- DatabricksPurpose of the Position:Develop, support and steer end-to-end business intelligence using Databricks.Location: Nagpur/ Pune/ Chennai/ BangaloreKey Responsibilities:Work with business analysts and data architects to translate requirements into technical implementations.Design, develop, implement, and maintain pyspark code...


  • Chennai, Tamil Nadu, India Tata Consultancy Services Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Role Summary:We are looking for aData Engineerwith expertise inAzure Databricks,data transformation, andintegration pipelinesto support forecasting, scheduling, and analytics flows in the WFM Re-Platform program.Key ResponsibilitiesDesign and implement data pipelines in Azure Databricks for ingesting and transforming data from upstream systems (SAP, PIPS,...


  • Chennai, Tamil Nadu, India Raah Techservices Full time ₹ 4,69,000 - ₹ 18,17,548 per year

    Position OverviewWe are looking for an experienced Databricks Data Engineer with 6+ years of expertise in building and managing large-scale data platforms. The ideal candidate will have strong hands-on experience with Databricks, Spark, and Cloud Data Engineering practices. This role involves designing, developing, and optimizing data pipelines, enabling...

  • Data Engineer

    1 week ago


    Chennai, Tamil Nadu, India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Req ID: 336026NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer - Azure to join our team in Chennai, Tamil Nādu (IN-TN), India (IN). "Job Duties: Key Responsibilities:...


  • Chennai, Tamil Nadu, India InfoCepts Full time ₹ 6,00,000 - ₹ 12,00,000 per year

    Position: Data Engineer ? Azure DatabricksPurpose of the Position:To design, build, and optimize scalable data pipelines and solutions using Azure Databricks and related technologies, enabling Zodiac Maritime to make faster, data-driven decisions as part of its data transformation journey.Proficiency in data integration techniques, ETL processes and data...

  • Databricks

    6 days ago


    Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job SummaryJoin our dynamic team as a Developer where you will leverage your expertise in Spark in Scala Databricks and Amazon technologies to drive innovative solutions. With a hybrid work model and day shifts you will collaborate with cross-functional teams to optimize data processes and enhance our data infrastructure. Your contributions will directly...

  • Data Engineer

    13 hours ago


    Chennai, Tamil Nadu, India, Tamil Nadu KaarTech Full time

    Key Responsibilities· Data Pipeline Development: Design, develop, and maintain scalable data pipelines to support various data analytics and reporting needs.· Data Integration: Integrate data from multiple sources and ensure data quality and consistency.· Data Modelling: Build and optimize data models using Spark to support complex data transformations...

  • Data Engineering

    14 hours ago


    Chennai, Tamil Nadu, India, Tamil Nadu EXL Full time

    Responsibilities:Work with stakeholders to understand the data requirements to design, develop, and maintain complex ETL processes.Create the data integration and data diagram documentation. Lead the data validation, UAT and regression test for new data asset creation.Create and maintain data models, including schema design and optimization.Create and manage...


  • Chennai, Tamil Nadu, India InfoCepts Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Position: Data Architect (Databricks, Snowflake)Location: Nagpur, Pune, Chennai, BangaloreType of Employment: Full time EmploymentPurpose of the Position:Design and optimize cloud-native data architectures on platforms like Databricks and Snowflake, enabling scalable data engineering, advanced analytics, and AI/ML solutions aligned with business needs.Key...