Data Engineer – Databricks

4 days ago

tamil nadu, India Tata Consultancy Services Full time

Role Summary: We are looking for a Data Engineer with expertise in Azure Databricks , data transformation , and integration pipelines to support forecasting, scheduling, and analytics flows in the WFM Re-Platform program. Key Responsibilities Design and implement data pipelines in Azure Databricks for ingesting and transforming data from upstream systems (SAP, PIPS, POS) into WFM and UKG. Optimize ETL/ELT workflows for performance and scalability. Collaborate with Java/API developers to integrate event-driven triggers into data pipelines. Implement data quality checks , schema validation, and error handling. Support batch and near-real-time data flows for operational and analytics use cases. Work with Boomi and WFM teams to ensure data contracts and canonical models are enforced. Required Skills Strong experience with Azure Databricks (PySpark, Delta Lake). Proficiency in SQL and data modeling . Experience with Azure Data Lake , and Event Hub . Familiarity with data governance and security best practices . Ability to work with large datasets and optimize for performance. Familiarity with CI/CD (Jenkins and Terraform preferred). Knowledge of JSON, XML . Nice-to-Have Experience with UKG Data Hub or similar HR/payroll data platforms. Knowledge of API integration and microservices . Familiarity with Power BI or other reporting tools.

  • Azure Databricks Engineer

    5 days ago

    tamil nadu, India Tata Consultancy Services Full time

    Role**Databricks Engineer (Individual Contributor) Required Technical Skill Set**Azure Databricks, Pyspark Experience: 4 to 10 Years Location: Hyd,Kolkata, Noida, Chennai, Bangalore Desired Competencies (Technical/Behavioral Competency) Must-Have** 1. Azure Data Bricks (Python) 2. Pyspark 3. ADLS 4. complex problem-solving skill Good-to-Have Azure Devops...

  • Databricks

    2 weeks ago

    Chennai, Tamil Nadu, India Cognizant Full time

    **Job Summary** **Responsibilities** - Develop and optimize data solutions using Databricks SQL to ensure efficient data processing and analysis. - Implement and manage Databricks Workflows to automate data pipelines and improve operational efficiency. - Collaborate with cross-functional teams to understand business requirements and translate them into...

  • Data Engineer – Databricks

    1 week ago

    tamil nadu, India Tata Consultancy Services Full time

    Role Summary:We are looking for a Data Engineer with expertise in Azure Databricks, data transformation, and integration pipelines to support forecasting, scheduling, and analytics flows in the WFM Re-Platform program.Key ResponsibilitiesDesign and implement data pipelines in Azure Databricks for ingesting and transforming data from upstream systems (SAP,...

  • Azure Databricks Engineer

    7 days ago

    tamil nadu, India Tata Consultancy Services Full time

    Role**Databricks Engineer (Individual Contributor)Required Technical Skill Set**Azure Databricks, PysparkExperience: 4 to 10 YearsLocation: Hyd,Kolkata, Noida, Chennai, BangaloreDesired Competencies (Technical/Behavioral Competency)Must-Have**1. Azure Data Bricks (Python)2. Pyspark3. ADLS4. complex problem-solving skillGood-to-HaveAzure DevopsAzure Data...

  • Databrick

    2 weeks ago

    Chennai, Tamil Nadu, India Virtusa Full time

    Key Responsibilities: Design, develop, and maintain scalable data pipelines using Apache Spark on Databricks. Write efficient and production-ready PySpark or Scala code for data transformation and ETL processes. Integrate data from various structured and unstructured sources into a unified platform. Implement Delta Lake and manage data versioning, updates,...

  • Databricks

    10 hours ago

    Coimbatore, Tamil Nadu, India Cognizant Full time

    **Description - External** **Skill: - Databricks** **Experience: 3 to 14 years** **Location: - Coimbatore (Walkin on 8th Feb)** **Must Have Skills** - Hands on experience with Azure Databricks, Azure Data Factory, Azure Analysis Services, Blob Storage, Databricks/Spark, Azure SQL DW/Synapse, and Azure functions. - In-depth knowledge of relational...

  • Data Engineer – Databricks

    6 days ago

    Chennai, Tamil Nadu, India, Tamil Nadu Tata Consultancy Services Full time

    Role Summary:We are looking for a Data Engineer with expertise in Azure Databricks, data transformation, and integration pipelines to support forecasting, scheduling, and analytics flows in the WFM Re-Platform program.Key ResponsibilitiesDesign and implement data pipelines in Azure Databricks for ingesting and transforming data from upstream systems (SAP,...

  • Azure Databricks Engineer

    6 days ago

    Chennai, Tamil Nadu, India, Tamil Nadu Tata Consultancy Services Full time

    Role**Databricks Engineer (Individual Contributor)Required Technical Skill Set**Azure Databricks, PysparkExperience: 4 to 10 YearsLocation: Hyd,Kolkata, Noida, Chennai, BangaloreDesired Competencies (Technical/Behavioral Competency)Must-Have**1. Azure Data Bricks (Python)2. Pyspark3. ADLS4. complex problem-solving skillGood-to-HaveAzure DevopsAzure Data...

  • Data Engineer

    4 days ago

    tamil nadu, India HCLTech Full time

    Azure Data Lead with Azure Data Factory (ADF),Azure Databricks, Job Summary The Technical Lead will be responsible for overseeing and leading projects related to Azure Data Factory (ADF), Azure Databricks, SQL, Oracle PL/SQL, and Python. The role involves designing, developing, and implementing data solutions while ensuring they meet the business...

  • Data Engineer

    7 days ago

    tamil nadu, India KaarTech Full time

    Key Responsibilities· Data Pipeline Development: Design, develop, and maintain scalable data pipelines to support various data analytics and reporting needs.· Data Integration: Integrate data from multiple sources and ensure data quality and consistency.· Data Modelling: Build and optimize data models using Spark to support complex data transformations...