Data Engineer – Databricks

1 week ago


Chennai, Tamil Nadu, India Tata Consultancy Services Full time ₹ 15,00,000 - ₹ 25,00,000 per year

Role Summary:

We are looking for a
Data Engineer
with expertise in
Azure Databricks
,
data transformation
, and
integration pipelines
to support forecasting, scheduling, and analytics flows in the WFM Re-Platform program.

Key Responsibilities

  • Design and implement
    data pipelines
    in Azure Databricks for ingesting and transforming data from upstream systems (SAP, PIPS, POS) into WFM and UKG.
  • Optimize
    ETL/ELT workflows
    for performance and scalability.
  • Collaborate with Java/API developers to integrate
    event-driven triggers
    into data pipelines.
  • Implement
    data quality checks
    , schema validation, and error handling.
  • Support
    batch and near-real-time data flows
    for operational and analytics use cases.
  • Work with Boomi and WFM teams to ensure
    data contracts
    and
    canonical models
    are enforced.

Required Skills

  • Strong experience with
    Azure Databricks
    (PySpark, Delta Lake).
  • Proficiency in
    SQL
    and
    data modeling
    .
  • Experience with
    Azure Data Lake
    , and
    Event Hub
    .
  • Familiarity with
    data governance
    and
    security best practices
    .
  • Ability to work with
    large datasets
    and optimize for performance.
  • Familiarity with
    CI/CD
    (Jenkins and Terraform preferred).
  • Knowledge of
    JSON, XML
    .

Nice-to-Have

  • Experience with
    UKG Data Hub
    or similar HR/payroll data platforms.
  • Knowledge of
    API integration
    and
    microservices
    .
  • Familiarity with
    Power BI
    or other reporting tools.


  • Chennai, Tamil Nadu, India Zorba Consulting Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Experience : 8-15 years. Primary Roles And Responsibilities : Developing Modern Data Warehouse solutions using Databricks and AWS/ Azure Stack. Ability to provide solutions that are forward-thinking in data engineering and analytics space. Collaborate with DW/BI leads to understand new ETL pipeline development requirements. Triage issues to find gaps in...


  • Chennai, Tamil Nadu, India DataTerrain, Inc. Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Title: Databricks ArchitectExperience: 12+ yearsJob Summary:We are seeking an experienced Databricks Architect to design, implement, and optimize data solutions on the Databricks platform. The ideal candidate will have deep expertise in big data technologies, cloud platforms, and analytics architectures, with strong communication skills to interact...

  • Databricks spark

    1 day ago


    Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job SummaryThe Sr. Developer role is crucial for driving innovation and efficiency in our hybrid work model. With a focus on Kafka Python Databricks SQL Databricks Workflows and PySpark the candidate will enhance our data processing capabilities. Experience in Claims and Billing domains is advantageous. This position requires 8 to 9 years of experience and...

  • Data Engineer

    1 week ago


    Chennai, Tamil Nadu, India CG-VAK Software & Exports Ltd. Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Title:Data Engineer (Scala, Spark, Pyspark, Databricks)Remark - final round will be the F2FExperience: 10+ Years (Lead Role)ResponsibilitiesDesign, develop, and maintain robust and scalable data pipelines using Apache Spark and Scala on the Databricks platform.Implement ETL (Extract, Transform, Load) processes for various data sources, ensuring data...

  • Data Engineer

    2 weeks ago


    Chennai, Tamil Nadu, India DataMoo Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    We're Hiring | Data Engineer (Databricks) – 2+ Years ExperienceAt, we're building next-generationAI-driven platformsthat are transforming industries likeBFSI, Healthcare, Manufacturing, and RetailthroughData Science, Data Engineering, and Generative AI.We're now looking for a passionateData Engineer (Databricks)to join our growing team inChennaiand help us...


  • Chennai, Tamil Nadu, India Genpact Full time ₹ 1,20,000 - ₹ 2,40,000 per year

    Principal Consultant, Sr. Databricks DeveloperPrincipal Consultant, Sr. Databricks Developer-COR Ready to shape the future of work? At Genpact, we don't just adapt to change—we drive it. AI and digital innovation are redefining industries, and we're leading the charge. Genpact's AI Gigafactory, our industry-first accelerator, is an example of how...


  • Chennai, Tamil Nadu, India Virtusa Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Key responsibilities include designing developing and maintaining scalable data pipelines using Apache Spark on Databricks Writing efficient and production ready PySpark or Scala code for data transformation and ETL processes Integrating data from various structured and unstructured sources into a unified platform Implementing Delta Lake and managing data...

  • Data Engineer

    1 week ago


    Chennai, Tamil Nadu, India Colan Infotech Private Limited Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Greetings from Colan InfotechWe are hiring Azure Data Engineer urgent basisJob Location - Chennai / Bangalore (WFO only)Role: Azure Data EngineerExperience: 3-5 YearsSkill set:Pyspark / Scala Spark, Python, Azure Databricks and Azure Data Factory Roles and Responsibilities: Should have programming skills with the ability to write optimized and reusable...

  • Data Engineer

    1 week ago


    Chennai, Tamil Nadu, India YO HR Consultancy Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Data Engineer/Senior Data EngineerLocation: ChennaiExperience: 2 - 8 YearsRole DescriptionThe Data Engineer will be responsible for designing and developing data engineering solutions, creating and maintaining data models, building Extract Transform Load (ETL) pipelines, implementing data warehousing, and performing data analytics on large...

  • AWS Data Engineer

    1 week ago


    Chennai, Tamil Nadu, India MyCareernet Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Company:IT Services OrganizationKey Skills:AWS, Pyspark, Databricks, SQL, Python, ETL, Azure Databricks, Data modeling, Data Warehouse, Data Engineer, Data Engineering, PL/SQL, Data ModellingRoles and Responsibilities:Design, develop, and maintain ETL processes to support data integration and transformation.Utilize Python for data engineering tasks, ensuring...