Data Engineer with Pyspark

2 weeks ago


Chennai Tamil Nadu India, Tamil Nadu Tata Consultancy Services Full time

TCS Hiring


Role: Data Engineer with Pyspark

Exp: 4-7 Years

Location: Hyderabad/Chennai/Kolkata


JD

Technical/Functional Skills

  • 5–6 years of total experience in data engineering or big data development
  • 2–3 years hands-on experience with Apache Spark.
  • Strong programming skills in PySpark, Python, and Scala.
  • 2+ years of experience in Scala backend development.
  • Proficient in Scala, both object oriented and functional programming concepts.
  • Deep understanding and application of advanced functional programming concepts like category theory, monads, applicatives, and type classes
  • Hands-On knowledge with Scala Typelevel libraries like Cats, Shapeless, and others used for building applications with strong typing and efficient concurrency.
  • Solid understanding of data lakes, lakehouses, and Delta Lake concepts
  • Experience in SQL development and performance tuning. Proficient in cloud services (e.g. S3, Glue, Lambda, EMR, Redshift, CloudWatch, IAM)
  • Familiarity with Airflow, dbt, or similar orchestration tools is a plus.
  • Experience in CI/CD tools like Jenkins, GitHub Actions, or Code Pipeline.
  • Knowledge of data security, governance, and compliance frameworks.

  • Pyspark

    2 weeks ago


    Chennai, Tamil Nadu, India, Tamil Nadu Tata Consultancy Services Full time

    TCS has been a great pioneer in feeding the fire of Young Techies like you. We are a global leader in the technology arena and there's nothing that can stop us from growing together.TCS Hiring for PysparkExperience Range: 04 To 07 YrsJob Locations : Chennai/Hyderabad/KolkataJob Description:• 4–6 years of total experience in data engineering or big data...

  • Data Engineer

    2 weeks ago


    Chennai, Tamil Nadu, India, Tamil Nadu Tata Consultancy Services Full time

    TCS present an excellent opportunity for Data EngineerJob Location: Delhi, Hyderabad, Bangalore, Kochi, Chennai, Kolkata, PuneExperience required :4- 12 yrsSkills: Data Engineer - GCPSQL + PySparkWalk in Interview Date: 22-Nov-25 (Saturday)Address: TCS Chennai, MagnumMust-HaveStrong and working experience in data migration using GCPPython, Spark, Kafka and...

  • Data Engineering

    2 weeks ago


    Chennai, Tamil Nadu, India, Tamil Nadu EXL Full time

    Responsibilities:Work with stakeholders to understand the data requirements to design, develop, and maintain complex ETL processes.Create the data integration and data diagram documentation.Lead the data validation, UAT and regression test for new data asset creation.Create and maintain data models, including schema design and optimization.Create and manage...

  • Pyspark Reltio

    7 days ago


    Chennai, Tamil Nadu, India Virtusa Full time

    We are looking for a skilled PySpark Developer with hands on experience in Reltio MDM to join our data engineering team The ideal candidate will be responsible for designing and implementing scalable data processing solutions using PySpark and integrating with Reltiocloud native MDM platformKey ResponsibilitiesDevelop and maintain data pipelines using...

  • Data Engineer

    2 weeks ago


    Chennai, Tamil Nadu, India, Tamil Nadu Tata Consultancy Services Full time

    Big Data/Hadoop Experience particularly in ingesting data and implementing Data ingestion pipelines, SQOOP, HADOOP, HDFS, HIVE, IMPALA, Java, Scala, Spark Scala is Mandatory Data Engineer with below responsibilities:Lead Data Engineer to build data pipelines to support implementation of data science and analytics use cases. Candidate needs to be able to...

  • Data Engineer

    2 weeks ago


    Chennai, Tamil Nadu, India, Tamil Nadu Tata Consultancy Services Full time

    Dear Candidate,Greetings from TCS !!!TCS is hiring for Azure Data Engineer, please find the below JD..Experience range – 6 to 10 yearsLocation - ChennaiSkills Required - Azure Databricks, Azure data factory, Azure synapse, PysparkRequired Competencies:1) Strong design and data solutioning skills2) Pyspark hands-on experience with complex transformations...

  • Azure Data Engineer

    2 weeks ago


    Chennai, Tamil Nadu, India, Tamil Nadu Talentgigs Full time

    Role: Azure Data EngineerWork Mode: Onsite/Full-timeLocation: Sholinganallur - Chennai Year of Experience: 5 - 10 YearsNotice Period: Immediate Good To Have Skills: Good CommunicationMust Have Skills: Databricks (Strong), Azure Data Engineering, PySpark, Python, SQLExternal Description:Azure Data Engineering + Databricks (Strong) + Python + SQL

  • Pyspark Reltio

    1 week ago


    Chennai, Tamil Nadu, India Virtusa Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    We are looking for a skilled PySpark Developer with hands on experience in Reltio MDM to join our data engineering team The ideal candidate will be responsible for designing and implementing scalable data processing solutions using PySpark and integrating with Reltiocloud native MDM platformKey ResponsibilitiesDevelop and maintain data pipelines using...

  • AWS + Pyspark

    5 days ago


    Chennai, Tamil Nadu, India Cognizant Full time

    Skills- AWS +PysparkExperience: 4 to 9 yearsLocation: AIA-PuneAs an AWS Data Engineer, you will design, build, and manage robust data pipelines on the AWS cloud platform. You will leverage your expertise in AWS data services and programming languages to ingest, process, transform, and store data efficiently, enabling data-driven insights and...

  • Data Engineer

    2 weeks ago


    Chennai, Tamil Nadu, India, Tamil Nadu HCLTech Full time

    Greetings from HCLTECH!We are hiring for GCP Data Engineer role for the location #Chennai #HyderabadRole: GCP Data EngineerExperience: 4 Years to 13 YearsLocation: Chennai, HyderabadInterview Mode: F2FDate: 22- Nov-2025Job Description:Mandatory Skill:GCPBigQueryCloud Composer or Airflow (Anyone is fine)Dataflow or Dataproc or Datafusion (Anyone is...