Pyspark Data Engineer

10 hours ago


New Delhi, India People Prime Worldwide Full time

About Client :-Our client is a French multinational information technology (IT) services and consulting company, headquartered in Paris, France. Founded in 1967, It has been a leader in business transformation for over 50 years, leveraging technology to address a wide range of business needs, from strategy and design to managing operations.The company is committed to unleashing human energy through technology for an inclusive and sustainable future, helping organisations accelerate their transition to a digital and sustainable world.They provide a variety of services, including consulting, technology, professional, and outsourcing services.Job Details:-location: Pune , ChennaiMode Of Work : HybridNotice Period : Immediate JoinersExperience : 6-8 yrsType Of Hire : Contract to HireJOB DESCRIPTION:Must have skills : Pyspark and PythonGood to have: Familiarity with orchestration tools like Apache AirflowGrade(s) : C1/C2Location(s) : Pune/ChennaiDetailed JD :"Design, develop, and maintain scalable and efficient data processing pipelines using PySpark and Python.Build and implement ETL (Extract, Transform, Load) processes to ingest data from various sources and load it into target destinations.Optimize PySpark applications for performance and troubleshoot existing code.Ensure data integrity and quality throughout the data lifecycle.Collaborate with cross-functional teams, including data engineers and data scientists, to understand and fulfill data needs.Provide technical leadership, conduct code reviews, and mentor junior team members.Translate business requirements into technical solutions and contribute to architectural discussions.Stay current with the latest industry trends in big data and distributed computing.Mandatory skills and experiencePySpark and Python: Advanced proficiency and extensive experience in building data processing applications.Distributed Computing: In-depth understanding of principles, including performance tuning.Big Data Ecosystem: Experience with technologies such as Hadoop, Hive, Sqoop, and Spark.Cloud Services: Hands-on experience with cloud platforms like AWS (e.g., Glue, Lambda, Kinesis) is often required.Database and SQL: Strong knowledge of SQL and experience with relational databases and data warehousing.Software Development: Experience with software development best practices, including version control (Git), unit testing, and code reviews.Desired or "nice-to-have" skillsFamiliarity with orchestration tools like Apache Airflow.Experience with other data processing tools like Kafka or Pandas/Numpy.Knowledge of API development and creating RESTful services.Experience with data file formats like Parquet, ORC, and Avro.Experience with Agile development methodologies.



  • New Delhi, India Tata Consultancy Services Full time

    Role: Data Engineer with Mandatory Pyspark KnowledgeRequired Technical Skill Set: Python , Pyspark, BigQueryDesired Experience Range: 5+ yrsDesired Experience: 0-60 DaysLocation: Bangalore, Pune, Chennai, GurugramDesired Competencies (Technical/Behavioral Competency)- Development, Production Support and delivery of Python, BigQuery, SQL, GCP, Airflow based...


  • New Delhi, India CirrusLabs Full time

    We are CirrusLabs. Our vision is to become the world's most sought-after niche digital transformation company that helps customers realize value through innovation. Our mission is to co-create success with our customers, partners and community. Our goal is to enable employees to dream, grow and make things happen. We are committed to excellence. We are a...

  • Data Engineer

    1 week ago


    New Delhi, India RSquareSoft Technologies Full time

    Role: Data EngineerLocation: Pune (On-site)Job Type: Full-TimeExperience: 4–7 YearsKey Responsibilities- Design, develop, and maintain scalable data pipelines and ETL workflows. - Work with large datasets using PySpark, Python, and SQL to ensure efficient data transformation and integration. - Implement data solutions on AWS, leveraging services like S3,...


  • New Delhi, India Tata Consultancy Services Full time

    TCS is hiring for Azure Data engineer with PySpark for Bangalore Location!Job Role: Azure Data engineer with PySpark Experience: 6 to 10 years Location: Bangalore Interview: VirtualWhat we are looking for:Strong design and data solutioning skills PySpark hands-on experience with complex transformations and large dataset handling experience Good command and...


  • New Delhi, India CirrusLabs Full time

    We areCirrusLabs . Our vision is to become the world's most sought-after niche digital transformation company that helps customers realize value through innovation. Our mission is to co-create success with our customers, partners and community. Our goal is to enable employees to dream, grow and make things happen. We are committed to excellence. We are a...


  • New Delhi, India Tata Consultancy Services Full time

    TCS is hiring for Azure Data engineer with PySpark for Bangalore Location!Job Role: Azure Data engineer with PySparkExperience: 6 to 10 yearsLocation: BangaloreInterview: VirtualWhat we are looking for:- Strong design and data solutioning skills - PySpark hands-on experience with complex transformations and large dataset handling experience - Good command...

  • Data Engineer

    4 days ago


    New Delhi, India Tata Consultancy Services Full time

    Greetings from Tata Consulting Services!!!Role: Data Engineer with Mandatory Pyspark, Python Knowledge Desired Experience Range: 5 to 10 yrs Location: Pune, Hyderabad, Chennai, Bangalore, Kochi, Bhubaneshwar Notice period: 0 To 30 Days Interview Mode: Virtual Mode Interview Date: 13th Nov 2025 Time Of Interview: 10AM TO 2PM Required Technical Skill Set:...

  • Data engineer

    3 weeks ago


    New Delhi, India Tata Consultancy Services Full time

    Dear CandidateGreetings from TATA Consultancy ServicesJob Openings at TCSSkill : Data engineer (Pyspark) with AIExp range: 6 yrs to10 yrsLocation: BangaloreNotice period –30 daysPls find the Job Description below.- 1) Strong design and data solutioning skills2) PySpark hands-on experience with complex transformations and large dataset handling experience-...


  • Delhi, India People Prime Worldwide Full time

    About Client :-Our client is a French multinational information technology (IT) services and consulting company, headquartered in Paris, France. Founded in 1967, It has been a leader in business transformation for over 50 years, leveraging technology to address a wide range of business needs, from strategy and design to managing operations.The company is...

  • Data engineer

    4 weeks ago


    New Delhi, India Tata Consultancy Services Full time

    Dear CandidateGreetings from TATA Consultancy Services Job Openings at TCS Skill: Data engineer (Pyspark) with AI Exp range:6 yrs to10 yrs Location:Bangalore Notice period–30 daysPls find the Job Description below. 1) Strong design and data solutioning skills 2) PySpark hands-on experience with complex transformations and large dataset handling experience...