Pyspark Data Engineer

6 hours ago

India People Prime Worldwide Full time

About Client :- Our client is a French multinational information technology (IT) services and consulting company, headquartered in Paris, France. Founded in 1967, It has been a leader in business transformation for over 50 years, leveraging technology to address a wide range of business needs, from strategy and design to managing operations. The company is committed to unleashing human energy through technology for an inclusive and sustainable future, helping organizations accelerate their transition to a digital and sustainable world. They provide a variety of services, including consulting, technology, professional, and outsourcing services. Job Details:- location : Pune Mode Of Work : Hybrid Notice Period : Immediate Joiners Experience : 08-10 yrs Type Of Hire : Contract to Hire Primary Skills :- "Design, develop, and maintain scalable and efficient data processing pipelines using PySpark and Python . Build and implement ETL (Extract, Transform, Load) processes to ingest data from various sources and load it into target destinations. Optimize PySpark applications for performance and troubleshoot existing code. Ensure data integrity and quality throughout the data lifecycle. Collaborate with cross-functional teams, including data engineers and data scientists, to understand and fulfill data needs. Provide technical leadership, conduct code reviews, and mentor junior team members. Translate business requirements into technical solutions and contribute to architectural discussions. Stay current with the latest industry trends in big data and distributed computing. Mandatory skills and experience PySpark and Python : Advanced proficiency and extensive experience in building data processing applications. Distributed Computing: In-depth understanding of principles, including performance tuning. Big Data Ecosystem: Experience with technologies such as Hadoop, Hive, Sqoop, and Spark . Cloud Services: Hands-on experience with cloud platforms like AWS (e.g., Glue, Lambda, Kinesis ) is often required. Database and SQL : Strong knowledge of SQL and experience with relational databases and data warehousing. Software Development: Experience with software development best practices, including version control (Git), unit testing, and code reviews. Desired or "nice-to-have" skills Familiarity with orchestration tools like Apache Airflow. Experience with other data processing tools like Kafka or Pandas/Numpy. Knowledge of API development and creating RESTful services. Experience with data file formats like Parquet, ORC, and Avro. Experience with Agile development methodologies.

  • Pyspark Data Engineer

    1 week ago

    Gurugaon, Haryana, India Dataeconomy Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    JobTitle: PySpark Data Engineer Experience: 5 – 8 Years Location: Hyderabad Employment Type: Full -Time JobSummary:We are looking for a skilledand experienced PySpark Data Engineer to join our growing dataengineering team. The ideal candidate will have 5–8 years of experience indesigning and implementing data pipelines using PySpark, AWS Glue,and Apache...

  • Pyspark Data Engineer

    6 hours ago

    India People Prime Worldwide Full time

    About Client :- Our client is a French multinational information technology (IT) services and consulting company, headquartered in Paris, France. Founded in 1967, It has been a leader in business transformation for over 50 years, leveraging technology to address a wide range of business needs, from strategy and design to managing operations. The company is...

  • Senior Pyspark Data Engineer

    6 days ago

    Hyderabad, Telangana, , India Dataeconomy Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job Title: PySpark Data EngineerExperience: 8+ YearsLocation: HyderabadEmployment Type: Full -Time Job Summary:We are looking for a skilled and experienced PySpark Data Engineer to join our growing data engineering team. The ideal candidate will have 8+ years of experience in designing and implementing data pipelines using PySpark, AWS Glue,...

  • PySpark Hadoop Engineer

    3 days ago

    Hyderabad, India Tata Consultancy Services Full time

    Job Description Job Title: PySpark Hadoop Engineer Location - Pan India Experience - 5 to 10 Yrs Key Skills/Knowledge: Good Data background. Hadoop is the primary skill and PySpark is secondary experience. Total 4 years exp, PySpark Min 2 years. With data transformation exp. (Hadoop platform optional) Experience required: Good Data background. Hadoop is the...

  • Data Engineer

    1 week ago

    India Crayon Data Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Job DescriptionData Engineer – ChennaiBuild the foundation of data intelligence — design, develop, and optimize data pipelines that power AI-driven insights.Location: Chennai, IndiaExperience: 2–3 years in data engineering or data-driven product developmentRole OverviewAs a Data Engineer, you will be responsible for building and maintaining scalable...

  • Data Architect/Senior Data Engineer

    2 weeks ago

    Thiruvananthapuram, Thiruvananthapuram / Trivandrum, India Quest Global Full time

    Job Description Job Requirements Job Title: AWS Data Engineer Company: Quest Global Job Category: Multi Industry - MedTech Quest Global is seeking a highly skilled AWS Data Engineer with 6+ years of experience in AWS, Databricks, Pyspark and S3. As an AWS Data Engineer, you will be responsible for designing, developing, and maintaining data pipelines,...

  • Pyspark Developer

    3 days ago

    Pune, India Tata Consultancy Services Full time

    Job Description Greetings from TCS! TCS is hiring for Pyspark developer Desired Experience Range: 4 to 8 Years Job Location: Chennai / Mumbai / Pune Key Responsibilities: - Develop, optimize, and maintain big data pipelines using PySpark on distributed computing platforms. - Design and implement ETL workflows for ingesting, processing, and transforming large...

  • Pyspark Developer

    4 weeks ago

    Pune, India Capgemini Full time

    Job Description Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you'd like, where you'll be supported and inspired by a collaborative community of colleagues around the world, and where you'll be able to reimagine what's possible. Join us and help the world's leading organizations unlock the value of...

  • AWS Pyspark Data Engineer

    1 week ago

    Pune City, Maharashtra, , India Dataeconomy Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    We are seeking a highly skilled and experienced Senior Data Engineer to lead the end -to -end development of complex models for compliance and supervision. The ideal candidate will have deep expertise in cloud -based infrastructure, ETL pipeline development, and financial domains, with a strong focus on creating robust, scalable, and efficient...

  • AWS Glue PySpark Developer

    1 week ago

    India CIGNEX Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We are looking for an experienced AWS Glue PySpark Developer to design, develop, and optimize ETL pipelines and data processing solutions on AWS. The ideal candidate will have deep expertise in PySpark, AWS Glue, and data engineering best practices, along with hands-on experience in building scalable, high-performance data solutions in the cloud.Key...