Capgemini - Data Engineer - Python/PySpark

1 month ago


PuneDelhi NCR, India Capgemini Full time

Skills : Databricks, AWS, SQL, Python, PySpark.

- Backend Data engineer with ability to code and create pipelines effectively in Python, Pyspark on Databricks.

- Basic experience in API development is required as well.

- Continuously monitor, optimize, and update data pipelines to ensure high performance, reliability, and scalability.

- Work closely with cross-functional teams to deploy data solutions that align with business objectives, ensuring seamless integration and operation.

- Manage the complete lifecycle of data projects from concept through deployment, ensuring agile methodologies are applied for swift and effective delivery.

Design, build, and maintain the organization's data architecture, including the design and implementation of databases tailored to the company's needs.

- Research and test data processing methodologies, tools, and frameworks to enhance the efficiency of our data pipelines.

- Utilize AWS services such as S3, Redshift, Lambda, and Glue for data management

- Implement data security and compliance measures in accordance with best practices.

- Implement streaming and batch data processing pipelines using Python and Golang.

- Clean, analyze, and extract datasets from external sources.

- Develop web crawlers to automate data collection.

- Design and deploy data APIs to facilitate data access

(ref:hirist.tech)

  • Gurgaon/Gurugram/Mumbai/Pune/Hyderabad/Bangalore, India capgemini Full time

    Job Title: Senior Data Engineer with Postgraduate Expertise in Python and PostgreSQL at Capgemini


  • Delhi NCR/Bangalore/Mumbai/Pune/Hyderabad, India capgemini Full time

    Job OverviewCapgemini is seeking an experienced C++ developer to join our team. As a C++ software engineer, you will be responsible for designing, developing, and testing software applications using C++.Key ResponsibilitiesDesign and develop software applications using C++Test and debug software applications to ensure they meet the required...


  • Delhi, India Genpact Full time

    Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people – we...

  • Senior Data Engineer

    4 weeks ago


    Pune, Maharashtra, India Exusia Full time

    Job Title: Senior Data Engineer (Developer) - Python/Pyspark/DatabricksExusia, a cutting-edge digital transformation consultancy, is seeking a highly skilled Senior Data Engineer (Developer) with expertise in Python/Pyspark/Databricks to join our global delivery team's Industry Analytics practice in India.Key Responsibilities:Design, develop, and maintain...

  • Python +pyspark

    5 months ago


    Delhi, India Nityo Infotech Full time

    2 hours ago **Job Code**: JD-19623 **JOB DESCRIPTION**: Mandatory Skills - Python, Pyspark, DataBricks, SQL Primary Skills: - Hands-on Python, PySpark, Databricks, SQL, AWS (S3, Lambda, EC2, RDS), and CI-CD tools. Job description: - 6 or more years of experience developing, testing, and implementing major Information Technology programs or projects that...


  • Gurgaon/Gurugram/Delhi NCR/Bangalore/Mumbai/Pune/Hyderabad, India capgemini Full time

    DevOps Engineer - Cloud InfrastructureAs a DevOps Engineer, you will be responsible for ensuring the efficient and reliable deployment of software systems. This role requires close collaboration with the development and operations teams to manage infrastructure as code, software development, continuous integration, system administration, and Linux...

  • Senior Data Engineer

    4 weeks ago


    Pune, Maharashtra, India Exusia Full time

    Job Title: Senior Data Engineer (Developer) - Python/Pyspark/DatabricksExusia is seeking a highly skilled Senior Data Engineer (Developer) with expertise in Python/Pyspark/Databricks to join our global delivery team's Industry Analytics practice in India.Key Responsibilities:Design, develop, and maintain large-scale data engineering solutions using...

  • Data Engineer

    4 months ago


    Pune, India Talentpro Edge Full time

    What will your essential responsibilities include ?- Exploring and acquiring new sources of data. - Using curiosity and creativity, would involve using technology to automate data acquisition, the ability to link new sources with internal data, and an appropriate level of supporting documentation of the source and technical solution.- Ensuring quality and...


  • Delhi, Delhi, India BetasharpInc Full time

    Job Title: Data Engineer with Advanced Python and PySpark ExpertiseJob Summary: We are seeking an experienced Data Engineer to develop and enhance data-processing systems, orchestration, and monitoring using open-source software, AWS, and GitLab automation.About the Role: Collaborate with product and technology teams to design and validate the capabilities...

  • Python Pyspark

    5 months ago


    Pune, India Virtusa Full time

    Role: Data Engineer 1) Minimum of 5+ years of experience in Data Engineering. Required technical skills: Python, PySpark, SQL, AWS 2) Required Domain: Healthcare 3) Extensive data analysis skills and Good communication skills **About Virtusa** Teamwork, quality of life, professional and personal development: values that Virtusa is proud to embody. When...


  • Pune, India capgemini Full time

    Job Title: Senior Automation Tester - Selenium ExpertJob Description: As a Senior Automation Tester at Capgemini, you will be responsible for designing and implementing automated tests using Selenium to ensure the highest quality of our software products. Your expertise in Python and Selenium will be crucial in developing and maintaining a robust test...

  • Big Data Engineer

    6 hours ago


    Pune, India Flipped.ai Full time

    Job Description : Big Data Engineer (PySpark)Years of experience : 6 to 13 yearsLocations : Chennai and Pune ( Candidates from chennai and pune only apply)Notice period : Immediate joiners/15 to 30 days onlyAbout the Role : We are seeking a highly skilled and experienced Big Data Engineer with a strong focus on PySpark to join our dynamic team. As a Big Data...


  • Chennai/Bangalore/Hyderabad/Pune, India ProgressX Full time

    Role : AWS Data : India Type : Full-time Experience : 5-9 yearsFunctions : Consulting, Finance, Information Technology, Data Engineering & AnalyticsIndustries : Capital Markets, Investment Banking, Alternative Investments, Financial Services, Management Consulting, Information Technology and Services, Business Travel Healthcare Job Description : We...

  • Data Engineer

    4 months ago


    Gurgaon/Gurugram/Pune, IN Talentpro Edge Full time

    What will your essential responsibilities include ?- Exploring and acquiring new sources of data. - Using curiosity and creativity, would involve using technology to automate data acquisition, the ability to link new sources with internal data, and an appropriate level of supporting documentation of the source and technical solution.- Ensuring quality and...

  • AWS Data Engineer

    2 days ago


    delhi, India ITI Data Full time

    Job Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....


  • Pune, Maharashtra, India Thinkwise Consulting LLP Full time

    Job Title: Pyspark Glue EngineerAbout the Role:We are looking for a skilled Pyspark Glue Engineer to join our team at Thinkwise Consulting LLP. As a Pyspark Glue Engineer, you will be responsible for designing, developing, and maintaining efficient and scalable solutions using PySpark and AWS Glue. You will ensure data quality and integrity through rigorous...

  • Data Scientist

    2 weeks ago


    Pune, Maharashtra, India Capgemini Full time

    Capgemini is seeking a highly skilled Data Scientist to leverage business insights and drive analytical exercises to uncover root causes and drivers of outcomes.This role will be responsible for distilling business needs into data-driven insights, utilizing data savvy, analytical prowess for explanatory analytics, and basic statistical knowledge to design...

  • AWS Data Engineer

    1 week ago


    delhi, India ITI Data Full time

    Job DescriptionWe are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources. There...

  • AWS Data Engineer

    3 months ago


    Delhi, India ITI Data Full time

    Job DescriptionWe are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources. There...

  • Pyspark Developer

    4 weeks ago


    Pune, India NewVision Software Full time

    Position Summary: We are seeking a talented Data Engineer with a strong background in data engineering to join our team. You will play a key role in designing, building, and maintaining data pipelines using a variety of technologies, with a focus on the Microsoft Azure cloud platform. Responsibilities: Design, develop, and implement data pipelines using...