Capgemini - Data Engineer - Python/PySpark
1 month ago
Skills : Databricks, AWS, SQL, Python, PySpark.
- Backend Data engineer with ability to code and create pipelines effectively in Python, Pyspark on Databricks.
- Basic experience in API development is required as well.
- Continuously monitor, optimize, and update data pipelines to ensure high performance, reliability, and scalability.
- Work closely with cross-functional teams to deploy data solutions that align with business objectives, ensuring seamless integration and operation.
- Manage the complete lifecycle of data projects from concept through deployment, ensuring agile methodologies are applied for swift and effective delivery.
Design, build, and maintain the organization's data architecture, including the design and implementation of databases tailored to the company's needs.
- Research and test data processing methodologies, tools, and frameworks to enhance the efficiency of our data pipelines.
- Utilize AWS services such as S3, Redshift, Lambda, and Glue for data management
- Implement data security and compliance measures in accordance with best practices.
- Implement streaming and batch data processing pipelines using Python and Golang.
- Clean, analyze, and extract datasets from external sources.
- Develop web crawlers to automate data collection.
- Design and deploy data APIs to facilitate data access
-
Gurgaon/Gurugram/Mumbai/Pune/Hyderabad/Bangalore, India capgemini Full timeJob Title: Senior Data Engineer with Postgraduate Expertise in Python and PostgreSQL at Capgemini
-
Capgemini C++ Software Engineer
2 weeks ago
Delhi NCR/Bangalore/Mumbai/Pune/Hyderabad, India capgemini Full timeJob OverviewCapgemini is seeking an experienced C++ developer to join our team. As a C++ software engineer, you will be responsible for designing, developing, and testing software applications using C++.Key ResponsibilitiesDesign and develop software applications using C++Test and debug software applications to ensure they meet the required...
-
Pyspark/Python Data Engineer
3 months ago
Delhi, India Genpact Full timeGenpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people – we...
-
Senior Data Engineer
4 weeks ago
Pune, Maharashtra, India Exusia Full timeJob Title: Senior Data Engineer (Developer) - Python/Pyspark/DatabricksExusia, a cutting-edge digital transformation consultancy, is seeking a highly skilled Senior Data Engineer (Developer) with expertise in Python/Pyspark/Databricks to join our global delivery team's Industry Analytics practice in India.Key Responsibilities:Design, develop, and maintain...
-
Python +pyspark
5 months ago
Delhi, India Nityo Infotech Full time2 hours ago **Job Code**: JD-19623 **JOB DESCRIPTION**: Mandatory Skills - Python, Pyspark, DataBricks, SQL Primary Skills: - Hands-on Python, PySpark, Databricks, SQL, AWS (S3, Lambda, EC2, RDS), and CI-CD tools. Job description: - 6 or more years of experience developing, testing, and implementing major Information Technology programs or projects that...
-
Capgemini Cloud Infrastructure DevOps Engineer
2 weeks ago
Gurgaon/Gurugram/Delhi NCR/Bangalore/Mumbai/Pune/Hyderabad, India capgemini Full timeDevOps Engineer - Cloud InfrastructureAs a DevOps Engineer, you will be responsible for ensuring the efficient and reliable deployment of software systems. This role requires close collaboration with the development and operations teams to manage infrastructure as code, software development, continuous integration, system administration, and Linux...
-
Senior Data Engineer
4 weeks ago
Pune, Maharashtra, India Exusia Full timeJob Title: Senior Data Engineer (Developer) - Python/Pyspark/DatabricksExusia is seeking a highly skilled Senior Data Engineer (Developer) with expertise in Python/Pyspark/Databricks to join our global delivery team's Industry Analytics practice in India.Key Responsibilities:Design, develop, and maintain large-scale data engineering solutions using...
-
Data Engineer
4 months ago
Pune, India Talentpro Edge Full timeWhat will your essential responsibilities include ?- Exploring and acquiring new sources of data. - Using curiosity and creativity, would involve using technology to automate data acquisition, the ability to link new sources with internal data, and an appropriate level of supporting documentation of the source and technical solution.- Ensuring quality and...
-
Delhi, Delhi, India BetasharpInc Full timeJob Title: Data Engineer with Advanced Python and PySpark ExpertiseJob Summary: We are seeking an experienced Data Engineer to develop and enhance data-processing systems, orchestration, and monitoring using open-source software, AWS, and GitLab automation.About the Role: Collaborate with product and technology teams to design and validate the capabilities...
-
Python Pyspark
5 months ago
Pune, India Virtusa Full timeRole: Data Engineer 1) Minimum of 5+ years of experience in Data Engineering. Required technical skills: Python, PySpark, SQL, AWS 2) Required Domain: Healthcare 3) Extensive data analysis skills and Good communication skills **About Virtusa** Teamwork, quality of life, professional and personal development: values that Virtusa is proud to embody. When...
-
Pune, India capgemini Full timeJob Title: Senior Automation Tester - Selenium ExpertJob Description: As a Senior Automation Tester at Capgemini, you will be responsible for designing and implementing automated tests using Selenium to ensure the highest quality of our software products. Your expertise in Python and Selenium will be crucial in developing and maintaining a robust test...
-
Big Data Engineer
6 hours ago
Pune, India Flipped.ai Full timeJob Description : Big Data Engineer (PySpark)Years of experience : 6 to 13 yearsLocations : Chennai and Pune ( Candidates from chennai and pune only apply)Notice period : Immediate joiners/15 to 30 days onlyAbout the Role : We are seeking a highly skilled and experienced Big Data Engineer with a strong focus on PySpark to join our dynamic team. As a Big Data...
-
Senior AWS Data Engineer
1 month ago
Chennai/Bangalore/Hyderabad/Pune, India ProgressX Full timeRole : AWS Data : India Type : Full-time Experience : 5-9 yearsFunctions : Consulting, Finance, Information Technology, Data Engineering & AnalyticsIndustries : Capital Markets, Investment Banking, Alternative Investments, Financial Services, Management Consulting, Information Technology and Services, Business Travel Healthcare Job Description : We...
-
Data Engineer
4 months ago
Gurgaon/Gurugram/Pune, IN Talentpro Edge Full timeWhat will your essential responsibilities include ?- Exploring and acquiring new sources of data. - Using curiosity and creativity, would involve using technology to automate data acquisition, the ability to link new sources with internal data, and an appropriate level of supporting documentation of the source and technical solution.- Ensuring quality and...
-
AWS Data Engineer
2 days ago
delhi, India ITI Data Full timeJob Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....
-
Pyspark Glue Engineer
7 days ago
Pune, Maharashtra, India Thinkwise Consulting LLP Full timeJob Title: Pyspark Glue EngineerAbout the Role:We are looking for a skilled Pyspark Glue Engineer to join our team at Thinkwise Consulting LLP. As a Pyspark Glue Engineer, you will be responsible for designing, developing, and maintaining efficient and scalable solutions using PySpark and AWS Glue. You will ensure data quality and integrity through rigorous...
-
Data Scientist
2 weeks ago
Pune, Maharashtra, India Capgemini Full timeCapgemini is seeking a highly skilled Data Scientist to leverage business insights and drive analytical exercises to uncover root causes and drivers of outcomes.This role will be responsible for distilling business needs into data-driven insights, utilizing data savvy, analytical prowess for explanatory analytics, and basic statistical knowledge to design...
-
AWS Data Engineer
1 week ago
delhi, India ITI Data Full timeJob DescriptionWe are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources. There...
-
AWS Data Engineer
3 months ago
Delhi, India ITI Data Full timeJob DescriptionWe are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources. There...
-
Pyspark Developer
4 weeks ago
Pune, India NewVision Software Full timePosition Summary: We are seeking a talented Data Engineer with a strong background in data engineering to join our team. You will play a key role in designing, building, and maintaining data pipelines using a variety of technologies, with a focus on the Microsoft Azure cloud platform. Responsibilities: Design, develop, and implement data pipelines using...