Pyspark/python data engineer
3 days ago
Inviting applications for the role of Principal Consultant – Pyspark/Python Data Engineer
We are looking for a passionate Python developer to join our team at Genpact.
You will be responsible for developing and implementing high-quality software solutions for data transformation and analytics using cutting-edge programming features and frameworks and collaborating with other teams in the firm to define, design and ship new features.
As an active part of our company, you will brainstorm and chalk out solutions to suit our requirements and meet our business goals. You will also be working on data engineering problems and building data pipelines. You would get ample opportunities to work on challenging and innovative projects, using the latest technologies and tools.
If you enjoy working in a fast-paced and collaborative environment, we encourage you to apply for this exciting role. We offer industry-standard compensation packages, relocation assistance, and professional growth and development opportunities.
Responsibilities
• Develop, test and maintain high-quality solutions using Py Spark /Python programming language.
• Participate in the entire software development lifecycle, building, testing and delivering high-quality data pipelines.
• Collaborate with cross-functional teams to identify and solve complex problems.
• Write clean and reusable code that can be easily maintained and scaled.
• Keep up to date with emerging trends and technologies in Python development.
Qualifications we seek in you
Minimum qualifications
• years of experience as a Python Developer with a strong portfolio of projects.
• Bachelor's degree in Computer Science, Software Engineering or a related field.
• Experience on developing pipelines on cloud platforms such as AWS or Azure using AWS Glue or ADF
• In-depth understanding of the Python software development stacks, ecosystems, frameworks and tools such as Numpy, Scipy, Pandas, Dask, spa Cy, NLTK, Great Expectations, Splink and Py Torch.
• Experience with data platforms such as Databricks/ Snowflake
• Experience with front-end development using HTML or Python.
• Familiarity with database technologies such as SQL and No SQL.
• Excellent problem-solving ability with solid communication and collaboration skills.
Preferred skills and qualifications
• Experience with popular Python frameworks such as Django, Flask, Fast API or Pyramid.
• Knowledge of Gen AI concepts and LLMs.
• Contributions to open-source Python projects or active involvement in the Python community.
Genpact is an Equal Opportunity Employer and considers applicants for all positions without regard to race, color, religion or belief, sex, age, national origin, citizenship status, marital status, military/veteran status, genetic information, sexual orientation, gender identity, physical or mental disability or any other characteristic protected by applicable laws. Genpact is committed to creating a dynamic work environment that values diversity and inclusion, respect and integrity, customer focus, and innovation. Get to know us at genpact.com and on Linked In, X, You Tube, and Facebook.
Furthermore, please do note that Genpact does not charge fees to process job applications and applicants are not required to pay to participate in our hiring process in any other way. Examples of such scams include purchasing a 'starter kit,' paying to apply, or purchasing equipment or training.
-
Pyspark/Python Data Engineer
4 days ago
kolkata, India Genpact Full timeGenpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people – we...
-
Pyspark/Python Data Engineer
3 months ago
Kolkata, India Genpact Full timeGenpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people – we...
-
Senior Pyspark Data Engineer
1 day ago
Kolkata, West Bengal, India Genpact Full timeGenpact is a global professional services and solutions firm that delivers outcomes that shape the future. Our people, driven by our innate curiosity and entrepreneurial agility, work to create lasting value for clients. We serve and transform leading enterprises, including the Fortune Global 500, with our deep business and industry knowledge, digital...
-
Senior Data Developer
5 days ago
Kolkata, West Bengal, India Genpact Full timePrincipal Consultant - Pyspark/Python Data EngineerWe are seeking a highly skilled Python developer to join our team in a Principal Consultant role. As a seasoned professional, you will be responsible for developing and implementing high-quality software solutions for data transformation and analytics using cutting-edge programming features and...
-
Data Engineer
2 months ago
Kolkata, India ApplyT Full timeAbout us :We are a Top MNC - Energizing the Educational Landscape!Must-Have Skills/Competencies :- AWS DWH tech stack with python- Create a solution in Python for creating reusable base classes using AWS libraries- SOLID principles, DWH fundamentals with implementation- End to end data pipelines in Pyspark & Athena- End to end data pipelines using AWS Glue...
-
PySpark Developer
3 months ago
Kolkata, India Risk Resources LLP Full timeJob Description :Must-Have :- Mandatory skill : Pyspark.- 3-6 years of experience in the design and implementation of Big Data pipelines using PySpark, database migration, transformation, and integration solutions for any Data warehousing project.- Must have excellent knowledge in Apache Spark and Python programming experience.- Experience in developing data...
-
PySpark Developer
3 weeks ago
Hyderabad/Chennai/Kolkata, India Risk Resources LLP Full timeJob Title: PySpark DeveloperAbout the Role:We are seeking a highly skilled PySpark Developer to join our team at Risk Resources LLP. As a key member of our data engineering team, you will be responsible for designing and implementing Big Data pipelines using PySpark, database migration, transformation, and integration solutions for our Data warehousing...
-
Azure data engineer
3 weeks ago
kolkata, India Webologix Ltd INC Full timeJob Title: Azure Cloud Database Engineer Experience Required: 3-15 YearsLocation: Kolkata Job Type: Full-timeMust Have: Azure DATA Factory; Azure SQL; Azure Databricks; Azure Cosmos DB; PySpark; Python; SnowflakeKey Responsibilities:Design, implement, and manage cloud-based OLTP databases using Azure SQL and Azure Cosmos DB.Develop, optimize, and automate...
-
Data Engineer
1 month ago
Mumbai/Kolkata, IN ApplyT Full timeAbout us :We are a Top MNC - Energizing the Educational Landscape!Must-Have Skills/Competencies :- AWS DWH tech stack with python- Create a solution in Python for creating reusable base classes using AWS libraries- SOLID principles, DWH fundamentals with implementation- End to end data pipelines in Pyspark & Athena- End to end data pipelines using AWS Glue...
-
AWS Data Engineer
2 months ago
kolkata, India Tata Consultancy Services Full timeRole** Developer Required Technical Skill Set** Databricks, Python, Pyspark Desired Experience Range** 4-6 Years Location of Requirement Kochi/ Kolkata, India Desired Competencies (Technical/Behavioral Competency) Must-Have** (Ideally should not be more than 3-5 lines) 3 years of experience in Databricks engineering solutions on AWS Cloud platforms...
-
AWS Data Engineer
2 months ago
Kolkata, India Tata Consultancy Services Full timeRole** DeveloperRequired Technical Skill Set** Databricks, Python, PysparkDesired Experience Range** 4-6 YearsLocation of Requirement Kochi/ Kolkata, IndiaDesired Competencies (Technical/Behavioral Competency)Must-Have**(Ideally should not be more than 3-5 lines)3 years of experience in Databricks engineering solutions on AWS Cloud platforms using PySpark,...
-
AWS Data Engineer
2 months ago
Kolkata, India Tata Consultancy Services Full timeRole** DeveloperRequired Technical Skill Set** Databricks, Python, PysparkDesired Experience Range** 4-6 YearsLocation of Requirement Kochi/ Kolkata, IndiaDesired Competencies (Technical/Behavioral Competency)Must-Have**(Ideally should not be more than 3-5 lines)3 years of experience in Databricks engineering solutions on AWS Cloud platforms using PySpark,...
-
AWS Data Engineer
2 months ago
kolkata, India Tata Consultancy Services Full timeRole** DeveloperRequired Technical Skill Set** Databricks, Python, PysparkDesired Experience Range** 4-6 YearsLocation of Requirement Kochi/ Kolkata, IndiaDesired Competencies (Technical/Behavioral Competency)Must-Have**(Ideally should not be more than 3-5 lines)3 years of experience in Databricks engineering solutions on AWS Cloud platforms using PySpark,...
-
Azure data engineer
1 month ago
Kolkata, India Webologix Ltd INC Full timeJob Title: Azure Cloud Database EngineerExperience Required: 3-15 YearsLocation: KolkataJob Type: Full-timeMust Have: Azure DATA Factory; Azure SQL; Azure Databricks; Azure Cosmos DB; PySpark; Python; SnowflakeKey Responsibilities:- Design, implement, and manage cloud-based OLTP databases using Azure SQL and Azure Cosmos DB.- Develop, optimize, and automate...
-
Senior PySpark Engineer
2 weeks ago
Hyderabad/Chennai/Kolkata, India Risk Resources LLP Full timeJob Description :Key Responsibilities :- Develop and implement Big Data pipelines using PySpark for Data warehousing projects.- Design and implement efficient data processing tasks using PySpark, including data reading from external sources, merging, aggregating, and loading into target data destinations.- Collaborate with cross-functional teams to deploy...
-
AWS Data Engineer
4 days ago
Kolkata, India Webologix Ltd INC Full timeJob Title: AWS Cloud Database EngineerExperience Required: 3-15 YearsLocation: KolkataJob Type: Full-timeMust Have: Aws Glue; Aws Lambda; AWS RDS; AWS S3; Dynamo Db; PySpark; Python; Step FunctionKey Responsibilities:- Design, develop, and manage cloud-based OLTP databases using AWS RDS and DynamoDB.- Build and maintain scalable ETL pipelines using AWS Glue...
-
PySpark Developer
2 weeks ago
Hyderabad/Chennai/Kolkata, India Risk Resources LLP Full timeJob Description : Must-Have : - Mandatory skill : Pyspark.- 3-6 years of experience in the design and implementation of Big Data pipelines using PySpark, database migration, transformation, and integration solutions for any Data warehousing project.- Must have excellent knowledge in Apache Spark and Python programming experience.- Experience in developing...
-
Azure data engineer
7 days ago
Kolkata, India Webologix Ltd INC Full timeJob Title:Azure Cloud Database EngineerExperience Required:3-15 YearsLocation:KolkataJob Type:Full-timeMust Have:Azure DATA Factory; Azure SQL; Azure Databricks; Azure Cosmos DB; PySpark; Python; SnowflakeKey Responsibilities:Design, implement, and manage cloud-based OLTP databases usingAzure SQLandAzure Cosmos DB .Develop, optimize, and automate data...
-
AWS Data Engineer
3 weeks ago
kolkata, India Webologix Ltd INC Full timeJob Title: AWS Cloud Database Engineer Experience Required: 3-15 YearsLocation: Kolkata Job Type: Full-timeMust Have: Aws Glue; Aws Lambda; AWS RDS; AWS S3; Dynamo Db; PySpark; Python; Step FunctionKey Responsibilities:Design, develop, and manage cloud-based OLTP databases using AWS RDS and DynamoDB.Build and maintain scalable ETL pipelines using AWS Glue...
-
Data Engineer
2 months ago
Kolkata, India Ultimate Digital Solutions Pvt. Ltd. Full timeWe're searching for a skilled Data Engineer to join our dynamic team. The ideal candidate will have a strong background in Python, AWS Glue, SQL, and data pipeline development. You'll be instrumental in designing, building, and maintaining robust data architectures and pipelines, ensuring high-quality data for analysis and insights. Location :...