Pyspark/Python Data Engineer

4 months ago

Kolkata, India Genpact Full time

Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people – we serve and transform leading enterprises, including the Fortune Global 500, with our deep business and industry knowledge, digital operations services, and expertise in data, technology, and AI.

Inviting applications for the role of Principal Consultant – Pyspark/Python Data Engineer

We are looking for a passionate Python developer to join our team at Genpact.

You will be responsible for developing and implementing high-quality software solutions for data transformation and analytics using cutting-edge programming features and frameworks and collaborating with other teams in the firm to define, design and ship new features.

As an active part of our company, you will brainstorm and chalk out solutions to suit our requirements and meet our business goals. You will also be working on data engineering problems and building data pipelines. You would get ample opportunities to work on challenging and innovative projects, using the latest technologies and tools.

If you enjoy working in a fast-paced and collaborative environment, we encourage you to apply for this exciting role. We offer industry-standard compensation packages, relocation assistance, and professional growth and development opportunities.


Responsibilities

• Develop, test and maintain high-quality solutions using PySpark /Python programming language.

• Participate in the entire software development lifecycle, building, testing and delivering high-quality data pipelines.

• Collaborate with cross-functional teams to identify and solve complex problems.

• Write clean and reusable code that can be easily maintained and scaled.

• Keep up to date with emerging trends and technologies in Python development.


Qualifications we seek in you

Minimum qualifications

• years of experience as a Python Developer with a strong portfolio of projects.

• Bachelor's degree in Computer Science, Software Engineering or a related field.

• Experience on developing pipelines on cloud platforms such as AWS or Azure using AWS Glue or ADF

• In-depth understanding of the Python software development stacks, ecosystems, frameworks and tools such as Numpy, Scipy, Pandas, Dask, spaCy, NLTK, Great Expectations, Splink and PyTorch.

• Experience with data platforms such as Databricks/ Snowflake

• Experience with front-end development using HTML or Python.

• Familiarity with database technologies such as SQL and NoSQL.

• Excellent problem-solving ability with solid communication and collaboration skills.


Preferred skills and qualifications

• Experience with popular Python frameworks such as Django, Flask, FastAPI or Pyramid.

• Knowledge of GenAI concepts and LLMs.

• Contributions to open-source Python projects or active involvement in the Python community.


Genpact is an Equal Opportunity Employer and considers applicants for all positions without regard to race, color, religion or belief, sex, age, national origin, citizenship status, marital status, military/veteran status, genetic information, sexual orientation, gender identity, physical or mental disability or any other characteristic protected by applicable laws. Genpact is committed to creating a dynamic work environment that values diversity and inclusion, respect and integrity, customer focus, and innovation. Get to know us at genpact.com and on LinkedIn, X, YouTube, and Facebook.

Furthermore, please do note that Genpact does not charge fees to process job applications and applicants are not required to pay to participate in our hiring process in any other way. Examples of such scams include purchasing a 'starter kit,' paying to apply, or purchasing equipment or training.

  • Pyspark/Python Data Engineer

    1 week ago

    kolkata, India Genpact Full time

    Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people – we...

  • Pyspark/Python Data Engineer

    3 weeks ago

    kolkata, India Genpact Full time

    Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people – we...

  • Pyspark/python data engineer

    3 weeks ago

    Kolkata, India Genpact Full time

    Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people – we...

  • Senior Pyspark Data Engineer

    3 weeks ago

    Kolkata, West Bengal, India Genpact Full time

    Genpact is a global professional services and solutions firm that delivers outcomes that shape the future. Our people, driven by our innate curiosity and entrepreneurial agility, work to create lasting value for clients. We serve and transform leading enterprises, including the Fortune Global 500, with our deep business and industry knowledge, digital...

  • Senior Data Developer

    3 weeks ago

    Kolkata, West Bengal, India Genpact Full time

    Principal Consultant - Pyspark/Python Data EngineerWe are seeking a highly skilled Python developer to join our team in a Principal Consultant role. As a seasoned professional, you will be responsible for developing and implementing high-quality software solutions for data transformation and analytics using cutting-edge programming features and...

  • PySpark Developer

    3 months ago

    Kolkata, India Risk Resources LLP Full time

    Job Description :Must-Have :- Mandatory skill : Pyspark.- 3-6 years of experience in the design and implementation of Big Data pipelines using PySpark, database migration, transformation, and integration solutions for any Data warehousing project.- Must have excellent knowledge in Apache Spark and Python programming experience.- Experience in developing data...

  • Data Engineer

    2 weeks ago

    kolkata, India Webologix Ltd INC Full time

    Job Title: AWS Cloud Database Engineer Experience Required: 3-15 Years Location: Kolkata Job Type: Full-time Must Have: Aws Glue; Aws Lambda; AWS RDS; AWS S3; Dynamo Db; PySpark; Python; Step Function Key Responsibilities: - Design, develop, and manage cloud-based OLTP databases using AWS RDS and DynamoDB. - Build and maintain scalable ETL pipelines...

  • Senior Data Integration Engineer

    4 hours ago

    Kolkata, India Senior Data Integration Engineer Full time

    Must Have Skills/Skill Requirement:Design and architect integration solutions to connect various enterprise applications, systems, and databases.Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.Utilize Azure Integration Services such as Azure Logic Apps,...

  • Data Engineer

    2 weeks ago

    Kolkata, India Webologix Ltd INC Full time

    Job Position: AWS Cloud DB EngineerJob Type: Full-TimeLocation: Kolkata, INExperience: - 3+ to 10+ YearsMust Have: -Aws Glue; Aws Lambda; AWS RDS; AWS S3; Dynamo Db; PySpark; Python; AWS Step FunctionResponsibilities: Data Pipeline Development:Design and implement data ingestion and transformation workflows using AWS Glue.Develop and manage ETL processes...

  • Data Engineer

    4 days ago

    Kolkata, India Webologix Ltd INC Full time

    Job Position: AWS Cloud DB Engineer Job Type: Full-TimeLocation: Kolkata, INExperience: - 3+ to 10+ YearsMust Have: - Aws Glue; Aws Lambda; AWS RDS; AWS S3; Dynamo Db; PySpark; Python; AWS Step FunctionResponsibilities: Data Pipeline Development:Design and implement data ingestion and transformation workflows using AWS Glue.Develop and manage ETL...

  • Data Engineer

    2 weeks ago

    Kolkata, India Webologix Ltd INC Full time

    Job Position: AWS Cloud DB EngineerJob Type: Full-TimeLocation: Kolkata, INExperience: - 3+ to 10+ YearsMust Have: - Aws Glue; Aws Lambda; AWS RDS; AWS S3; Dynamo Db; PySpark; Python; AWS Step FunctionResponsibilities: Data Pipeline Development:Design and implement data ingestion and transformation workflows using AWS Glue.Develop and manage ETL...

  • Senior PySpark Engineer

    4 weeks ago

    Hyderabad/Chennai/Kolkata, India Risk Resources LLP Full time

    Job Description :Key Responsibilities :- Develop and implement Big Data pipelines using PySpark for Data warehousing projects.- Design and implement efficient data processing tasks using PySpark, including data reading from external sources, merging, aggregating, and loading into target data destinations.- Collaborate with cross-functional teams to deploy...

  • Azure data engineer

    2 months ago

    Kolkata, India Webologix Ltd INC Full time

    Job Title: Azure Cloud Database EngineerExperience Required: 3-15 YearsLocation: KolkataJob Type: Full-timeMust Have: Azure DATA Factory; Azure SQL; Azure Databricks; Azure Cosmos DB; PySpark; Python; SnowflakeKey Responsibilities:- Design, implement, and manage cloud-based OLTP databases using Azure SQL and Azure Cosmos DB.- Develop, optimize, and automate...

  • Azure data engineer

    2 weeks ago

    Kolkata, India Webologix Ltd INC Full time

    Job Title: Azure Cloud Database EngineerExperience Required: 3-15 YearsLocation: KolkataJob Type: Full-timeMust Have: Azure DATA Factory; Azure SQL; Azure Databricks; Azure Cosmos DB; PySpark; Python; SnowflakeKey Responsibilities:Design, implement, and manage cloud-based OLTP databases using Azure SQL and Azure Cosmos DB .Develop, optimize, and...

  • Data Engineer

    3 months ago

    Kolkata, India Webologix Ltd INC Full time

    Job Position: Azure Cloud DB EngineerJob Type: Full-TimeLocation: Kolkata, INExperience: - 3 to 8+ YearsMust Have: - Azure DATA Factory; Azure SQL; Azure Databricks; Azure Cosmos DB; PySpark; PythonResponsibilities:Data Pipeline Development:Design and implement data integration workflows using Azure Data Factory to ingest, transform, and load data from...

  • AWS Data Engineer

    3 weeks ago

    Kolkata, India Webologix Ltd INC Full time

    Job Title: AWS Cloud Database EngineerExperience Required: 3-15 YearsLocation: KolkataJob Type: Full-timeMust Have: Aws Glue; Aws Lambda; AWS RDS; AWS S3; Dynamo Db; PySpark; Python; Step FunctionKey Responsibilities:- Design, develop, and manage cloud-based OLTP databases using AWS RDS and DynamoDB.- Build and maintain scalable ETL pipelines using AWS Glue...

  • PySpark Developer

    4 weeks ago

    Hyderabad/Chennai/Kolkata, India Risk Resources LLP Full time

    Job Description : Must-Have : - Mandatory skill : Pyspark.- 3-6 years of experience in the design and implementation of Big Data pipelines using PySpark, database migration, transformation, and integration solutions for any Data warehousing project.- Must have excellent knowledge in Apache Spark and Python programming experience.- Experience in developing...

  • AWS Data Engineer

    2 weeks ago

    Kolkata, India Webologix Ltd INC Full time

    Job Title: AWS Cloud Database EngineerExperience Required: 3-15 YearsLocation: KolkataJob Type: Full-timeMust Have: Aws Glue; Aws Lambda; AWS RDS; AWS S3; Dynamo Db; PySpark; Python; Step FunctionKey Responsibilities:Design, develop, and manage cloud-based OLTP databases using AWS RDS and DynamoDB .Build and maintain scalable ETL pipelines using AWS...

  • Azure data engineer

    4 weeks ago

    Kolkata, India Webologix Ltd INC Full time

    Job Title:Azure Cloud Database EngineerExperience Required:3-15 YearsLocation:KolkataJob Type:Full-timeMust Have:Azure DATA Factory; Azure SQL; Azure Databricks; Azure Cosmos DB; PySpark; Python; SnowflakeKey Responsibilities:Design, implement, and manage cloud-based OLTP databases usingAzure SQLandAzure Cosmos DB .Develop, optimize, and automate data...

  • Data Engineer

    2 months ago

    Kolkata, India Ultimate Digital Solutions Pvt. Ltd. Full time

    We're searching for a skilled Data Engineer to join our dynamic team. The ideal candidate will have a strong background in Python, AWS Glue, SQL, and data pipeline development. You'll be instrumental in designing, building, and maintaining robust data architectures and pipelines, ensuring high-quality data for analysis and insights. Location :...