PySpark Developer

3 months ago


Kolkata, India Risk Resources LLP Full time

Job Description :

Must-Have :

- Mandatory skill : Pyspark.

- 3-6 years of experience in the design and implementation of Big Data pipelines using PySpark, database migration, transformation, and integration solutions for any Data warehousing project.

- Must have excellent knowledge in Apache Spark and Python programming experience.

- Experience in developing data processing tasks using PySpark such as reading data from external sources, merging data, aggregating data, performing data enrichment, and loading into target data destinations.

- Hands-on project experience on Jupyter Notebook/ PyCharm etc. IDE

- Should have experience in fine-tuning process and troubleshooting performance issue.

- Experience in source code control systems like git, GitHub, SVN etc.

- Experience in deployment and operationalizing the code, knowledge of scheduling tools like Control-M etc. is preferred.

- Experience in CI/CD tools like Jenkins, Nexus, Ansible etc.

- Excellent communication and interpersonal skills.

Good-to-Have :

- Understanding of Unix/Linux Shell Scripting

- Should understand and have operating experience with Agile

(ref:hirist.tech)
  • PySpark Developer

    4 weeks ago


    Hyderabad/Chennai/Kolkata, India Risk Resources LLP Full time

    Job Title: PySpark DeveloperAbout the Role:We are seeking a highly skilled PySpark Developer to join our team at Risk Resources LLP. As a key member of our data engineering team, you will be responsible for designing and implementing Big Data pipelines using PySpark, database migration, transformation, and integration solutions for our Data warehousing...

  • PySpark Developer

    2 weeks ago


    Hyderabad/Chennai/Kolkata, India Risk Resources LLP Full time

    Job Description : Must-Have : - Mandatory skill : Pyspark.- 3-6 years of experience in the design and implementation of Big Data pipelines using PySpark, database migration, transformation, and integration solutions for any Data warehousing project.- Must have excellent knowledge in Apache Spark and Python programming experience.- Experience in developing...

  • Pyspark

    3 weeks ago


    Kolkata, West Bengal, India Tata Consultancy Services Full time

    pyspark 5 to 8 kolkata location and developer role Qualifications :ELECT& ELETROENG


  • Kolkata, West Bengal, India Genpact Full time

    Principal Consultant - Pyspark/Python Data EngineerWe are seeking a highly skilled Python developer to join our team in a Principal Consultant role. As a seasoned professional, you will be responsible for developing and implementing high-quality software solutions for data transformation and analytics using cutting-edge programming features and...

  • Databricks Developer

    1 month ago


    Kolkata, India NUSTAR TECHNOLOGIES INDIA PRIVATE LIMITED Full time

    Exp: 5+yrsLocation : Kolkata Job Description : - Minimum 5 years + working exp as Databricks Developer.- Minimum 3 years + working exp on PySpark and AWS. - 5+ years relevant and progressive data engineering experience.- Deep Technical knowledge and experience in Databricks, Python, Scala, Microsoft Azure architecture and platform including Synapse, ADF...


  • Kolkata, West Bengal, India Genpact Full time

    Genpact is a global professional services and solutions firm that delivers outcomes that shape the future. Our people, driven by our innate curiosity and entrepreneurial agility, work to create lasting value for clients. We serve and transform leading enterprises, including the Fortune Global 500, with our deep business and industry knowledge, digital...


  • Hyderabad/Chennai/Kolkata, India Risk Resources LLP Full time

    Job Description :Key Responsibilities :- Develop and implement Big Data pipelines using PySpark for Data warehousing projects.- Design and implement efficient data processing tasks using PySpark, including data reading from external sources, merging, aggregating, and loading into target data destinations.- Collaborate with cross-functional teams to deploy...


  • Kolkata, India Genpact Full time

    Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people – we...


  • kolkata, India Genpact Full time

    Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people – we...


  • Kolkata, India Genpact Full time

    Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people – we...

  • Lead Consultant

    4 months ago


    Kolkata, India Genpact Full time

    Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people –...

  • AWS Data Engineer

    2 months ago


    kolkata, India Tata Consultancy Services Full time

    Role** DeveloperRequired Technical Skill Set** Databricks, Python, PysparkDesired Experience Range** 4-6 YearsLocation of Requirement Kochi/ Kolkata, IndiaDesired Competencies (Technical/Behavioral Competency)Must-Have**(Ideally should not be more than 3-5 lines)3 years of experience in Databricks engineering solutions on AWS Cloud platforms using PySpark,...

  • AWS Data Engineer

    2 months ago


    kolkata, India Tata Consultancy Services Full time

    Role** Developer Required Technical Skill Set** Databricks, Python, Pyspark Desired Experience Range** 4-6 Years Location of Requirement Kochi/ Kolkata, India Desired Competencies (Technical/Behavioral Competency) Must-Have** (Ideally should not be more than 3-5 lines) 3 years of experience in Databricks engineering solutions on AWS Cloud platforms...

  • AWS Data Engineer

    2 months ago


    Kolkata, India Tata Consultancy Services Full time

    Role** DeveloperRequired Technical Skill Set** Databricks, Python, PysparkDesired Experience Range** 4-6 YearsLocation of Requirement Kochi/ Kolkata, IndiaDesired Competencies (Technical/Behavioral Competency)Must-Have**(Ideally should not be more than 3-5 lines)3 years of experience in Databricks engineering solutions on AWS Cloud platforms using PySpark,...

  • Data Engineer

    2 days ago


    kolkata, India Webologix Ltd INC Full time

    Job Title: AWS Cloud Database Engineer Experience Required: 3-15 Years Location: Kolkata Job Type: Full-time Must Have: Aws Glue; Aws Lambda; AWS RDS; AWS S3; Dynamo Db; PySpark; Python; Step Function Key Responsibilities: - Design, develop, and manage cloud-based OLTP databases using AWS RDS and DynamoDB. - Build and maintain scalable ETL pipelines...

  • AWS Data Engineer

    1 week ago


    Kolkata, India Webologix Ltd INC Full time

    Job Title: AWS Cloud Database EngineerExperience Required: 3-15 YearsLocation: KolkataJob Type: Full-timeMust Have: Aws Glue; Aws Lambda; AWS RDS; AWS S3; Dynamo Db; PySpark; Python; Step FunctionKey Responsibilities:- Design, develop, and manage cloud-based OLTP databases using AWS RDS and DynamoDB.- Build and maintain scalable ETL pipelines using AWS Glue...

  • AWS Data Engineer

    2 weeks ago


    Kolkata, India Webologix Ltd INC Full time

    Job Title:AWS Cloud Database EngineerExperience Required:3-15 YearsLocation:KolkataJob Type:Full-timeMust Have:Aws Glue; Aws Lambda; AWS RDS; AWS S3; Dynamo Db; PySpark; Python; Step FunctionKey Responsibilities:Design, develop, and manage cloud-based OLTP databases usingAWS RDSandDynamoDB .Build and maintain scalable ETL pipelines usingAWS GlueandPySpark...


  • Kolkata, India Genpact Full time

    Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people –...

  • Azure data engineer

    1 month ago


    Kolkata, India Webologix Ltd INC Full time

    Job Title: Azure Cloud Database EngineerExperience Required: 3-15 YearsLocation: KolkataJob Type: Full-timeMust Have: Azure DATA Factory; Azure SQL; Azure Databricks; Azure Cosmos DB; PySpark; Python; SnowflakeKey Responsibilities:- Design, implement, and manage cloud-based OLTP databases using Azure SQL and Azure Cosmos DB.- Develop, optimize, and automate...

  • Azure Data Engineer

    2 months ago


    Kolkata, India Talpro Full time

    Job Description : We are looking for a skilled and experienced Azure Data Engineer with expertise in ADF (Azure Data Factory), strong RDBMS and SQL skills, and familiarity with Informatica PWC and Oracle PL/SQL. As an Azure Data Engineer, you will be responsible for understanding and converting Informatica PWC and Oracle PL/SQL code into ADF and Azure SQL....