PySpark Developer
3 months ago
Job Description :
Must-Have :
- Mandatory skill : Pyspark.
- 3-6 years of experience in the design and implementation of Big Data pipelines using PySpark, database migration, transformation, and integration solutions for any Data warehousing project.
- Must have excellent knowledge in Apache Spark and Python programming experience.
- Experience in developing data processing tasks using PySpark such as reading data from external sources, merging data, aggregating data, performing data enrichment, and loading into target data destinations.
- Hands-on project experience on Jupyter Notebook/ PyCharm etc. IDE
- Should have experience in fine-tuning process and troubleshooting performance issue.
- Experience in source code control systems like git, GitHub, SVN etc.
- Experience in deployment and operationalizing the code, knowledge of scheduling tools like Control-M etc. is preferred.
- Experience in CI/CD tools like Jenkins, Nexus, Ansible etc.
- Excellent communication and interpersonal skills.
Good-to-Have :
- Understanding of Unix/Linux Shell Scripting
- Should understand and have operating experience with Agile
-
PySpark Developer
4 weeks ago
Hyderabad/Chennai/Kolkata, India Risk Resources LLP Full timeJob Title: PySpark DeveloperAbout the Role:We are seeking a highly skilled PySpark Developer to join our team at Risk Resources LLP. As a key member of our data engineering team, you will be responsible for designing and implementing Big Data pipelines using PySpark, database migration, transformation, and integration solutions for our Data warehousing...
-
PySpark Developer
2 weeks ago
Hyderabad/Chennai/Kolkata, India Risk Resources LLP Full timeJob Description : Must-Have : - Mandatory skill : Pyspark.- 3-6 years of experience in the design and implementation of Big Data pipelines using PySpark, database migration, transformation, and integration solutions for any Data warehousing project.- Must have excellent knowledge in Apache Spark and Python programming experience.- Experience in developing...
-
Pyspark
3 weeks ago
Kolkata, West Bengal, India Tata Consultancy Services Full timepyspark 5 to 8 kolkata location and developer role Qualifications :ELECT& ELETROENG
-
Senior Data Developer
1 week ago
Kolkata, West Bengal, India Genpact Full timePrincipal Consultant - Pyspark/Python Data EngineerWe are seeking a highly skilled Python developer to join our team in a Principal Consultant role. As a seasoned professional, you will be responsible for developing and implementing high-quality software solutions for data transformation and analytics using cutting-edge programming features and...
-
Databricks Developer
1 month ago
Kolkata, India NUSTAR TECHNOLOGIES INDIA PRIVATE LIMITED Full timeExp: 5+yrsLocation : Kolkata Job Description : - Minimum 5 years + working exp as Databricks Developer.- Minimum 3 years + working exp on PySpark and AWS. - 5+ years relevant and progressive data engineering experience.- Deep Technical knowledge and experience in Databricks, Python, Scala, Microsoft Azure architecture and platform including Synapse, ADF...
-
Senior Pyspark Data Engineer
5 days ago
Kolkata, West Bengal, India Genpact Full timeGenpact is a global professional services and solutions firm that delivers outcomes that shape the future. Our people, driven by our innate curiosity and entrepreneurial agility, work to create lasting value for clients. We serve and transform leading enterprises, including the Fortune Global 500, with our deep business and industry knowledge, digital...
-
Senior PySpark Engineer
2 weeks ago
Hyderabad/Chennai/Kolkata, India Risk Resources LLP Full timeJob Description :Key Responsibilities :- Develop and implement Big Data pipelines using PySpark for Data warehousing projects.- Design and implement efficient data processing tasks using PySpark, including data reading from external sources, merging, aggregating, and loading into target data destinations.- Collaborate with cross-functional teams to deploy...
-
Pyspark/Python Data Engineer
3 months ago
Kolkata, India Genpact Full timeGenpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people – we...
-
Pyspark/Python Data Engineer
1 week ago
kolkata, India Genpact Full timeGenpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people – we...
-
Pyspark/python data engineer
7 days ago
Kolkata, India Genpact Full timeGenpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people – we...
-
Lead Consultant
4 months ago
Kolkata, India Genpact Full timeGenpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people –...
-
AWS Data Engineer
2 months ago
kolkata, India Tata Consultancy Services Full timeRole** DeveloperRequired Technical Skill Set** Databricks, Python, PysparkDesired Experience Range** 4-6 YearsLocation of Requirement Kochi/ Kolkata, IndiaDesired Competencies (Technical/Behavioral Competency)Must-Have**(Ideally should not be more than 3-5 lines)3 years of experience in Databricks engineering solutions on AWS Cloud platforms using PySpark,...
-
AWS Data Engineer
2 months ago
kolkata, India Tata Consultancy Services Full timeRole** Developer Required Technical Skill Set** Databricks, Python, Pyspark Desired Experience Range** 4-6 Years Location of Requirement Kochi/ Kolkata, India Desired Competencies (Technical/Behavioral Competency) Must-Have** (Ideally should not be more than 3-5 lines) 3 years of experience in Databricks engineering solutions on AWS Cloud platforms...
-
AWS Data Engineer
2 months ago
Kolkata, India Tata Consultancy Services Full timeRole** DeveloperRequired Technical Skill Set** Databricks, Python, PysparkDesired Experience Range** 4-6 YearsLocation of Requirement Kochi/ Kolkata, IndiaDesired Competencies (Technical/Behavioral Competency)Must-Have**(Ideally should not be more than 3-5 lines)3 years of experience in Databricks engineering solutions on AWS Cloud platforms using PySpark,...
-
Data Engineer
2 days ago
kolkata, India Webologix Ltd INC Full timeJob Title: AWS Cloud Database Engineer Experience Required: 3-15 Years Location: Kolkata Job Type: Full-time Must Have: Aws Glue; Aws Lambda; AWS RDS; AWS S3; Dynamo Db; PySpark; Python; Step Function Key Responsibilities: - Design, develop, and manage cloud-based OLTP databases using AWS RDS and DynamoDB. - Build and maintain scalable ETL pipelines...
-
AWS Data Engineer
1 week ago
Kolkata, India Webologix Ltd INC Full timeJob Title: AWS Cloud Database EngineerExperience Required: 3-15 YearsLocation: KolkataJob Type: Full-timeMust Have: Aws Glue; Aws Lambda; AWS RDS; AWS S3; Dynamo Db; PySpark; Python; Step FunctionKey Responsibilities:- Design, develop, and manage cloud-based OLTP databases using AWS RDS and DynamoDB.- Build and maintain scalable ETL pipelines using AWS Glue...
-
AWS Data Engineer
2 weeks ago
Kolkata, India Webologix Ltd INC Full timeJob Title:AWS Cloud Database EngineerExperience Required:3-15 YearsLocation:KolkataJob Type:Full-timeMust Have:Aws Glue; Aws Lambda; AWS RDS; AWS S3; Dynamo Db; PySpark; Python; Step FunctionKey Responsibilities:Design, develop, and manage cloud-based OLTP databases usingAWS RDSandDynamoDB .Build and maintain scalable ETL pipelines usingAWS GlueandPySpark...
-
Principal Consultant-Senior Data Engineer
3 months ago
Kolkata, India Genpact Full timeGenpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people –...
-
Azure data engineer
1 month ago
Kolkata, India Webologix Ltd INC Full timeJob Title: Azure Cloud Database EngineerExperience Required: 3-15 YearsLocation: KolkataJob Type: Full-timeMust Have: Azure DATA Factory; Azure SQL; Azure Databricks; Azure Cosmos DB; PySpark; Python; SnowflakeKey Responsibilities:- Design, implement, and manage cloud-based OLTP databases using Azure SQL and Azure Cosmos DB.- Develop, optimize, and automate...
-
Azure Data Engineer
2 months ago
Kolkata, India Talpro Full timeJob Description : We are looking for a skilled and experienced Azure Data Engineer with expertise in ADF (Azure Data Factory), strong RDBMS and SQL skills, and familiarity with Informatica PWC and Oracle PL/SQL. As an Azure Data Engineer, you will be responsible for understanding and converting Informatica PWC and Oracle PL/SQL code into ADF and Azure SQL....