IN | Travelers_ BC: AWS Glue- Pyspark Dev_Offshore

:- Primary - Strong experience in PostgreSQL. Must have experience in Stored procedure development. ETL environment using the Talend application. Secondary - Should have good experience in Data Migration process (Data profiling/ Analysis and Transformation/Load ) Should have good communication skills and knowledge in Agile process. Knowledge of Talend...

Must Have Strong hands-on Experience in AWS Native Services Python, Pyspark Data Engineering(S3, EMR, Glue, Sqoop) Serverless Experience(Lambda, Step Functions) Strong SQL AWS Athena, Cloud Formation Templates, Crawler Strong Data analysis and troubleshooting skill Datamart / Data Warehousing Multi-Dimensional OLAP Star/Snowflake Schema Design **About...

**JOB DESCRIPTION** **Skill: PySpark QA** **Role / Tier: Lead Software Engineer/Tier 2** **Experience: 6 - 9 years** Primary Skills BIG Data technology mentioned below Hadoop / Big Data (HDFS, PYTHON, SPARK-SQL, MapReduce) with PYSpark. build CI/CD pipelines Spark APIs to cleanse, explore, aggregate, transform, store & analyse installing, configuring,...

P3-C3-STS AWS Data Engineer Design and build scalable data pipelines using AWS services like AWS Glue, Amazon Redshift, and S3. Develop efficient ETL processes for data extraction, transformation, and loading into data warehouses and lakes. Automate repetitive tasks and build reusable frameworks to improve efficiency. Skill AWS Data Engineer - AWS Glue,...

Role : AWS TesterWe are looking for a highly skilled Automation QA Engineer with hands-on experience in AWS and Big Data ecosystems to join our Quality Engineering team. The ideal candidate will be responsible for developing automated test frameworks and validating large-scale data processing pipelines in cloud-based environments. This role requires strong...

Overall 10+ years of experience in Datawarehouse and Hadoop platform. MUST have experience with Python/PySpark and Hive in Big Data environments Should have strong skills in writing complex SQL Queries and good understanding of Data warehouse concepts. exposure to migration of legacy Data warehouse platform to Hadoop platform experience will be a big...

AWS Data EngineerExperience :- 5+ yearsLocation : RemoteJob DescriptionDesign, development, and implementation of performant ETL pipelines using python API (pySpark) of Apache Spark on AWS EMR.Writing reusable, testable, and efficient codeIntegration of data storage solutions in spark – especially with AWS S3 object storage. Performance tuning of pySpark...

P2-C3-STS 1. Experience with AWS CDK development using TypeScript or Python. 2. Experience with AWS services like s3, Redshift, RDS, EC2, Glue, CloudFormation etc.., 3. Experience with lambda development using python 4. Experience with access management using IAM roles. 5. Experience with code management using GitHub 6. Experience with Data pipeline...

skillExperience At least 5 years of experience in AWS based projects. Technical skills Proficiency in Python and PySpark for data engineering tasks. Big Data Strong knowledge of Big Data technologies and data warehousing concepts. AWS services Experience with AWS Data Engineering stack, including S3, RDS, Athena, Glue, Lambda, and Step Functions. SQL Strong...

- Primary - Strong experience in PostgreSQL. Must have experience in Stored procedure development. ETL environment using the Talend application. Secondary - Should have good experience in Data Migration process (Data profiling/ Analysis and Transformation/Load ) Should have good communication skills and knowledge in Agile process. Knowledge of Talend...