Java Spark Etl

**6+ years**of Experience in **Spark ETL on Bigdata**: - Must have **good Database knowledge**and should be able to write the queries **Spark ETL on Big Data**: - Good to have Knowledge in Spark SQL. - Good to have understanding on Regulatory reporting. - Design & implementation of scalable & fault tolerant ETL Pipelines on Bigdata Platform to store &...

Design thorough ETL testing solutions Implement tests that are logical, extensible and thorough Create scripts that cover UI, Functional, Regression and E2E requirements Mentor the team on test practices Make informed decisions quickly and take ownership of quality solutions About you: You will have up to 7 years of experience testing commercial software in...

JD: Establishes and provides traceability to requirements for all tests executed in between Acceptance Criteria in system test ( INT/QA) Write and execute test scripts through execution, test and release phases. Responsible for understanding and communicating the status of the projects test strategy and test scripts to the scrum team. Responsible for working...

Key Responsibilities Data Validation and Testing: Develop and execute comprehensive test plans and test cases to validate data migration processes. Ensure data integrity, accuracy, and consistency across source and target systems. Perform pre and post-migration data checks to verify successful migration. Test Automation Design and implement automated test...

6+yrs with hands-on on Java 1.8 and Above is Must Database knowledge and should be able to write the queries is Must. Handson on experience on Spring boot. Understand on Regulatory reporting(Good to have). Good to have knowledge on microservices, Java/JEE Work closely with multiple teams(Business Analyst, ETL, DB team, Infra, Support, etc ) Work...

AWS Data EngineerExperience :- 5+ yearsLocation : RemoteJob DescriptionDesign, development, and implementation of performant ETL pipelines using python API (pySpark) of Apache Spark on AWS EMR.Writing reusable, testable, and efficient codeIntegration of data storage solutions in spark – especially with AWS S3 object storage. Performance tuning of pySpark...

Role : TALEND Sr Developer **Job Description**: Key Responsibilities ETL Development: Design, develop, and optimize ETL/ELT processes using Talend Data Integration and other Talend components. Data Transformation: Implement data cleansing, transformation, and enrichment processes to support analytics and operational needs. Integration Solutions: Develop and...

Dear Canndidate, We are actively looking for **ETL**(extraction, transformation, and loading)**/Database QA Tester**is primarily responsible for testing of database & functional aspects of Banking and Financial software products using a variety of methods and tools. Testers execute test cases and report defects following test plans and procedures developed...

10 years of hands-on experience in Spark, Kafka, Python, Hive, Snowflake, Databricks, AWSLead architecture of big data platforms for enterprise-scale analyticsDevelop, test, and optimize complex ETL workflowsCollaborate with Data Scientists and Business SMEs on ML pipelinesEnforce data quality, lineage, and observability best practicesMentor engineers and...

Data Modeler (Architect): JD 10+ years of experience in data modeling, database design, or related roles. Experience in relational, dimensional, and/or analytic experience (using RDBMS, dimensional, NoSQL data platform technologies, and ETL and data ingestion protocols). Proven experience in designing data models for ETL/ELT processes and data warehouses in...