Senior Data Quality Engineer
4 weeks ago
Overview: symplr is seeking a highly skilled and motivated Senior Data Quality Engineer with 7+ years of experience to support testing and quality assurance for our scalable Data Platform. This role is instrumental in maintaining the integrity, reliability, and performance of our data systems. The ideal candidate will bring strong expertise in ETL testing, data validation, AWS-based data workflows, and Power BI reports, with a solid foundation in Test Automation and scripting. This position is part of symplr’s Data Platform team and will report to the Quality Manager, working closely with Engineering and Analytics stakeholders to ensure high data quality standards - Contribute to the development and execution of data quality strategies and best practices to support the organization’s data initiatives. - ETL Testing: Design and perform thorough ETL tests, including test case development, data validation, transformation accuracy, end-to-end pipeline testing, and performance testing. - AWS Data Pipeline Monitoring: Support the monitoring and optimization of AWS-based pipelines using services like Glue, S3, Athena, SQS, Lambda, and Step Functions. - Automation & Scripting: Develop Python-based scripts to automate data quality checks and validation processes. - Power BI Reports: Ensure data accuracy and consistency in Power BI reports by validating data lineage, transformation logic, and report outputs against source systems. - Collaboration: Work alongside data engineers, analysts, and business stakeholders to understand data flows and resolve data quality issues. - Documentation: Maintain clear and detailed documentation of testing procedures, test results, and quality metrics. Duties & Responsibilities: - Contribute to the development and execution of data quality strategies and best practices to support the organization’s data initiatives. - ETL Testing: Design and perform thorough ETL tests, including test case development, data validation, transformation accuracy, end-to-end pipeline testing, and performance testing. - AWS Data Pipeline Monitoring: Support the monitoring and optimization of AWS-based pipelines using services like Glue, S3, Athena, SQS, Lambda, and Step Functions. - Automation & Scripting: Develop Python-based scripts to automate data quality checks and validation processes. - Power BI Reports: Ensure data accuracy and consistency in Power BI reports by validating data lineage, transformation logic, and report outputs against source systems. - Collaboration: Work alongside data engineers, analysts, and business stakeholders to understand data flows and resolve data quality issues. - Documentation: Maintain clear and detailed documentation of testing procedures, test results, and quality metrics. Skills Required: Required Qualifications: - 7+ years of experience in data quality engineering, data testing, or related fields. - Strong hands-on experience with ETL testing and data validation techniques. - Experience working with AWS data services, including Glue, S3, Athena, MSK, SQS, Lambda, and Step Functions. - Proficiency in SQL and Python for data validation and automation. - Experience validating data in Power BI reports, including understanding of data models and report logic. - Familiarity with test management tools such as Azure DevOps, Zephyr, or equivalent. - Experience working in Agile environments (Scrum/Kanban). - Exposure to data governance principles or data observability tools is a plus. - Strong problem-solving skills and a proactive approach to identifying and resolving data quality issues. - Good communication skills and the ability to work effectively with cross-functional teams. - Continuous learning mindset and willingness to adapt to new technologies and techniques.
-
Senior Data Engineer
1 week ago
bangalore, India AIQU Full timeWe are hiring for Senior Data Engineer to join one of our major clients based out of KSA. Job Details: Role: Senior Data Engineer Work Location: Remote Employment Type: Contract – 12 months & extendable Role Summary: The Senior Data Engineer plays a lead role in designing, building, optimizing, and governing data pipelines and architectures that power...
-
Senior Data Engineer
1 week ago
bangalore, India AIQU Full timeWe are hiring for Senior Data Engineer to join one of our major clients based out of KSA.Job Details:Role: Senior Data EngineerWork Location: RemoteEmployment Type: Contract – 12 months & extendableRole Summary:The Senior Data Engineer plays a lead role in designing, building, optimizing, and governing data pipelines and architectures that power analytics,...
-
Senior Data Engineer
3 weeks ago
Bangalore, India Sonata Software Full timeThe Senior Software Engineer supports functions which require automation/systems development, including initial development and ongoing support of the suite of applications that would help manage loan, pricing, enterprise data pipeline, or other functions depending on the department. As the Application Developer, you must be proficient in Python, Data...
-
Senior Data Engineer
1 week ago
bangalore, India USEReady Full timeJob Title: Senior Databricks EngineerExperience Level: 5-8 YearsJob SummaryAs a Senior Databricks Engineer, you will be responsible for designing, developing, and optimizing our data architecture and pipelines on the Databricks Lakehouse Platform. You will leverage your deep expertise in Spark, Delta Lake, and cloud technologies to build scalable and...
-
Senior Engineer, Data Engineering
1 week ago
Bangalore, India USEReady Full timeJob Title: Senior Databricks Engineer Experience Level: 5-8 Years As a Senior Databricks Engineer, you will be responsible for designing, developing, and optimizing our data architecture and pipelines on the Databricks Lakehouse Platform. You will leverage your deep expertise in Spark, Delta Lake, and cloud technologies to build scalable and reliable...
-
Senior Data Engineer
1 week ago
Bangalore, India USEReady Full timeJob Title: Senior Databricks Engineer Experience Level: 5-8 Years Job Summary As a Senior Databricks Engineer, you will be responsible for designing, developing, and optimizing our data architecture and pipelines on the Databricks Lakehouse Platform. You will leverage your deep expertise in Spark, Delta Lake, and cloud technologies to build scalable and...
-
Senior Data Engineer
3 weeks ago
Bangalore, India USEReady Full timeJob Title: Senior Databricks Engineer Experience Level: 5-8 Years Job Summary As a Senior Databricks Engineer, you will be responsible for designing, developing, and optimizing our data architecture and pipelines on the Databricks Lakehouse Platform. You will leverage your deep expertise in Spark, Delta Lake, and cloud technologies to build scalable and...
-
Senior Data Engineer
1 week ago
Bangalore, India Sonata Software Full timeMandatory * Experience building data pipelines * Highly proficient in python, Data frames * Experience with AWS Lambda, Events (SQS), API calls, Kinesis, DynamoDB * Highly proficient in SQL Query * Snowflake or experience with similar analytics database * Experience extracting data from SQL and NoSQL databases. * Experience with CI/CD pipeline to release the...
-
Senior Quality Engineer
1 week ago
bangalore, India canadainternationalprojects Full timeContract Type: Contract/Consultant Location: Remote Client: Leading Canadian Enterprise Work Schedule: Eastern Time Zone (5:00 PM - 1:00 AM IST) About the Opportunity We are seeking an experienced Senior Quality Engineer for an exciting contract opportunity with a premier Canadian client. This role focuses on ensuring the quality of enterprise-scale data...
-
Senior Engineer, Data Engineering
1 week ago
Bangalore, India Sonata Software Full timeThe Senior Software Engineer supports functions which require automation/systems development, including initial development and ongoing support of the suite of applications that would help manage loan, pricing, enterprise data pipeline, or other functions depending on the department. As the Application Developer, you must be proficient in Python, Data...