Data Quality

Role description

A Data Quality & Automation Engineer to take over and enhance existing automation frameworks and develop new ones for validating data migration and transformation across Oracle SQL Developer, SQL Server Management Studio (SSMS), and Databricks. The role involves working extensively with databases, Python automation, and SQL-based data validations to ensure data integrity during migration and post-migration processes across both batch and streaming pipelines

Skills

• Convert manual test cases in Azure DevOps into automated validation scripts using Python (VS Code).
• Design, implement, and optimize SQL validation queries to reconcile large datasets.
• Maintain and enhance existing Python-based validation framework for source-to-target system reconciliation across Oracle, SQL Server, and Databricks.
• Manage and execute scenario-based validations, including record counts, null checks, data accuracy, and validity rules, based on requirements.
• Implement cross-system data validation for both batch loads and streaming data flows.
• Automate execution flows, structured logging, exception handling, and result reporting in user-defined formats (CSV, text, dashboards).
• Debug and maintain framework scripts, environment setup (Oracle Instant Client, ODBC drivers), and resolve connectivity or runtime issues.
• Write and maintain unit tests and smoke tests for Python scripts and SQL queries to ensure stability.
• Collaborate with business and technical teams to define validation requirements, establish pass/fail conditions, and interpret results.
• Manage Git repositories, including branching strategies, merging, and version control best practices.

Other details

• Strong proficiency in Python (data handling, automation, error handling).
• Hands-on experience with Oracle Database, SQL Server (SSMS), and Databricks.
• Familiarity with database drivers: oracledb (Oracle) and pyodbc (SQL Server).
• Expertise in writing and optimizing SQL queries (joins, aggregations, CASE logic, exception handling).
• Experience managing Git repositories and collaborative development workflows.
• Knowledge of data validation frameworks and large-scale reconciliation strategies.
• Familiarity with data quality metrics: completeness, accuracy, consistency, timeliness, uniqueness.

• Ability to track and report defects, mismatches, and exceptions with clear root-cause analysis.

• Experience with cross-database reconciliation (Oracle, SQL Server, Databricks).

• Familiarity with Azure DevOps (creating tasks, test plans, and pipelines).
• Ability to design structured reporting and dashboards for test execution summaries.

About RCG Global Services
At Myridius, we transform the way businesses operate. Formerly known as RCG Global Services, our more than 50 years of expertise now drive a new vision—propelling organizations through the rapidly evolving landscapes of technology and business. We offer tailored solutions in AI, data analytics, digital engineering, and cloud innovation, addressing the unique challenges each industry faces. Our integration of cutting-edge technology with deep domain knowledge enables businesses to seize new opportunities, drive significant growth, and maintain a competitive edge in the global market. Our commitment is not just to meet expectations but to exceed them, ensuring measurable impact and fostering sustainable innovation. The success of Myridius is directly tied to the breakthroughs achieved by our clients. Together, we co-create solutions that not only solve today's challenges but also anticipate future trends. At Myridius, we go beyond typical service delivery. We craft transformative outcomes that help businesses not just adapt, but thrive in a world of continuous change. Discover how Myridius can elevate your business to new heights of innovation. Visit us at and start leading the change.