Lead Data Quality Engineer

Tech Profile/Essential Skills

• 10+ years of experience as a Lead Quality Data Engineer working on software products.
• Proven ability to lead and coordinate projects involving requirement analysis, test planning, and test execution, with clear entry and exit criteria aligned with Azure DevOps principles.
• Experience in coordinating with SCRUM teams to ensure exit criteria are met before code promotion to staging environments.
• Leadership experience managing a team of Senior and Junior Quality Engineers.
• Expertise in creating Automation Test Frameworks using MS Fabric, PySpark, and Pytest.
• Skilled in designing test scenarios for EPICs/Stories, generating test completion reports, and managing the signoff process at each Quality Gate.
• Ability to manage relationships with Product Development, Business, and Product Owners, defining SLAs and OKRs for delivery milestones.
• Proficient in Test Process Management, Test Governance, and Defect Management, providing pragmatic solutions for critical testing issues.
• Demonstrated ability to drive iterative improvements in software quality and accountability for overall release quality.
• Strong knowledge of Azure DevOps CI/CD build and automation pipelines, and experience with containerization technologies.
• Experience in defining test strategies, test plans, and approaches for critical business and change requirements.
• Expereince and hands-on working in design and automate ELT Process via GreatExpections (GX), Data orgestration Air Flow and integration with Fabric
• Experience in Python, Pytest, and other similar programming languages and automation frameworks (BDD).
• Familiar with Spark and has experience with Spark SQL.
• Experience with Azure Fabric, Azure Data Factory, Databricks, Synapse (Spark, PySpark), and Purview.
• Familiarity with Azure DevOps or similar tools for managing agile development.
• Strong understanding of cloud concepts, Azure services, and CI/CD pipelines.
• Excellent leadership, project management, and communication skills.
• Detail-oriented with strong analytical and problem-solving skills.
• Experience with API testing tools like Postman.
• Experience with test management tools (e.g.,ADO, JIRA,TestRail).
• Good understanding of software engineering principles and familiarity with Agile development processes and tools.
• Strong sense of customer satisfaction and core system support.

Preferred Skills and Experience

• Financial Markets domain knowledge.
• Experience in Financial Market Industry product development.
• Ability to support the Production Support team during critical issue escalations.
• Domain knowledge and understanding of data products and data lakes (nice to have).
• Experience in Functional Automation testing within an ETL/ELT Development environment.

Education and Professional Skills

• A relevant degree is desirable, but experience and a proactive approach are equally valued.
• ISEB/ISTQB Certification at Advanced or Expert Level in Test Management.
• Proficiency in Scrum/Agile methodologies.
• Strong English reading and writing skills.
• Excellent communication and articulation abilities.
• Curiosity for new technologies and tools, with a creative and proactive mindset.

Detailed Responsibilities

• Demonstrate knowledge of technologies and their relevance to various business areas.
• Work on diverse projects, including creating new automated ETL data feeds, enhancing existing web tools with data analysts, refactoring data flow processes, supporting existing systems, performing bug fixes, and prototyping new systems on new hardware.
• Execute tasks with some guidance and oversight.
• Develop tools and applications by producing clean and efficient code; review others' code when required.
• Build trusting relationships with team members and colleagues, collaborating closely.
• Communicate clearly and precisely in a concise format.
• Take initiative to develop knowledge in technology products and tools through on-the-job learning, certifications, and projects.

Job Type: Full-time

Pay: ₹559, ₹1,941,944.39 per year

Benefits:

• Health insurance
• Paid sick time
• Paid time off
• Provident Fund
• Work from home

Work Location: In person