Senior Data Quality Engineer

3 weeks ago

PuneHyderabadGurgaonGurugram, IN HuQuo Consulting Pvt. Ltd. Full time

Job Description - Senior Data Quality Engineer (Azure Specialist, Automation)

Experience : 6-8+ years

Work Location - Pune, Hyderabad(Hybrid)

The Senior Data Quality Engineer is a collaborative role responsible for designing sound, scalable, and performant data quality metrics that meet the requirements in a large data volume enterprise.

Technical Skills

Must have :

- 6-8+ years of experience working in Bigdata and Cloud environments- including Relational Databases, Data Lakes, ELT/ETL processes, data profiling and data quality management.

- Expert-level experience with SQL & Python, writing complex queries.

- Excellent documentation skills with knowledge of tools like JIRA, Confluence, Bitbucket.

- 5+ years experience in Big data and ETL testing Spark, PySpark

- Experience is API Testing, Postman

Experience with Azure public cloud(ADF, Synapse, Event Hubs, ADLS2)

Candidate Profile:

Bachelor's/Master's degree in computer science/engineering, operations research or related areas.

Self-starter with drive, initiative and a positive attitude. Able to meet very stringent deadlines and always deliver results, even under pressure.

Outstanding written and verbal communication skills

Key Responsibilities :

- Be the point of contact for Data validation deliverable.

- Develop and automate underlying SQL or Python scripts for implementing DQ rules and metrics in pre & postproduction data systems.

- Investigate and explain data anomalies.

- Work alongside the central data quality team and data engineers to ensure high quality data and observability.

- Participate in go-live preparation activities such as QA, dress rehearsals, issue remediation, cutover, and go-live aftercare.

- Seek opportunities for continuous improvement in processes, procedures, and systems with regards to data quality

- Define test strategy for various platform components.

- Hands on in executing Test plans and test scenarios for user stories,

- Test automation executing test scenarios, Performance testing, Functional testing, Regression testing, Post-Production validation, Bug reporting.

- Experience in Publish test reports to stakeholders.

(ref:hirist.tech)

  • Senior Data Engineer

    4 weeks ago

    Gurgaon/Gurugram, IN Optivalue tek consulting Full time

    Company Description : OptiValueTek is a leading provider of IT solutions specializing in Application & Process Integration, API Management, Data Engineering, Data Science/MLOps, DevOps & SRE, Cloud Solutions, and Web/Mobile & Application Development. With a focus on innovation, we have developed in-house tools/accelerators for Test Automation, API...

  • Senior Data Engineer

    3 weeks ago

    Gurgaon/Gurugram, IN Optivalue tek consulting Full time

    Company Description : OptiValueTek is a leading provider of IT solutions specializing in Application & Process Integration, API Management, Data Engineering, Data Science/MLOps, DevOps & SRE, Cloud Solutions, and Web/Mobile & Application Development. With a focus on innovation, we have developed in-house tools/accelerators for Test Automation, API...

  • Data Engineer

    2 months ago

    Gurgaon/Gurugram/Bangalore, IN Huquo Full time

    Role and Responsibilities :- To work on Data Governance - Build a robust data quality validation framework, business rules to identify any data quality issues.- Liaise with different client stakeholders on ad-hoc analyses related to monitoring the data- Build ETL & data pipelines to help feed the data into different business facing data products /...

  • Lead/Senior Azure Data Engineer

    2 months ago

    Pune/Hyderabad/Gurgaon/Gurugram, IN Huquo Full time

    About Clairvoyant :Clairvoyant is a global technology consulting and services company founded in 2012, headquartered in Chandler, US, and has delivery centers across the globe. We help organizations maximize the value of data by providing data engineering, analytics, machine learning, and user experience consulting and development projects to multiple...

  • Lead/Senior Azure Data Engineer

    3 weeks ago

    Pune/Hyderabad/Gurgaon/Gurugram, IN Huquo Full time

    About Clairvoyant :Clairvoyant is a global technology consulting and services company founded in 2012, headquartered in Chandler, US, and has delivery centers across the globe. We help organizations maximize the value of data by providing data engineering, analytics, machine learning, and user experience consulting and development projects to multiple...

  • Engineering Program Manager

    3 weeks ago

    Gurgaon/Gurugram, IN Ofbusi Full time

    Job Summary : OfBusiness is seeking a Data Quality and Engineering Program Manager to ensure the integrity and reliability of our data assets while managing data-centric projects to practical execution and timely delivery.What You'll Do :Data Quality Custodian : Serve as the go-to person for data quality. Ensure the integrity and reliability of our data...

  • Engineering Program Manager

    2 months ago

    Gurgaon/Gurugram, IN Ofbusi Full time

    Job Summary : OfBusiness is seeking a Data Quality and Engineering Program Manager to ensure the integrity and reliability of our data assets while managing data-centric projects to practical execution and timely delivery.What You'll Do :Data Quality Custodian : Serve as the go-to person for data quality. Ensure the integrity and reliability of our data...

  • Coforge - Data Engineer - Data Pipeline

    3 weeks ago

    Gurgaon/Gurugram, IN COFORGE Full time

    Job Description :As a Senior Data Engineer, you'll be at the forefront of developing and optimizing data pipelines, ensuring the seamless flow of data across our systems. Bring your expertise in Java, Python, and a range of big data technologies including Hadoop, Cassandra, Kafka, Spark, HBase, and MySQL to drive innovation and efficiency in our data...

  • Coforge - Data Engineer - Data Pipeline

    2 months ago

    Gurgaon/Gurugram, IN COFORGE Full time

    Job Description :As a Senior Data Engineer, you'll be at the forefront of developing and optimizing data pipelines, ensuring the seamless flow of data across our systems. Bring your expertise in Java, Python, and a range of big data technologies including Hadoop, Cassandra, Kafka, Spark, HBase, and MySQL to drive innovation and efficiency in our data...

  • Senior Data Governance Engineer

    3 weeks ago

    Bangalore/Gurgaon/Gurugram/Mohali, IN USEReady Technology Pvt Ltd Full time

    Job Description :We are looking for a Sr. Data Governance Engineer to build capabilities and features around the IDQ/EDC/Axon/Data Marketplace/ CDGC for Data Quality and Data Governance use cases.Responsibilities :- Experience on Data Governance, Metadata Management, Data Catalog, Data Quality tools like Informatica IDQ/EDC/Axon , data warehousing technology...

  • Senior Data Governance Engineer

    2 months ago

    Bangalore/Gurgaon/Gurugram/Mohali, IN USEReady Technology Pvt Ltd Full time

    Job Description :We are looking for a Sr. Data Governance Engineer to build capabilities and features around the IDQ/EDC/Axon/Data Marketplace/ CDGC for Data Quality and Data Governance use cases.Responsibilities :- Experience on Data Governance, Metadata Management, Data Catalog, Data Quality tools like Informatica IDQ/EDC/Axon , data warehousing technology...

  • Data Quality Engineer

    1 week ago

    Chennai/Pune, IN IMS consulting company Full time

    Job Description :As a Manager of Data Quality Engineering, you will lead a team responsible to ensure the accuracy, integrity, and reliability of data across the organization. You will collaborate closely with various stakeholders including data engineers, data scientists, product managers, and business analysts to establish and maintain robust data quality...

  • Curate Data Analytics

    3 weeks ago

    Gurgaon/Gurugram, IN Curate Data Analytics LLP Full time

    About the Job : Senior Power BI DeveloperWe at Curate Data Analytics (A Startup in Business Analytics & Strategy space) are on a look out for a dynamic leader who knows Power BI very well, to be part of our Business Intelligence reporting Team. The incumbent is required to have a good understanding of business analytics & reporting using Power BI in FMCG...

  • Curate Data Analytics

    2 months ago

    Gurgaon/Gurugram, IN Curate Data Analytics LLP Full time

    About the Job : Senior Power BI DeveloperWe at Curate Data Analytics (A Startup in Business Analytics & Strategy space) are on a look out for a dynamic leader who knows Power BI very well, to be part of our Business Intelligence reporting Team. The incumbent is required to have a good understanding of business analytics & reporting using Power BI in FMCG...

  • Lead Data Engineer

    4 weeks ago

    Gurgaon/Gurugram, IN HuQuo Consulting Pvt. Ltd. Full time

    Job brief :We are looking for a Lead Data Engineer to join our Data Engineering Team. In this senior role, you will be responsible for managing our Enterprise Data Warehouse and ensuring the efficient flow and quality of data.Your tasks will include implementing data processes, managing data architecture, designing ETL processes, and analyzing data for...

  • Lead Data Engineer

    3 weeks ago

    Gurgaon/Gurugram, IN HuQuo Consulting Pvt. Ltd. Full time

    Job brief :We are looking for a Lead Data Engineer to join our Data Engineering Team. In this senior role, you will be responsible for managing our Enterprise Data Warehouse and ensuring the efficient flow and quality of data.Your tasks will include implementing data processes, managing data architecture, designing ETL processes, and analyzing data for...

  • Freight Tiger

    3 weeks ago

    Gurgaon/Gurugram, IN Freight Tiger Full time

    Our growth plans :We process close to 4% of the country's freight on our software platform. Our goal is to get to 20% of the country's freight by 2028. This gives us a bird's eye view of the market. We're already the largest road freight technology platform in the country and we plan to build on this base to drive growth in software, freight...

  • Senior Data Engineer

    1 week ago

    Bangalore/Chennai/Hyderabad, IN PPLABILITY PRIVATE LIMITED Full time

    Job Title: Senior Data Engineer-Data Modeling. Location: Bengaluru, Chennai, about the role? What your typical day would look like? As a Senior Data Engineer, you will work to solve some of the organizational data management problems that would enable them as a data-driven organization; Seamlessly switch between roles of an Individual Contributor, team...

  • NewsBytes - Junior Quality Assurance Engineer - Testing

    2 months ago

    Gurgaon/Gurugram, IN NewsBytes Full time

    Company Overview : Elysium Labs is a product and software technology company that operates in the media space. We are the pioneers of robot journalism in India. We use the mix of AI generated and human- edited content, across media formats, be it audio, video or text.Our key products include India's first explanatory journalism portal-NewsBytes, a...

  • NewsBytes - Junior Quality Assurance Engineer - Testing

    3 weeks ago

    Gurgaon/Gurugram, IN NewsBytes Full time

    Company Overview : Elysium Labs is a product and software technology company that operates in the media space. We are the pioneers of robot journalism in India. We use the mix of AI generated and human- edited content, across media formats, be it audio, video or text.Our key products include India's first explanatory journalism portal-NewsBytes, a...