Data Quality Engineer
1 week ago
We are seeking a meticulous and proactive Data Quality Engineer to join our dynamic Data
Engineering team. The ideal candidate will possess a deep understanding of data quality,
validation, and data reconciliation concepts. They will collaborate closely with our data
engineers to ensure the integrity and accuracy of our data. This role requires expertise in
PySpark, Python, data pipelines, ETL processes, and Snowflake.
Key Responsibilities:
• Data Quality Management: Develop and implement data quality checks, validation
procedures, and reconciliation processes to ensure data integrity and consistency.
• Collaboration: Work closely with data engineers to design and optimize data
pipelines and ETL processes, ensuring data quality throughout the data lifecycle.
• Data Validation: Create automated scripts and processes to validate data against
business rules and requirements using PySpark and Python.
• Data Reconciliation: Develop and maintain data reconciliation frameworks to
identify and resolve data discrepancies in a timely manner.
• Snowflake Expertise: Leverage Snowflake for data warehousing and data quality
management, ensuring efficient and effective data storage and retrieval.
• Process Improvement: Identify areas for improvement in existing data quality
processes and propose innovative solutions to enhance data accuracy and
reliability.
• Documentation: Maintain comprehensive documentation of data quality
procedures, validation rules, and reconciliation processes.
• Reporting: Generate regular reports on data quality metrics, highlighting issues and
trends to inform stakeholders and drive continuous improvement.
Qualifications:
• Education: Bachelor’s degree in Computer Science, Information Technology, or a
related field. Master’s degree is a plus.
• Experience: Minimum of 4 years of experience in a data quality engineering role,
with a strong focus on data validation, reconciliation, and quality management.
• Technical Skills:
o Proficiency in PySpark and Python for data processing and automation.
o Extensive experience with data pipelines and ETL processes.
o Strong knowledge of Snowflake for data warehousing and quality
management.
o Familiarity with SQL and other database technologies.
Soft Skills:
o Excellent problem-solving and analytical skills.
o Strong attention to detail and commitment to data accuracy.
o Effective communication skills, with the ability to collaborate with cross-
functional teams.
o Ability to work independently and manage multiple priorities in a fast-paced
environment.
-
Senior Quality Engineer
1 week ago
gurgaon, India American Express Full timeWe are looking for a highly skilled Quality Engineer to join our team. The ideal candidate will have a strong background in both Big Data and SQL, with experience in automating data validation and quality assurance processes. You will be responsible for ensuring the accuracy, integrity, and performance of our data systems, working closely with data...
-
Data Engineer
1 week ago
gurgaon, India True Tech Professionals Full timeLead Data Engineer (Multiple Positions)Location: Remote - Gurgaon (Office visit - once in a while - as and when required)Experience:4 to 6 yearsKey Responsibilities:Data Pipeline Development: Design, implement, and maintain scalable data pipelines to extract, transform, and load (ETL) data from various sources into data warehouses or other storage...
-
Quality Engineer
4 months ago
gurgaon, India K D Groups Full timeQuality Engineer Gurgaon Share RSS Feed Job Openings for 1 Quality Engineer Job with minimum 1 Year Experience in Gurgaon/Gurugram,Quality Analyst, having Educational qualification of : Diploma, B.Tech/B.E with Good knowledge in Quality Analyst etc. Salary 1 Lac 50 Thousand To 2 Lac P.A. Qualification Diploma, B.Tech/B.E Key Skills Quality Analyst...
-
Quality Engineer
6 days ago
Gurgaon, India OrbiTouch HR (orbiTouch outsourcing pvt ltd) Full timeUrgent hiring for Quality Engineer|| Location- Gurgaon||Profile:- Quality EngineerLocation-GurgaonExperience :- Min 5 YearsCtc- upto 5 lpaWorking Days- 6 daysJob DescriptionDevelop inspection methods to analyze product qualityMonitor all incoming, process & final inspection activities.Approve or reject raw materials with respect to quality standards and...
-
Data Engineer
7 days ago
Gurgaon, India Persistent Systems Full timeAbout Position:We are seeking a talented Data Engineer to join our team. The ideal candidate will have strong expertise in Python, Apache Spark, and Databricks.Role: Data EngineerLocation: GurgaonExperience: 4-6 YearsJob Type: Full Time EmploymentWhat You'll Do:Develop and maintain scalable data pipelines using Python and Apache Spark.Collaborate with...
-
Data Engineer
1 week ago
Gurgaon, India RSA India (An Intact Company) Full timeData Engineering Opportunity with RSA Insurance GroupThe purpose of the Data Engineer is to build and unit test code for Projects and Programmes on Azure Cloud Data and Analytics Platform.About the roleAnalyse business requirements and support\create design for requirementsBuild and deploy new/changes to technology applications developed on Azure Cloud...
-
Data Engineer
1 week ago
gurgaon, India RSA India (An Intact Company) Full timeData Engineering Opportunity with RSA Insurance GroupThe purpose of the Data Engineer is to build and unit test code for Projects and Programmes on Azure Cloud Data and Analytics Platform.About the roleAnalyse business requirements and support\create design for requirementsBuild and deploy new/changes to technology applications developed on Azure Cloud...
-
Data Engineer
3 months ago
gurgaon, India Impetus Full timeAbout ImpetusImpetus Technologies is a digital engineering company focused on delivering expert services and products to help enterprises achieve their transformation goals. We solve the analytics, AI, and cloud puzzle, enabling businesses to drive unmatched innovation and growth.Founded in 1991, we are cloud and data engineering leaders providing solutions...
-
Data Engineer
3 weeks ago
Gurgaon, India Awign Expert Full timeJob DescriptionAbout Awign Expert: Awign Expert, a division of Awign - India's largest work-as-a-service platform. We connect skilled professionals with exciting project-based opportunities from top companies, handling onboarding, feedback, conflict resolution, and payroll. Our mission is to empower professionals to focus on their work by managing...
-
Data Engineer
4 weeks ago
Gurgaon, India Awign Expert Full timeJob DescriptionAbout Awign Expert: Awign Expert, a division of Awign - India's largest work-as-a-service platform. We connect skilled professionals with exciting project-based opportunities from top companies, handling onboarding, feedback, conflict resolution, and payroll. Our mission is to empower professionals to focus on their work by managing...
-
Data Engineer
3 weeks ago
Gurgaon, India Awign Expert Full timeJob DescriptionAbout Awign Expert: Awign Expert, a division of Awign - India's largest work-as-a-service platform. We connect skilled professionals with exciting project-based opportunities from top companies, handling onboarding, feedback, conflict resolution, and payroll. Our mission is to empower professionals to focus on their work by managing...
-
Data Engineer
3 weeks ago
Gurgaon, India Awign Expert Full timeAbout Awign Expert: Awign Expert, a division of Awign - India's largest work-as-a-service platform. We connect skilled professionals with exciting project-based opportunities from top companies, handling onboarding, feedback, conflict resolution, and payroll. Our mission is to empower professionals to focus on their work by managing administrative tasks,...
-
Data Engineer
4 weeks ago
Gurgaon, India Awign Expert Full timeAbout Awign Expert: Awign Expert, a division of Awign - India's largest work-as-a-service platform. We connect skilled professionals with exciting project-based opportunities from top companies, handling onboarding, feedback, conflict resolution, and payroll. Our mission is to empower professionals to focus on their work by managing administrative tasks,...
-
Data Engineer
3 weeks ago
Gurgaon, India Awign Expert Full timeAbout Awign Expert: Awign Expert, a division of Awign - India's largest work-as-a-service platform. We connect skilled professionals with exciting project-based opportunities from top companies, handling onboarding, feedback, conflict resolution, and payroll. Our mission is to empower professionals to focus on their work by managing administrative tasks,...
-
Senior Data Engineer
6 days ago
Gurgaon, India Mrikal Full timeWe are looking for a talented Data Engineer to join our team and play a pivotal role in designing, building, and maintaining the cloud-based data infrastructure for our clients. In this role, you will collaborate closely with data architects, analysts, and cross-functional teams to develop robust and scalable data pipelines, ensuring the seamless flow of...
-
Data Engineer
2 months ago
Gurgaon, India Corning Full timeRequisition Number: 63042 Corning is vital to progress – in the industries we help shape and in the world we share. We invent life-changing technologies using materials science. Our scientific and manufacturing expertise, boundless curiosity, and commitment to purposeful invention place us at the center of the way the world interacts,...
-
Senior Data Engineer
4 days ago
Gurgaon, India NAB Full timeEssential Experience- 7+ years technical experience (within financial services industry preferred)- Technical Domain experience (Subject Matter Expertise in Technology or Tools) – particularly in core banking domain with ledger and product data models- Solid experience, knowledge and skills in Data Engineering, software development such as ELT/ETL, data...
-
Senior Data Engineer
1 week ago
gurgaon, India NAB Full timeEssential Experience7+ years technical experience (within financial services industry preferred)Technical Domain experience (Subject Matter Expertise in Technology or Tools) – particularly in core banking domain with ledger and product data modelsSolid experience, knowledge and skills in Data Engineering, software development such as ELT/ETL, data...
-
Data Engineer
2 months ago
Gurgaon, India BayOne Solutions Full timeWork from office - 3 days/WeekLocation:Bangalore/GurgaonJob Description:Min 5 years of experience in modern data engineering/data warehousing/data lakes technologies on cloud platforms like Azure, AWS, GCP, Data Bricks etc.Azure experience is preferred over other cloud platforms.5 years of proven experience with SQL, schema design and dimensional data...
-
Senior Data Engineer
1 week ago
gurgaon, India True Tech Professionals Full timeJob Title: Senior Data EngineerLocation: Gurgaon (Hybrid)Experience Required: 6 to 9 yearsJob Summary:We are seeking a highly skilled Senior Data Engineer with expertise in PySpark, Python, ETL processes, and data pipeline development. The ideal candidate will have a strong background in Snowflake and hands-on experience working with AWS cloud. You will be...