Data Validation Engineer

4 weeks ago

Delhi, Delhi, India VSHR UNNATI LLP Full time

About the Role

We are looking for a detail-oriented Data Validation Engineer to ensure the accuracy, quality, and consistency of data across our platforms. The ideal candidate will be proficient in PySpark and have strong experience working with Databricks to build automated validation frameworks that verify ingestion, transformation, and reporting pipelines.

You will work closely with Data Engineers, Data Scientists, and business stakeholders to design validation rules, troubleshoot data issues, and ensure reliable delivery of high-quality data.


Key Responsibilities :

- Develop and maintain automated data validation pipelines using PySpark on Databricks.

- Validate data ingestion, transformation, and aggregation processes across multiple data sources.

- Identify, document, and resolve data quality issues in collaboration with engineering and analytics teams.

- Create reusable validation frameworks to check data accuracy, completeness, timeliness, and consistency.

- Write and optimize PySpark queries for large-scale validation in Databricks notebooks.

- Perform root cause analysis for data discrepancies and ensure corrective actions are implemented.

- Work with business stakeholders to define validation rules and acceptance criteria.

- Contribute to continuous improvement of data quality, governance, and monitoring & Skills :- 36 years of experience in Data Engineering, Data Validation, or Data Quality roles.

- Strong expertise in PySpark, Python, and SQL, with hands-on Databricks experience.

- Experience building validation frameworks on Databricks and Spark-based platforms.

- Familiarity with ETL/ELT processes, data pipelines, and data warehousing concepts.

- Exposure to cloud data ecosystems (Azure, AWS, or GCP) with Databricks integration.

- Knowledge of data governance, monitoring, and quality frameworks.

- Strong analytical and troubleshooting skills with attention to detail.

- Excellent communication and collaboration We Offer :- Opportunity to work on large-scale data validation projects using Databricks & PySpark.

- 100% Remote Opportunity

- Exposure to modern big data platforms and cloud data ecosystems.

- Collaborative, innovation-driven, and growth-oriented culture.

- Competitive compensation and career advancement opportunities. (ref:hirist.tech)

  • Testing and validation engineer

    2 weeks ago

    Delhi, Delhi, India UTL Solar Full time ₹ 2,50,000 - ₹ 3,00,000 per year

    Required testing and validation engineer-3 Nos, 2-3 years exp in inverter, ups and power electronics testing and validation, b.tech in electronicsJob Types: Full-time, PermanentPay: ₹22, ₹25,000.00 per monthBenefits:Cell phone reimbursementCommuter assistanceFood providedHealth insuranceInternet reimbursementLeave encashmentLife insuranceExperience:total...

  • Senior Data Engineer

    4 weeks ago

    Delhi, Delhi, India Aptus Data Labs Full time

    Job Title : Senior Data EngineerLocation : : 58 YearsEmployment Type : Full-TimeAbout the Role :Aptus Data Labs is looking for a talented and proactive Senior Data Engineer to help build the backbone of our enterprise data and AI initiatives. Youll work on modern data lake architectures and high-performance pipelines in AWS, enabling real-time insights and...

  • SQL Data Engineer

    4 weeks ago

    Delhi, Delhi, India ATOM Systems Pvt Ltd Full time

    Job Summary : We are seeking a Data Engineer with expertise in SQL, Data Modeling, AWS Glue, Python, and MS Excel.The ideal candidate will design scalable data solutions, build reliable pipelines, and ensure high-quality, well-modeled data to drive business insights.Key Responsibilities : - Design and maintain robust data models to support analytics and...

  • Data Engineer

    3 weeks ago

    Delhi, Delhi, India Provido Solutions Full time

    Exp : 8 - 10+ yearsSkillset :- Design and implement robust, production-grade pipelines using Python, Spark SQL, and Airflow to process high-volume file-based datasets (CSV, Parquet, JSON).- Own the full lifecycle of core pipelines - from file ingestion to validated, queryable datasets - ensuring high reliability and performance.- Build resilient, idempotent...

  • Data Engineer

    2 weeks ago

    Delhi, Delhi, India ISITCA PRIVATE LIMITED Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    About the Role: We are looking for a hands-on Data Engineer to join our team and take full ownership of scraping pipelines and data quality. You'll be working on data from 60+ websites involving PDFs, processed via OCR and stored in MySQL/PostgreSQL. You'll build robust, self-healing pipelines and fix common data issues (missing fields, duplication,...

  • Data Engineer

    4 weeks ago

    Delhi, Delhi, India Ascendeum Full time

    Ascendeum is looking for veterans with extensive hands-on experience in the field of data engineering to build cutting-edge solutions for large-scale data extraction, processing, storage, and retrieval.About Us : We provide AdTech strategy consulting to leading Internet websites and apps globally hosting over 200 million monthly worldwide audiences.Since...

  • Senior Data Engineer

    4 weeks ago

    Delhi, Delhi, India Vikash Technologies Full time

    Senior Data EngineerSenior Data Engineer with strong expertise in SQL, Python, Azure Synapse, Azure Data Factory, Snowflake, and Databricks. The ideal candidate should have a solid understanding of SQL (DDL, DML, query optimization) and ETL pipelines while demonstrating a learning mindset to adapt to evolving Responsibilities : - Design and implement...

  • Data Engineer

    4 weeks ago

    Delhi, Delhi, India Bullet Full time

    Job Description: Data Engineer (Mid–Senior Level)Location: Delhi NCR (On-Site) Team: Tech & Product Type: Full-time Compensation: ₹20 – 35 LPA (Market Standard, Based on Experience & Skills)Application Link https://forms.zohopublic.in/Bullet Shorts/form/Job Application/formperma/Ajn_C7 Hj MVa9 Lk JZ0np1ybq Yxr Bfmh SBNz5q2 L7 MD7g About Bullet Bullet...

  • Data Engineer

    4 weeks ago

    Delhi, Delhi, India Bullet Full time

    Job Description: Data Engineer (Mid–Senior Level) Location: Delhi NCR (On-Site) Team: Tech & Product Type: Full-time Compensation: ₹20 – 35 LPA (Market Standard, Based on Experience & Skills) Experience - 5- 8 Years Application Link About Bullet Bullet is India's first microdrama OTT app backed by Z. We create bingeable 90-second vertical...

  • Full Stack Data Engineer

    3 weeks ago

    Delhi, Delhi, India iTroSys Full time

    Job Summary :We are seeking a highly skilled Full Stack Data Engineer to design, develop, and manage scalable data pipelines, storage, and transformation solutions.The role requires deep expertise in cloud-based data platforms, data warehousing, data lakehouse design, workflow automation, and data integration to support business intelligence and advanced...