Data Engineering

5 days ago


Halol India TESTQ Technologies Full time

Job Description Location Halol, Gujarat Experience: 5+ yrs Role Name: Data Engineering & Schema Steward (Metadata Owner) Role Summary This role will serve dual responsibilities: 1. Schema Steward (Metadata Owner) to maintain authoritative metadata standards, IDs, naming conventions, and data definitions across the Data Lake. 2. Data Engineer to build, validate, and maintain extraction and file-drop pipelines from systems such as TDMS and PDM, ensuring high-quality, structured, and consistent data ingestion. The role ensures metadata consistency, technical feasibility, and smooth execution of integration activities across all phases. Key Responsibilities 1. Metadata Ownership (Schema Steward) Own and continuously update the Metadata Dictionary for all R&D domains. Define and standardize unique identifiers such as Variant_ID, Compound_ID, DOE_ID, Test_ID, etc. Maintain naming conventions, versioning rules, and schema evolution practices. Validate sample metadata records to ensure adherence to standards. Ensure metadata consistency across all tools, systems, dashboards, and analytical use cases. Collaborate with IT Architect and functional SMEs to maintain a robust metadata governance framework. 2. Data Engineering Responsibilities Support R&D tools data extraction, cleansing, normalization, and ingestion processes. Design and assist with structured file-drop or automated ingestion pipelines for Data Lake loading. Perform feasibility validation for Phase-2 integration candidates, assessing data availability, structure, volume, and integration complexity. Conduct data discovery and profiling to understand source system nuances. Collaborate with the Architect to ensure data models comply with designed contracts and metadata rules. Implement pipeline monitoring, error handling, and data quality checks. Required Skills & Qualifications Bachelor's degree in Computer Science, Information Systems, Engineering, or related field. 58 years of experience in data engineering, metadata governance, or related roles. Strong expertise in ETL/ELT tools, file-based integrations, and data transformation logic. Prior experience R&D data or laboratory/engineering data sources is a strong plus. Understanding of metadata frameworks, data dictionaries, and data governance processes. Ability to work across cross-functional teams and ensure strict adherence to data standards.



  • Halol, India XFactor Talent Full time

    Position Title Data Engineer Department R&D Grade/Level/Experience 5+ years of experience in this profile Reporting To Head of R&D/ Senior Manager Digital & Analytics Role Summary This role will serve dual responsibilities: 1. Schema Steward (Metadata Owner) to maintain authoritative metadata standards, IDs, naming conventions, and data definitions across...


  • Halol, India XFactor Talent Full time

    Position Title Data Engineer Department R&D Grade/Level/Experience 5+ years of experience in this profile Reporting To Head of R&D/ Senior Manager Digital & Analytics Role Summary This role will serve dual responsibilities: 1. Schema Steward (Metadata Owner) to maintain authoritative metadata standards, IDs, naming conventions, and data definitions across...


  • Halol, India XFactor Talent Full time

    Position Title Data EngineerDepartment R&DGrade/Level/Experience 5+ years of experience in this profileReporting To Head of R&D/ Senior Manager Digital & AnalyticsRole SummaryThis role will serve dual responsibilities:1. Schema Steward (Metadata Owner) to maintain authoritative metadata standards,IDs, naming conventions, and data definitions across the Data...


  • Halol, India XFactor Talent Full time

    Position Title Data EngineerDepartment R&DGrade/Level/Experience 5+ years of experience in this profileReporting To Head of R&D/ Senior Manager Digital & AnalyticsRole SummaryThis role will serve dual responsibilities:1. Schema Steward (Metadata Owner) to maintain authoritative metadata standards,IDs, naming conventions, and data definitions across the Data...


  • Halol, India XFactor Talent Full time

    Position Title Data EngineerDepartment R&DGrade/Level/Experience 5+ years of experience in this profileReporting To Head of R&D/ Senior Manager Digital & AnalyticsRole SummaryThis role will serve dual responsibilities:1. Schema Steward (Metadata Owner) to maintain authoritative metadata standards,IDs, naming conventions, and data definitions across the Data...


  • Halol, India XFactor Talent Full time

    Position Title Data EngineerDepartment R&DGrade/Level/Experience 5+ years of experience in this profileReporting To Head of R&D/ Senior Manager Digital & AnalyticsRole SummaryThis role will serve dual responsibilities:1. Schema Steward (Metadata Owner) to maintain authoritative metadata standards,IDs, naming conventions, and data definitions across the Data...

  • Data Engineer

    4 days ago


    India Crayon Data Full time

    Job DescriptionData Engineer – ChennaiBuild the foundation of data intelligence — design, develop, and optimize data pipelines that power AI-driven insights.Location: Chennai, IndiaExperience: 2–3 years in data engineering or data-driven product developmentRole OverviewAs a Data Engineer, you will be responsible for building and maintaining scalable...

  • Senior Test Engineer

    18 hours ago


    India, Airoli, Navi Mumbai, India , NA, Maharashtra Data Engineering Full time

    Looking for an enthusiastic and talented Elastic Search Engineer with 1-3 years of hands-on experience with Elasticsearch and is eager to work in a fast-paced environment, contributing to the management, optimization, and scaling of our Elasticsearch infrastructure.Key Responsibilities:- Elasticsearch Setup & Management: Install, configure, and manage...

  • Data Steward

    3 days ago


    Halol, India TESTQ Technologies Full time

    Location Halol, Gujarat Experience: 5+ yrs Role Name: Data Engineering & Schema Steward (Metadata Owner) Role Summary This role will serve dual responsibilities: 1. Schema Steward (Metadata Owner) to maintain authoritative metadata standards, IDs, naming conventions, and data definitions across the Data Lake. 2. Data Engineer to build, validate, and maintain...

  • Data Steward

    1 day ago


    halol, India TESTQ Technologies Full time

    Location Halol, GujaratExperience: 5+ yrsRole Name: Data Engineering & Schema Steward (Metadata Owner)Role SummaryThis role will serve dual responsibilities:1. Schema Steward (Metadata Owner) to maintain authoritative metadata standards, IDs, naming conventions, and data definitions across the Data Lake.2. Data Engineer to build, validate, and maintain...