Data Pipeline Specialist

2 weeks ago

palakkad, India beBeePipeline Full time

Job Role:We are seeking a skilled Data Pipeline Specialist to enhance our technical capabilities. The ideal candidate will possess hands-on experience in ETL/Data Pipeline Testing, API Testing, and data flows.Main Responsibilities:Conduct comprehensive testing of ETL pipelines across cloud/on-prem environments.Validate source-to-target mappings, complex data transformations, and SCD logic.Perform data completeness, data accuracy, and reconciliation testing.Test Informatica IDMC/IICS CDI mappings, taskflows, and ingestion patterns.Create test scenarios using mapping documents, BRDs, and ETL workflows.API Testing:Test REST/SOAP APIs using Postman, Swagger, or SoapUI.Validate request/response payloads, authentication flows, error handling, and negative scenarios.Data Quality Assurance (DQA) & Process:Develop test plans, test cases, test data, and maintain QA documentation.Perform functional, integration, regression, and data validation testing.Log defects, track them to closure, and participate in defect triage with the dev team.Provide QA sign-offs and ensure quality of deliverables.Qualifications:Strong understanding of data flows and familiarity with Informatica tools such as IDMC/IICS, CDI, and MDM SaaS.Familiarity with data transformation, data cleansing, and DQ rules.Excellent problem-solving skills and ability to work independently.Good communication and collaboration skills.

  • Quality Assurance Specialist for Data Pipelining

    2 weeks ago

    palakkad, India beBeeDataPipelining Full time

    Job Title: Quality Assurance Specialist for Data PipeliningA quality assurance specialist is needed to perform end-to-end testing of data pipelines across cloud and on-prem environments.Responsibilities:Perform thorough testing of data pipeline transformations, including source-to-target mappings and complex data logic.Validate data completeness, accuracy,...

  • Expert Data Pipeline Specialist

    3 days ago

    palakkad, India beBeeDataSupportEngineer Full time

    Role DescriptionWe are seeking a skilled Data Support Engineer to serve as the escalation point for data ingestion, pipeline, and consumption issues.This role requires a professional with 8+ years of experience in SQL, Python, ETL/ELT pipelines, and cloud technologies such as Azure, Databricks, PySpark, ADF, ADLS, Azure Workbooks, KQL, and Grafana. The ideal...

  • Data Pipeline Architect

    2 weeks ago

    palakkad, India beBeePlatformEngineer Full time

    As a Platform Engineer, you will play a pivotal role in the development and support of our data pipeline and platform services.This position offers an exciting opportunity to utilize your skills in Python, Apache Spark, and Databricks to design and develop scalable solutions.Data Pipeline Design and Development: Utilize Python, Apache Spark, and Databricks...

  • Data Pipeline Architect

    2 weeks ago

    palakkad, India beBeeEngineering Full time

    About the RoleThe Palantir Foundry Engineer is responsible for designing, building, and maintaining scalable data pipelines within the Palantir ecosystem.

  • Data Infrastructure Specialist

    5 days ago

    palakkad, India beBeeData Full time

    Data Infrastructure SpecialistWe are seeking a highly skilled data infrastructure specialist to design, build, and optimize scalable data pipelines using Databricks and GCP.Main Responsibilities:Develop and maintain ETL pipelines utilizing PySpark and DatabricksManage and optimize Delta Lake architectures for improved data managementIntegrate data from...

  • Senior Data Pipeline Architect

    3 days ago

    palakkad, India beBeeDataEngineer Full time

    Job OpportunityWe are seeking skilled professionals to join our data engineering teams.This role is ideal for experienced engineers who can design, build, and maintain scalable data pipelines using modern tools and frameworks.Data Ingestion: Develop ETL/ELT workflows for structured, semi-structured, and unstructured data sources.Data Processing: Implement...

  • Data Engineering Specialist

    2 weeks ago

    palakkad, India beBeeDataEngineering Full time

    **Job Title:** Data Engineering Specialist**Job Summary:This role involves the development of a robust data pipeline leveraging an off-the-shelf machine learning model. The consultant will be responsible for designing and implementing a batch processing pipeline in a cloud-based environment (AWS), integrating image processing workflows and ML model...

  • Building Scalable Data Pipelines

    2 weeks ago

    palakkad, India beBeeDataEngineer Full time

    **Data Architect Role**Job Overview:We are seeking a skilled Data Engineer to design and build scalable data pipelines, ensure efficient data integration, and enable advanced analytics and reporting across the organization.Key Responsibilities:Design, develop, and optimize ETL/ELT pipelines using Python, PySpark, and AWS Glue.Implement data ingestion,...

  • Ai engineer

    2 weeks ago

    Palakkad, India BeGig Full time

    Job Role- AI Engineer (Data Pipelines & RAG) Job Type- Full-time Work Mode- Remote(6 days working) We are looking for a hands-on AI/Data Engineer (4–7 years) to build and scale data pipelines powering Gen AI and agentic applications. You’ll architect data models, build ETL/ELT workflows, and integrate pipelines with RAG-based systems in a fast-paced...

  • Data Innovation Specialist

    5 days ago

    palakkad, India beBeeDataInnovation Full time

    Lead Data Innovation SpecialistWe are seeking a highly skilled Lead Data Innovation Specialist to spearhead our cutting-edge data science initiatives. In this role, you will drive the development of advanced generative AI, large language models, and agentic systems, transforming complex business challenges into impactful AI solutions.Key...