Expert Data Pipeline Specialist

3 days ago

palakkad, India beBeeDataSupportEngineer Full time

Role DescriptionWe are seeking a skilled Data Support Engineer to serve as the escalation point for data ingestion, pipeline, and consumption issues.This role requires a professional with 8+ years of experience in SQL, Python, ETL/ELT pipelines, and cloud technologies such as Azure, Databricks, PySpark, ADF, ADLS, Azure Workbooks, KQL, and Grafana. The ideal candidate will have expertise in troubleshooting complex technical problems and prioritizing multiple support requests.Key Responsibilities:Escalation Point: Serve as the primary contact for data ingestion, pipeline, and consumption issues.Monitoring: Proactively monitor data pipeline health to ensure stability and uptime.Root Cause Analysis: Perform root cause analysis on recurring issues to identify and document long-term fixes.Data Quality: Support data quality checks, identify issues, and recommend corrective actions.Technical Skills: Strong SQL and Python skills for troubleshooting, knowledge of data pipeline concepts (ETL/ELT), and experience with cloud platforms like Azure, Databricks, Pyspark, Azure Data Factory, ADLS, Azure workbooks, KQL, Grafana.Problem Solving: Ability to troubleshoot complex technical problems and prioritize multiple support requests.Communication: Strong communication skills to interact with both business and technical teams.Tools: Experience with ticketing systems (e.g., ServiceNow, JIRA).

  • Data Pipeline Specialist

    2 weeks ago

    palakkad, India beBeePipeline Full time

    Job Role:We are seeking a skilled Data Pipeline Specialist to enhance our technical capabilities. The ideal candidate will possess hands-on experience in ETL/Data Pipeline Testing, API Testing, and data flows.Main Responsibilities:Conduct comprehensive testing of ETL pipelines across cloud/on-prem environments.Validate source-to-target mappings, complex data...

  • Quality Assurance Specialist for Data Pipelining

    2 weeks ago

    palakkad, India beBeeDataPipelining Full time

    Job Title: Quality Assurance Specialist for Data PipeliningA quality assurance specialist is needed to perform end-to-end testing of data pipelines across cloud and on-prem environments.Responsibilities:Perform thorough testing of data pipeline transformations, including source-to-target mappings and complex data logic.Validate data completeness, accuracy,...

  • Data Pipeline Architect

    2 weeks ago

    palakkad, India beBeePlatformEngineer Full time

    As a Platform Engineer, you will play a pivotal role in the development and support of our data pipeline and platform services.This position offers an exciting opportunity to utilize your skills in Python, Apache Spark, and Databricks to design and develop scalable solutions.Data Pipeline Design and Development: Utilize Python, Apache Spark, and Databricks...

  • Expert Data Migration Specialist

    2 weeks ago

    palakkad, India beBeeDataMigration Full time

    Data Migration SpecialistJoin our team of experts to work on complex data integration projects. The role requires analyzing legacy mainframe data flows, documenting source-to-target mappings, and supporting the ETL/ELT migration to Snowflake.This position ensures accurate data lineage, transformation logic, and availability for Power BI consumption.Analyze...

  • Data Expert

    1 week ago

    palakkad, India beBeeAI Full time

    AI Model Development LeadWe are seeking a seasoned data expert to spearhead the development of cutting-edge AI models. The ideal candidate will have hands-on expertise in AI and machine learning technologies.Develop, deploy, and optimize AI models to drive business growth, enhance automation, and develop scalable applications.Design and implement AI...

  • Data Pipeline Architect

    2 weeks ago

    palakkad, India beBeeEngineering Full time

    About the RoleThe Palantir Foundry Engineer is responsible for designing, building, and maintaining scalable data pipelines within the Palantir ecosystem.

  • Mainframe Data Migration Expert

    7 days ago

    palakkad, India beBeeDataTransformation Full time

    Key ResponsibilitiesThe role of a Data Transformation Specialist involves analyzing and documenting data flows, transformation logic, and mappings between source and target systems. This encompasses the extraction of transformation logic from JCL jobs, COBOL programs, and batch workflows.Analyzing JCL jobs, COBOL programs, and batch workflows to extract...

  • Senior Data Pipeline Architect

    3 days ago

    palakkad, India beBeeDataEngineer Full time

    Job OpportunityWe are seeking skilled professionals to join our data engineering teams.This role is ideal for experienced engineers who can design, build, and maintain scalable data pipelines using modern tools and frameworks.Data Ingestion: Develop ETL/ELT workflows for structured, semi-structured, and unstructured data sources.Data Processing: Implement...

  • Data Infrastructure Specialist

    5 days ago

    palakkad, India beBeeData Full time

    Data Infrastructure SpecialistWe are seeking a highly skilled data infrastructure specialist to design, build, and optimize scalable data pipelines using Databricks and GCP.Main Responsibilities:Develop and maintain ETL pipelines utilizing PySpark and DatabricksManage and optimize Delta Lake architectures for improved data managementIntegrate data from...

  • Data Engineering Specialist

    2 weeks ago

    palakkad, India beBeeDataEngineering Full time

    **Job Title:** Data Engineering Specialist**Job Summary:This role involves the development of a robust data pipeline leveraging an off-the-shelf machine learning model. The consultant will be responsible for designing and implementing a batch processing pipeline in a cloud-based environment (AWS), integrating image processing workflows and ML model...