Current jobs related to Senior Pipeline Engineer - Hubli, Karnataka - beBeeData


  • Hubli, Karnataka, India beBeeBackend Full time ₹ 80,00,000 - ₹ 1,20,00,000

    About the RoleWe are seeking a seasoned backend engineer to spearhead the development of event decoders for major DeFi protocols, including Uniswap, Curve, and Balancer. This position requires expertise in Go or Rust programming languages.The ideal candidate will play a key role in transforming raw on-chain data into actionable insights by decoding smart...


  • Hubli, Karnataka, India beBeeDataPipeline Full time ₹ 90,00,000 - ₹ 1,20,00,000

    Greetings from our organizationWe are seeking a highly skilled Data Pipeline Developer to join our team.Job OverviewKey Responsibilities:1. Design, develop, and implement data pipelines using IBM Datastage.2. Collaborate with cross-functional teams to understand business requirements and develop solutions.3. Ensure high-quality deliverables and adhere to...

  • Senior AI Engineer

    2 weeks ago


    Hubli, Karnataka, India beBeeResearch Full time US$ 20,000 - US$ 40,000

    Job Title:AI Research Engineer - Platform Development Job Description:We are seeking an experienced AI engineer to lead the development of our core intelligence platform. This is a hands-on role with real ownership and significant responsibility.As a key member of our team, you will be responsible for designing, implementing, and productionizing vector...


  • Hubli, Karnataka, India beBeeCloudEngineer Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    Senior Data Engineer - Cloud InfrastructureWe are seeking a seasoned Senior Data Engineer to lead our cloud infrastructure initiatives on AWS. As a key member of our team, you will be responsible for designing, developing, and deploying end-to-end data pipelines using AWS services.This is an exceptional opportunity to leverage your technical expertise in...


  • Hubli, Karnataka, India beBeeDataEngineer Full time ₹ 8,00,000 - ₹ 15,00,000

    We are seeking a highly skilled Data Engineer to help build and maintain our robust data infrastructure. This individual will design, develop and maintain scalable data pipelines ensuring high-quality, reliable data for player behavior analysis, game performance and optimization.Responsibilities:Develop, maintain and optimize large-scale data pipelines for...


  • Hubli, Karnataka, India Deltacubes Full time

    Job description:• Develop, construct, test and maintain data acquisition pipelines for large volumes of structed and unstructured data. This includes batch and real-time processing (in google cloud)• Build large and complex datasets based on business requirements• Construct 'big data' pipeline architecture• Identify opportunities for data acquisition...


  • Hubli, Karnataka, India Rayole Software Full time

    ???? We're Hiring: Senior Backend Engineer ????Location: RemoteEmployment Type: Full-TimeExperience Level: SeniorAre you an experienced Backend Engineer with a passion for building scalable, high-performance applications? We're looking for a highly skilled Senior Backend Engineer with extensive expertise in Python, Django, Next.js, Node.js, React, and web...


  • Hubli, Karnataka, India beBeeLinux Full time ₹ 18,00,000 - ₹ 21,50,000

    Job Description:We are seeking a highly skilled Senior Linux Infrastructure Automation Engineer to lead the design and implementation of a Zero-Touch Build, Upgrade, and Certification pipeline for our on-prem GPU cloud infrastructure.The ideal candidate will have extensive experience in Linux systems automation, image management, and compliance hardening,...


  • Hubli, Karnataka, India beBeeCloudNativeEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Overview">We are seeking a skilled senior-level engineer to lead our DevSecOps team.">Job Description:">The ideal candidate will have at least 6-7 years of experience in DevSecOps, DevOps or a related role with exposure to cloud environments.">Key responsibilities include designing and implementing secure cloud-native platforms, developing and maintaining...

  • Senior Data Engineer

    2 weeks ago


    Hubli, Karnataka, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Senior Data Engineer">Overview:">We are seeking a highly skilled and experienced data engineer to design and implement scalable IoT data solutions utilizing AWS services.">Key Responsibilities:">">Design, develop, and deploy large-scale IoT data pipelines using AWS services.">Write efficient, reusable, and maintainable Python code for data...

Senior Pipeline Engineer

3 weeks ago


Hubli, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

ThreatXIntel is a startup dedicated to protecting businesses and organizations from cyber threats. Our proactive approach involves continuously monitoring and testing digital environments to identify vulnerabilities.

Job Description

As a data engineer, you will be responsible for designing, building, and maintaining scalable data pipelines using Azure Data Factory. This involves integrating data from multiple sources, including on-premise, cloud, structured, and unstructured data, and optimizing pipelines for performance, scalability, and cost efficiency.

Key Responsibilities:
  • Design, build, and maintain scalable data pipelines using Azure Data Factory.
  • Integrate data from multiple sources, including on-premise, cloud, structured, and unstructured data.
  • Optimize pipelines for performance, scalability, and cost efficiency.
  • Implement data transformations, mapping, and workflow orchestration in Azure.
  • Configure triggers, parameters, and dynamic pipelines in ADF.
  • Collaborate with data engineers, analysts, and business stakeholders to meet data requirements.
  • Ensure security, compliance, and monitoring of pipelines using Azure best practices.
Required Skills and Qualifications
  • Proven hands-on experience with Azure Data Factory (ADF).
  • Strong knowledge of ETL/ELT processes, data integration, and pipeline design.
  • Familiarity with Azure services such as Data Lake, Synapse Analytics, SQL Database, and Key Vault.
  • Experience in parameterization, linked services, datasets, and integration runtimes.

Preferred Skills include experience with Azure DevOps, Azure Monitor / Log Analytics, and JSON-based ADF configurations.