Senior Data Pipeline Specialist

1 day ago

Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 1,00,00,000 - ₹ 1,40,00,000
Job Description

As a seasoned professional with 7-14 years of experience, you will have the opportunity to manage and maintain critical data pipeline platforms that collect, transform, and transmit cyber events data to downstream platforms such as ElasticSearch and Splunk.

Key responsibilities include collaborating with Cyber teams to identify, onboard, and integrate new data sources into the platform, designing and implementing data mapping, transformation, and routing processes to meet analytics and monitoring requirements, developing automation tools that integrate with in-house developed configuration management frameworks and APIs, monitoring the health and performance of the data pipeline infrastructure, working as a top-level escalation point to perform complex troubleshoots, working with other infrastructure teams to resolve issues, creating and maintaining detailed documentation for pipeline architecture, processes, and integrations.

Required Skills and Qualifications
  • Hands-on experience deploying and managing large-scale dataflow products like Cribl, Logstash or Apache NiFi.
  • Hands-on experience integrating data pipelines with cloud platforms (e.g., AWS, Azure, Google Cloud) and on-premises systems.
  • Hands-on experience in developing and validating field extraction using regular expressions.
  • A solid understanding of Operating Systems and Networking concepts: Linux/Unix system administration, HTTP and encryption.
  • Good understanding of software version control, deployment & build tools using DevOps SDLC practices (Git, Jenkins, Jira).
  • Strong analytical and troubleshooting skills.
  • Excellent verbal & written communication skills.
  • Appreciation of Agile methodologies, specifically Kanban.
,

  • Data Pipeline Engineer

    1 day ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    The Role of Senior Data Integration SpecialistJob Overview:We are seeking an experienced Senior Data Integration Specialist to join our team. This is a key position that will play a vital role in the smooth operation of our enterprise data integration platform.As a Senior Data Integration Specialist, you will be responsible for designing, implementing, and...

  • Senior Data Pipeline Specialist

    6 days ago

    Bengaluru, Karnataka, India beBeeAutomatedTesting Full time

    Job Opportunity:The role of Senior Consultant involves designing, developing and implementing automated test cases for complex data pipelines.Ability to design, develop, and implement automated test cases for complex data pipelines is a mustAWS experience is essentialPharma expertise is also requiredProficiency in programming languages such as Python, R, or...

  • Data Pipeline Specialist

    1 day ago

    Bengaluru, Karnataka, India beBeeDataPipeline Full time US$ 1,00,000 - US$ 1,50,000

    Job Overview- We are seeking a highly skilled Data Pipeline Specialist to join our team. The ideal candidate will have experience building and productionizing data pipelines using industry-leading technologies.- A strong background in working with complex SQL datasets is required, as well as expertise in building efficient SQL scripts using BigQuery Syntax-...

  • Senior Data Solutions Specialist

    21 hours ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 1,20,00,000 - ₹ 1,80,00,000

    Senior Data Solutions SpecialistWe are seeking a highly skilled data solutions specialist to design and implement cutting-edge data pipelines and workflows.

  • Data Pipeline Specialist

    5 days ago

    Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 9,00,000 - ₹ 12,00,000

    Job TitleSenior Data EngineerJob DescriptionAs a Senior Data Engineer, you will design, implement, and optimize data pipelines for large-scale data processing. You will work with data scientists, analysts, and engineers to ensure data availability and quality.Key responsibilities include developing and maintaining ETL/ELT workflows using Spark, Hadoop, Hive,...

  • Principal Data Pipeline Architect

    2 days ago

    Bengaluru, Karnataka, India beBeeDataEngineer Full time US$ 1,25,000 - US$ 1,75,000

    About the RoleWe are seeking a Senior Data Engineer with expertise in building scalable data pipelines and integrating healthcare data. Reporting to the Head of AI and Engineering, you will design, build, and operate the backbone of our AI-powered applications.You will work closely with software engineers, ML specialists, and clinical partners to bring our...

  • Data Pipeline Architect

    10 hours ago

    Bengaluru, Karnataka, India beBeeAzure Full time ₹ 15,00,000 - ₹ 25,00,000

    Freelance Azure Data Factory SpecialistWe are seeking an experienced Freelance Azure Data Factory (ADF) Specialist to support our data integration and ETL needs.The ideal consultant will have strong hands-on expertise in Azure ADF pipelines, data orchestration, and transformations to ensure smooth, scalable, and secure data flows across multiple sources and...

  • Lead Data Pipeline Specialist

    2 days ago

    Bengaluru, Karnataka, India beBeeDataEngineer Full time US$ 1,04,000 - US$ 1,30,878

    Job Title: Senior Data EngineerAbout the Role:This is an exceptional opportunity to join our organization as a Senior Data Engineer. As a key member of our data team, you will be responsible for designing, building, and optimizing scalable data pipelines using cloud-native technologies.Key Responsibilities:Design and architect high-throughput ETL pipelines...

  • Senior Data Integration Specialist

    10 hours ago

    Bengaluru, Karnataka, India beBeeDataIntegration Full time ₹ 22,49,600 - ₹ 28,11,200

    Job DescriptionAs a senior data integration specialist, you will be responsible for designing and developing end-to-end data pipelines, optimizing workflows, and collaborating with cross-functional teams to deliver scalable and high-performing solutions.

  • Senior Data Pipeline Developer

    21 hours ago

    Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 30,00,000

    Data Engineering SpecialistWe are seeking a highly skilled Data Engineer to join our organization. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining scalable data pipelines to support our growing business needs.You will collaborate with analytics and business teams to improve data models that...