Data Pipeline Specialist

7 days ago

Salem, Tamil Nadu, India beBeeElasticsearch Full time ₹ 15,00,000 - ₹ 22,50,000

System Administrator - Elasticsearch Specialist

">

We are seeking an experienced System Administrator to specialize in Elasticsearch. This key member of our infrastructure team will be responsible for ensuring the reliability and performance of our Elasticsearch cluster.

Responsibilities include:

  • Evaluating the performance of our Elasticsearch cluster to identify potential problems and plan changes for high-load events
  • Applying security fixes, testing, and performing incremental upgrades
  • Extending and improving our monitoring and alert infrastructure

The successful candidate will also have opportunities to work with various types of infrastructure and operations teams and build partnerships across the organization.

To succeed in this role, you will need to have:

  • Expertise in administration and management of Elasticsearch clusters
  • Strong knowledge in provisioning and configuration management tools like Puppet, Ansible, Rundeck, etc.
  • Experience in building automations and infrastructure as code using Terraform, Packer, or CloudFormation templates
  • Experience with monitoring and logging tools like Splunk, Prometheus, PagerDuty, etc.
  • Experience with scripting languages like Python, Bash, Go, Ruby, Perl, etc.
  • Experience with CI/CD tools like Jenkins, Pipelines, Artifactory, etc.

A Bachelor's degree in computer science, information technology, engineering, or a related discipline is required.

Benefits of this Role:

This is a unique opportunity to work with a variety of infrastructure and operations teams, and build long-lasting partnerships across the organization.

What We Offer:

Competitive salary, comprehensive benefits package, and opportunities for growth and professional development.

Key Skills and Qualifications:

  • Expertise in Elasticsearch administration and management
  • Strong knowledge in provisioning and configuration management tools
  • Experience in building automations and infrastructure as code
  • Experience with monitoring and logging tools
  • Experience with scripting languages and CI/CD tools
  • Bachelor's degree in computer science, information technology, engineering, or a related discipline

  • Data Pipeline Specialist

    1 week ago

    Salem, Tamil Nadu, India beBeeDataPipelineSpecialist Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Data Pipeline SpecialistThis role requires a highly skilled professional to design and develop data pipelines using Oracle Data Flow or Apache Spark (PySpark) with solid understanding of data patterns, Python, and SQL.The ideal candidate will have strong expertise in building and managing Data Lakes, Data Warehouses, and Data Pipelines. Proficient...

  • Data Pipeline Engineer

    2 weeks ago

    Salem, Tamil Nadu, India beBeeData Full time ₹ 80,00,000 - ₹ 1,50,00,000

    Job Title: Technical SpecialistThis is a challenging and exciting role that offers the opportunity to work on designing, implementing, and managing data pipelines using Azure Data Factory. You will implement scalable data processing solutions within Azure Synapse Analytics, and have the chance to work with data modeling, ETL processes, and query...

  • Data Pipeline Specialist

    5 days ago

    Salem, Tamil Nadu, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job OverviewWe are seeking an experienced professional to assume a pivotal role in developing data pipelines using IBM StreamSets. This remote position requires a strong understanding of data integrations and hybrid cloud environments.Key ResponsibilitiesDeveloping StreamSets pipelines to facilitate seamless data integration.Designing and implementing data...

  • Senior Data Pipeline Engineer

    2 weeks ago

    Salem, Tamil Nadu, India beBeeIngestion Full time US$ 1,00,000 - US$ 1,50,000

    Job DescriptionWe are seeking a Data Ingestion Specialist with expertise in continuous integration and deployment (CI/CD) and container orchestration to design, develop, and optimize data ingestion pipelines for integrating multiple sources into Databricks.The ideal candidate will have hands-on experience with data pipelines, automation, and infrastructure...

  • Big Data Pipeline Specialist

    1 week ago

    Salem, Tamil Nadu, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    GCP Data Engineering ExpertThe ideal candidate will possess in-depth knowledge of data engineering principles and practices, specifically within the Google Cloud Platform (GCP) ecosystem. They will be responsible for designing, building, and maintaining large-scale data pipelines that cater to various business requirements.The GCP Data Engineer will work...

  • Data Pipeline Specialist

    1 week ago

    Salem, Tamil Nadu, India beBeeData Full time ₹ 8,00,000 - ₹ 12,00,000

    \Exciting Career Opportunity as a Trainee Engineer: Build Your Future with Data Pipelines and Automation\About the Job:\\We are seeking a highly motivated and detail-oriented Trainee Engineer to join our team in building data pipelines and automation scripts.\As a Trainee Engineer, you will assist in implementing analytical algorithms under guidance and help...

  • Senior Data Pipeline Specialist

    1 week ago

    Salem, Tamil Nadu, India beBeeDataEngineer Full time ₹ 90,00,000 - ₹ 1,50,00,000

    Data Engineering is a vital role that involves designing, building and maintaining production-level data pipelines to handle structured and unstructured data. We are seeking a skilled Data Engineer to join our team.The ideal candidate has 1–2 years of experience in data engineering and possesses strong knowledge of AWS cloud services and big data best...

  • Lead Data Pipeline Specialist

    1 week ago

    Salem, Tamil Nadu, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,10,000

    The Fabric Data & Analytics Platform is a cutting-edge solution for data integration, development, and support.This role involves building and managing ETL pipelines (Azure Data Factory, Fabric toolbox) using expertise in data modelling, SQL, and ETL Pipelines to deliver high-quality datasets across business areas.A key aspect of this position will be the...

  • Senior Pipeline Specialist

    2 weeks ago

    Salem, Tamil Nadu, India beBeePipeline Full time ₹ 80,00,000 - ₹ 1,40,00,000

    Senior Pipeline SpecialistWe are seeking a skilled Senior Pipeline Specialist to join our team and oversee the management of our end-to-end release process.This role involves designing, implementing, and managing DevOps pipelines to streamline software development and deployment.You will work closely with developers and admins to ensure smooth release...

  • Senior Financial Data Pipeline Specialist

    3 days ago

    Salem, Tamil Nadu, India beBeeData Full time ₹ 60,00,000 - ₹ 1,20,00,000

    We're seeking an experienced Data Engineer to design and build robust data pipelines handling high-volume financial data from various sources.Main Responsibilities:Develop and manage end-to-end data pipelines for stocks, cryptocurrencies, and other financial datasets ensuring scalability and real-time availability.Integrate third-party APIs and data feeds...