Data Pipeline Specialist

3 days ago

Thrissur, Kerala, India beBeeElasticsearch Full time ₹ 1,20,00,000 - ₹ 1,50,00,000

About this position:

We are seeking a highly skilled professional to manage and maintain our Elasticsearch clusters.

  • This includes evaluating cluster performance, planning changes for high-load events, applying security fixes, testing and performing incremental upgrades, and extending and improving our monitoring and alert infrastructure.

Key responsibilities:

  • Maintain other parts of the data pipeline, including serverless or server-based systems for feeding data into the Elasticsearch pipeline.
  • Work with declarative tools like Puppet and various scripting mechanisms to automate as much as possible and aim for a 'build once/run everywhere' system.

Requirements:

  • Experience with administration and management of Elasticsearch clusters is essential.
  • Secondary expertise in administration and management of Splunk clusters is desired.
  • Strong knowledge in provisioning and configuration management tools like Puppet, Ansible, Rundeck, etc.
  • Experience with building automations and infrastructure as code using Terraform, Packer or CloudFormation templates.
  • Experience with monitoring and logging tools like Splunk, Prometheus, PagerDuty, etc.
  • Scripting languages like Python, Bash, Go, Ruby, Perl, etc.
  • CI/CD tools like Jenkins, Pipelines, Artifactory, etc.
  • An inquisitive mind with the ability to learn where the data exists in a large and disparate system and what that data means.
  • The skills to do effective troubleshooting, following a problem wherever it may lead.

A note on diversity and inclusion:

We are dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals and welcome diverse candidates from all backgrounds.

  • Data Pipeline Specialist

    3 days ago

    Thrissur, Kerala, India beBeeDataPipelineSpecialist Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: OCI Data Flow SpecialistOverview:We are seeking a skilled professional to design, develop and manage data pipelines using Oracle Data Flow or Apache Spark (PySpark), with a solid understanding of data patterns, Python, and SQL.Responsibilities:3–12 years of experience in building and managing Data Lakes, Data Warehouses, and Data...

  • Data Pipeline Architect

    10 hours ago

    Thrissur, Kerala, India beBeeETL Full time ₹ 15,00,000 - ₹ 25,00,000

    As a highly skilled ETL specialist, you will be responsible for designing and deploying efficient data pipelines that drive business growth.The ideal candidate will have hands-on experience with ETL development using Informatica and a strong understanding of data warehousing concepts. Additionally, proficiency in Python programming for data processing and...

  • Data Pipeline Specialist

    3 days ago

    Thrissur, Kerala, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    We are seeking a skilled data engineer to take on the challenge of designing, developing and maintaining scalable data pipelines. The successful candidate will ensure high-quality, reliable data for player behavior analysis, game performance and optimization.Key Responsibilities:Build, maintain and optimize data pipelines for large-scale slot game and player...

  • Data Pipeline Specialist

    1 day ago

    Thrissur, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Opportunity: Data EngineerWe are seeking a skilled professional to join our team as a Data Engineer.Key Responsibilities:Design, develop, and maintain scalable data pipelines using Azure Synapse, Databricks & Apache Spark (PySpark).Integrate data from various sources, ensuring data quality and consistency.Optimize data processing workflows for...

  • Data Pipeline Architect

    2 days ago

    Thrissur, Kerala, India beBeeData Full time ₹ 30,00,000 - ₹ 50,00,000

    Unlock the Power of Data EngineeringAs a Senior Data Engineer, you will play a vital role in building and maintaining scalable data pipelines that integrate healthcare data. This is a critical position where you will create high-performance pipelines that process clinical encounter data, retrieve associated medical documents, and deliver validated...

  • Advanced Data Pipeline Specialist

    1 day ago

    Thrissur, Kerala, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Data Engineer PositionOur organization is seeking an experienced and skilled Data Engineer to play a pivotal role in our team.The ideal candidate will have a solid background in data engineering, focusing on PySpark, Python, and SQL. Familiarity with Azure Databricks is beneficial.Main Responsibilities:Create, develop, and maintain scalable data pipelines...

  • Senior Data Architect

    3 days ago

    Thrissur, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Role – Data Engineer With FabricJob Location – JaipurJob Type – PermanentExperience Required: 2-4 YearsWe are seeking a skilled Data Engineer to join our team. As a key member of the team, you will play a critical role in designing, developing, and maintaining our data pipelines and infrastructure.Main Responsibilities:Data Pipeline Development:...

  • Data Engineer

    2 days ago

    Thrissur, Kerala, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 30,00,000

    Job Title:Data Engineer - Pipeline Architect\About the Role:\We are seeking a highly skilled Data Engineer to design, implement and manage data pipelines. Key responsibilities include building CI/CD pipelines using GitHub Actions or equivalent tools, configuring and maintaining branch protection rules and workflows, automating Databricks deployments using...

  • Data Validation Specialist

    3 days ago

    Thrissur, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 30,00,000

    Data Validation SpecialistJob Title: Data Validation SpecialistJob SummaryThe role of the Data Validation Specialist will be to support a critical data migration initiative, testing the transition from a legacy application to a modernized platform. The specialist will be responsible for ensuring data integrity and dashboard accuracy throughout the...

  • Expert Data Pipeline Architect

    6 days ago

    Thrissur, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Freelance Data EngineerWe are seeking a Freelance Data Engineer with expertise in designing, building, and optimizing large-scale data pipelines using Python, SQL, Linux/Bash, PySpark, AWS, and Databricks.Job Description:Data Engineering is a key component of our organization's ability to drive business outcomes through data-driven decision making. We are...