Data Pipeline Architect

4 days ago

Kozhikode, Kerala, India beBeeElasticsearch Full time ₹ 16,00,000 - ₹ 23,20,000

About Role:

We are seeking a seasoned Elasticsearch expert to join our team as an Administrator. In this role, you will be responsible for continually evaluating the performance of our Elasticsearch and Splunk clusters to identify potential issues, planning changes for upcoming high-load events, applying security patches, testing and performing incremental upgrades, and enhancing and improving our monitoring and alert infrastructure.

  • Key Responsibilities:
  • Evaluate the performance of Elasticsearch and Splunk clusters
  • Plan changes for upcoming high-load events
  • Apply security patches
  • Test and perform incremental upgrades
  • Enhance and improve monitoring and alert infrastructure

You will also be involved in maintaining other parts of the data pipeline, which may include serverless or server-based systems for feeding data into the Elasticsearch pipeline.

  • Maintenance of Data Pipeline:
  • Maintain serverless or server-based systems
  • Feed data into Elasticsearch pipeline

As a critical member of our team, you will have the opportunity to work with a variety of types of infrastructure and operations teams.

  • Collaboration and Partnership Building:
  • Work with various types of infrastructure and operations teams
  • Foster collaboration between Product, Engineering and Operations teams

Required Skills and Qualifications:

  • Bachelor's degree in computer science, information technology, engineering, or related discipline
  • Expertise in administration and management of Elasticsearch clusters
  • Strong knowledge in provisioning and configuration management tools like Puppet, Ansible, Rundeck
  • Experience in building automations and infrastructure as code using Terraform, Packer or CloudFormation templates
  • Experience with monitoring and logging tools like Splunk, Prometheus, PagerDuty
  • Experience with scripting languages like Python, Bash, Go, Ruby, Perl
  • Experience with CI/CD tools like Jenkins, Pipelines, Artifactory

Benefits:

  • Competitive salary and benefits package
  • Culture focused on talent development with quarterly promotion cycles and company-sponsored higher education and certifications
  • Opportunity to work with cutting-edge technologies
  • Employee engagement initiatives such as project parties, flexible work hours, and long service awards
  • Annual health check-ups
  • Insurance coverage: group term life, personal accident, and mediclaim hospitalization for self, spouse, two children, and parents

Work Environment:

We value diversity and inclusion in the workplace and invite applications from all qualified individuals.

  • Diversity and Inclusion:
  • Welcome diverse candidates from all backgrounds
  • Support hybrid work and flexible hours to fit diverse lifestyles

  • Data Pipeline Architect

    1 week ago

    Kozhikode, Kerala, India beBeeDataEngineering Full time ₹ 90,00,000 - ₹ 1,22,50,000

    Role Overview:">Job DescriptionWe are seeking an experienced Data Engineer to design and implement scalable data pipelines utilizing expertise in Palantir Foundry.Responsibilities will include developing efficient data processing solutions using PySpark and building robust data engineering tools with Typescript.The ideal candidate will have a minimum of 5-8...

  • Data Pipeline Architect

    7 days ago

    Kozhikode, Kerala, India beBeeCloud Full time ₹ 10,00,000 - ₹ 15,00,000

    Senior AWS Glue DeveloperAs a senior developer, you will be responsible for designing and implementing data ingestion and transformation pipelines using serverless and cloud-based services.The ideal candidate will have experience with the Extract-Load-Transform approach, metadata-driven integration design, and Data Build Tool to enable rapid onboarding of...

  • Senior Data Pipeline Architect

    4 days ago

    Kozhikode, Kerala, India beBeeETLDynamo Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    ETL Development OpportunityWe are seeking a skilled ETL Developer to join our team. The ideal candidate will have experience in designing and developing data pipelines using IBM DataStage, AWS Glue, and Snowflake.The chosen candidate will be responsible for designing, developing, and maintaining scalable and efficient ETL pipelines using various tools.They...

  • Chief Data Pipeline Architect

    6 days ago

    Kozhikode, Kerala, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Role Overview:We are seeking a highly skilled Data Engineer to develop and implement scalable data pipelines using cloud-based technologies. The ideal candidate will have expertise in cloud services such as GCP, AWS, or Azure, distributed stream processing technology, and strong programming skills.The successful candidate will be responsible for designing,...

  • Data Pipeline Engineer

    1 week ago

    Kozhikode, Kerala, India beBeeData Full time ₹ 25,00,000 - ₹ 30,00,000

    Data Solutions Architect for Oil & Gas IndustryWe are seeking a senior-level Data Solutions Architect with expertise in designing, building, and optimizing scalable data pipelines and cloud solutions for the Oil & Gas industry. The ideal candidate will have a strong background in AWS cloud services, data engineering, and knowledge of Oil & Gas upstream,...

  • Chief Data Pipeline Architect

    2 days ago

    Kozhikode, Kerala, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,25,000

    Job Overview Data Engineers design and build scalable data pipelines on cloud platforms, leveraging services such as S3, Glue, Redshift, EMR, Lambda, and Terraform.They implement data ingestion, transformation, and integration solutions using Spark, Glue, and SQL to ensure robust and automated deployments.Data Engineers manage and optimize cloud storage and...

  • Building Enterprise-Ready Data Pipelines

    2 days ago

    Kozhikode, Kerala, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,40,00,000

    Job Title: Data ArchitectKey Responsibilities:Design and implement scalable, high-performance data transformation pipelines using cloud-based data warehousing solutions.Build ingestion pipelines from various sources into cloud-based data warehouses.Implement data modelling and transformation logic to support layered architecture.Leverage orchestration tools...

  • Chief Data Pipeline Architect

    4 days ago

    Kozhikode, Kerala, India beBeeDataAnalytics Full time ₹ 12,00,000 - ₹ 20,10,000

    We're seeking a highly skilled Data Analytics Professional with expertise in developing scalable data pipelines using PySpark, Scala Spark, and Java Spark SQL.Key Responsibilities:Design data models to meet business needs and develop efficient data transformation logicsCollaborate with cross-functional teams to integrate data solutions into existing systems...

  • Big Data Architect

    55 minutes ago

    Kozhikode, Kerala, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Job Title: Big Data ArchitectWe are seeking a highly skilled data architect with expertise in designing, developing, and optimizing large-scale data pipelines and distributed data processing systems.Key Responsibilities:Design and develop large-scale data pipelines using Scala, Spark, Python, Apache Kafka, and orchestration tools like NiFi/Airflow.Work...

  • Data Architect

    22 hours ago

    Kozhikode, Kerala, India beBeeDataArchitect Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Data ArchitectAs a seasoned professional, you will play a pivotal role in designing and implementing cutting-edge data pipelines that propel our organization forward. With a strong foundation in big data technologies, you will collaborate with cross-functional teams to drive innovation and growth.Design and develop scalable data architectures that...