Data Pipeline Architect

3 days ago

Bengaluru, Karnataka, India beBeeExpert Full time ₹ 1,80,00,000 - ₹ 2,00,00,000
Job Overview

As a seasoned IT professional, we're seeking an Elasticsearch administrator to join our team. This role involves continuously evaluating the performance of Elasticsearch and Splunk clusters to identify developing issues, planning changes for high-load events, applying security patches, testing incremental upgrades, and extending monitoring and alert infrastructure.

This is a critical position that requires strong expertise in Elasticsearch cluster administration, Docker, Kubernetes, and automation tools like Puppet and scripting mechanisms. The ideal candidate will have 6-12 years of experience in managing complex data pipelines, optimizing cost-vs-performance positions, and building partnerships between Product, Engineering, and Operations teams.

Responsibilities
  • Maintain other parts of the data pipeline, including serverless or server-based systems feeding data into Elasticsearch.
  • Optimize cost-vs-performance position by testing new hosts or configurations.
  • Automate tasks using declarative tools like Puppet and scripting mechanisms.
Requirements
  • Manage Elasticsearch clusters in public cloud, Kubernetes, and private datacenter environments.
  • Build partnerships between Product, Engineering, and Operations teams.
  • Participate in on-call rotations and address escalated issues.
  • Provision and configure infrastructure using tools like Puppet, Ansible, Rundeck.
  • Experience with automation, infrastructure as code, monitoring, logging, and CI/CD tools.
  • Strong troubleshooting skills and ability to learn from data in large systems.
  • Docker and Kubernetes experience.
What We Offer
  • Competitive salary and benefits package
  • Talent development opportunities with quarterly promotions and company-sponsored education and certifications
  • Cutting-edge technology work environment
  • Employee engagement initiatives
  • Annual health check-ups
  • Insurance coverage
Inclusive Work Environment

We are committed to diversity and inclusion. We welcome applications from qualified individuals with disabilities and support hybrid work arrangements.

  • Data Pipeline Architect

    7 days ago

    Bengaluru, Karnataka, India beBeeETLDeveloper Full time ₹ 1,20,00,000 - ₹ 1,50,00,000

    About the RoleWe are seeking a skilled Senior ETL Developer to join our team.The successful candidate will be responsible for evaluating and understanding current-state Informatica ETL jobs, mappings, workflows, and dependencies.Key responsibilities include:Evaluating and redesigning data pipelines using Databricks (PySpark/Scala/SQL) to optimize performance...

  • Data Pipeline Architect

    3 hours ago

    Bengaluru, Karnataka, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job TitleData Engineering ManagerRole OverviewThe Senior Data Engineer will design, develop, and maintain scalable data pipelines and infrastructure to support data-driven decision-making and advanced analytics. They must have deep expertise in data engineering, strong problem-solving skills, and the ability to collaborate with cross-functional teams to...

  • Strategic Data Pipeline Architect

    2 days ago

    Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 19,96,000 - ₹ 24,64,700

    Job DescriptionWe are seeking a highly skilled Data Engineer to design, develop, and maintain data pipelines that extract data from Oracle Symphony via APIs, process and store it in the Databricks Lakehouse platform, and then integrate it into Oracle EPM (Enterprise Performance Management).This role requires deep expertise in data integration, ETL/ELT, APIs,...

  • Senior Data Pipeline Architect

    10 hours ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job OverviewAs a senior data pipeline architect, you will be responsible for designing, developing, and deploying scalable data architectures using big data technologies.You will collaborate with stakeholders to understand data requirements and translate them into technical solutions. Your expertise in writing complex SQL queries and knowledge of advanced...

  • Senior Data Pipeline Architect

    5 days ago

    Bengaluru, Karnataka, India beBeeDataLeader Full time ₹ 1,04,000 - ₹ 1,30,878

    Job DescriptionAs a seasoned data professional, you will be responsible for leading cross-functional teams in the development and maintenance of large-scale data pipelines. Your expertise will be essential in architecting and implementing scalable data solutions that drive business growth.Required Skills and QualificationsMinimum 5 years of experience...

  • Senior Data Pipeline Architect

    7 days ago

    Bengaluru, Karnataka, India beBeeDataEngineering Full time ₹ 1,04,000 - ₹ 1,30,878

    Lead Data EngineeringThe Lead Data Engineer is a key member of our engineering team, responsible for leading and mentoring data engineers to ensure alignment with technical and business objectives.As a senior data engineer, you will architect, design, and implement scalable and high-performance data pipelines using AWS technologies. You will collaborate with...

  • Chief Data Pipeline Architect

    5 days ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title:High-Performance Data Solutions Architect">">">Design and develop scalable, high-availability data pipelines for large-scale data sets.">Collaborate with cross-functional teams to understand business requirements and drive technology solutions.">Implement automation and DevOps practices to improve efficiency and reduce team effort.">Lead technical...

  • Data Pipeline Architect

    6 days ago

    Bengaluru, Karnataka, India beBeeAzure Full time ₹ 15,00,000 - ₹ 25,00,000

    Freelance Azure Data Factory SpecialistWe are seeking an experienced Freelance Azure Data Factory (ADF) Specialist to support our data integration and ETL needs.The ideal consultant will have strong hands-on expertise in Azure ADF pipelines, data orchestration, and transformations to ensure smooth, scalable, and secure data flows across multiple sources and...

  • Chief Data Pipeline Architect

    7 days ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Ab Initio ETL DeveloperWe are seeking a seasoned Ab Initio ETL Developer to join our team. The ideal candidate will have a strong background in designing and implementing high-quality data pipelines using Ab Initio.The successful candidate will work on developing robust ETL solutions, utilizing their expertise in GDE, EME, CoOp, ExpressIT, and Continuous...

  • Data Pipeline Architect

    3 days ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 12,00,000 - ₹ 18,00,000

    Data Engineer Role SummaryWe are seeking a skilled Data Engineer to build and maintain large-scale data pipelines for slot game data. The ideal candidate will have experience with SQL, Python, or other data engineering languages, as well as familiarity with cloud platforms (AWS) and data pipeline orchestration tools.Key ResponsibilitiesDesign, develop, and...