High-Performance Data Architect

20 hours ago

Kozhikode, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

Big Data Engineer Job Description

We are seeking a highly skilled Big Data Engineer to join our team. As a key member of our Professional Services group, you will design, build, and maintain high-performance data pipelines that process terabytes of data.

Job Overview

As a Big Data Engineer at our company, you will work on optimizing our existing systems, identifying and resolving performance bottlenecks, and implementing solutions that improve the overall efficiency of our platform. This role is critical in ensuring our data infrastructure can handle increasing volumes of data while maintaining exceptional performance standards.

Key Responsibilities

  • Design and implement scalable batch processing systems using Python and big data technologies
  • Optimize database performance, focusing on slow-running queries and latency improvements
  • Use Python profilers and performance monitoring tools to identify bottlenecks
  • Reduce P95 and P99 latency metrics across our data platform
  • BUILD efficient ETL pipelines that can handle large-scale data processing
  • Collaborate with data scientists and product teams to understand data requirements
  • Monitor and troubleshoot data pipeline issues in production
  • Implement data quality checks and validation mechanisms
  • Document data architecture and engineering processes
  • Stay current with emerging big data technologies and best practices

Qualifications Required

  • Bachelor's degree in Computer Science, Engineering, or related technical field
  • 4+ years of experience in data engineering roles
  • Strong Python programming skills with focus on data processing libraries
  • Experience with big data technologies (Spark, Hadoop, etc.)
  • Proven experience optimizing database performance (SQL or NoSQL)
  • Knowledge of data pipeline orchestration tools (Airflow, Luigi, etc.)
  • Understanding of performance optimization techniques and profiling tools
  • Experience with cloud platforms (AWS, GCP, or Azure)
  • Ability to translate business requirements into technical specifications
  • Ability to work in UK timezone (12 PM IST to 9:30 PM IST)

Benefits

  • Maintain your skills by staying updated with new technologies and trends
  • We encourage you to contribute to open-source projects and make a difference in the industry
  • We support your professional development through training and workshops

  • High-Performance Data Engineer

    1 day ago

    Kozhikode, Kerala, India beBeeDataEngineer Full time ₹ 15,04,860 - ₹ 21,68,100

    Job DescriptionWe are seeking a skilled and detail-oriented professional to design, build, and manage scalable data pipelines and enterprise data solutions. This role will be critical in supporting analytics, reporting, and data science initiatives by delivering high-quality, reliable, and performant data systems.This individual will work collaboratively...

  • High-Performance Backend Developer

    12 hours ago

    Kozhikode, Kerala, India beBeeBackend Full time ₹ 1,50,00,000 - ₹ 2,25,00,000

    **Job Overview:**We are seeking a seasoned Backend Engineer to spearhead the development of our high-performance, real-time hotel search and distribution platform.The ideal candidate will have extensive experience in building scalable microservices using Java, Spring Boot, and Hibernate. They should also be well-versed in NoSQL databases like MySQL, MongoDB,...

  • High-Level Data Systems Architect

    12 hours ago

    Kozhikode, Kerala, India beBeeDataArchitect Full time ₹ 10,00,000 - ₹ 12,00,000

    Data Systems ArchitectWe are seeking a skilled Data Systems Architect to design and implement large-scale data systems. The ideal candidate will have expertise in designing, building, and maintaining complex data architectures.Key Responsibilities:System Design: Design scalable data systems on cloud platforms.DBT Experience: Work with DBT to transform and...

  • Head of High-Performance Culture

    19 hours ago

    Kozhikode, Kerala, India beBeeLeadership Full time ₹ 1,78,44,170 - ₹ 2,51,82,800

    Performance Excellence Lead:We seek an experienced Performance Management expert to implement and institutionalize a high-performance culture across our organization. As a strategic advisor to senior leaders, you will drive performance alignment with business goals, provide data-driven insights, and foster excellence.About the Role:

  • Highly Skilled Data Systems Architect Wanted

    16 hours ago

    Kozhikode, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job TitleData Systems ArchitectRole OverviewWe are seeking a highly skilled data systems architect to join our team. The ideal candidate will have expertise in designing and implementing high-quality, secure, and scalable data pipelines and systems that power reporting, analytics, and operational use cases.This is a remote-first opportunity with occasional...

  • Data Systems Architect

    3 days ago

    Kozhikode, Kerala, India beBeeDataArchitect Full time ₹ 10,00,000 - ₹ 15,00,000

    Job DescriptionA data architect is required to be proactive in designing, building and maintaining data systems. The role also requires cross-functional collaborations and ensuring the highest standards of data quality and performance by extending their expertise in data engineering, data architecture, pipeline creation and big data technologies.The role...

  • High-Performance Golang Backend Developer Wanted

    16 hours ago

    Kozhikode, Kerala, India beBeeGolang Full time ₹ 15,00,000 - ₹ 25,00,000

    Backend Developer PositionWe are seeking a highly skilled and experienced Backend Developer to join our team. The successful candidate will have extensive knowledge of backend development, with a strong focus on Golang.The ideal candidate will have in-depth understanding of concurrency, memory management, and performance tuning in Golang. They will be...

  • Enterprise Data Solutions Architect

    17 hours ago

    Kozhikode, Kerala, India beBeeData Full time ₹ 9,84,321 - ₹ 12,34,567

    Business Intelligence Analyst: Enterprise Data SolutionsThis critical role supports the migration of enterprise data solutions from HANA to Snowflake.Collaborate with business stakeholders to understand analytics and reporting requirements.Conduct feasibility studies and analyze requirements for technical implementation.Convert functional requirements into...

  • Lead Data Architect

    17 hours ago

    Kozhikode, Kerala, India beBeeData Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    Job Title:Data Systems Architect Job Description:We are seeking an experienced Data Systems Architect to lead the design, development, and maintenance of large-scale data systems.Key Responsibilities:Distributed System Expertise: Proven experience in designing and implementing distributed systems is essential. Strong hands-on knowledge of SQL performance...

  • Leading Identity Architect

    16 hours ago

    Kozhikode, Kerala, India beBeeIdentity Architect Full time ₹ 1,20,000 - ₹ 1,30,000

    We're seeking a technical leader to lead our greenfield IAM infrastructure, fostering collaboration and expertise among engineers.This is an excellent opportunity for seasoned professionals who balance technical excellence with user empathy and thrive in building from zero to production.Skillfully scale identity architecture using JavaScript, Node.js, and...