High-Performance Data Architect

5 days ago

Malappuram, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

As a Senior Data Engineer, you will play a crucial role in our organization's data infrastructure. Your primary responsibility will be to design and build high-performance data pipelines that process massive amounts of data. You'll work on optimizing existing systems, identifying performance bottlenecks, and implementing solutions to improve overall efficiency.

Key Responsibilities include:

  • Designing scalable batch processing systems using Python and big data technologies
  • Optimizing database performance by focusing on slow-running queries and latency improvements
  • Using Python profilers and performance monitoring tools to identify bottlenecks
  • Reducing P95 and P99 latency metrics across our data platform
  • Building efficient ETL pipelines that can handle large-scale data processing
  • Collaborating with data scientists and product teams to understand data requirements
  • Monitoring and troubleshooting data pipeline issues in production
  • Implementing data quality checks and validation mechanisms
  • Documenting data architecture and engineering processes

Requirements include:

  • Bachelor's degree in Computer Science, Engineering, or related technical field
  • 4+ years of experience in data engineering roles
  • Strong Python programming skills with focus on data processing libraries
  • Experience with big data technologies (Spark, Hadoop, etc.)
  • Proven experience optimizing database performance (SQL or NoSQL)
  • Knowledge of data pipeline orchestration tools (Airflow, Luigi, etc.)
  • Understanding of performance optimization techniques and profiling tools
  • Experience with cloud platforms (AWS, GCP, or Azure)
  • Ability to translate business requirements into technical specifications

Preferred qualifications include:

  • Master's degree in Computer Science or related field
  • Experience with SEO data or web crawling systems
  • Experience with Clickhouse Database
  • Knowledge of distributed systems and microservices architecture
  • Familiarity with container orchestration (Kubernetes, Docker)
  • Experience with real-time data processing
  • Contributions to open-source projects

Skills and Abilities required include:

  • Strong analytical thinking and problem-solving skills
  • Excellent attention to detail and commitment to data quality
  • Ability to work effectively in a collaborative team environment
  • Good communication skills to explain complex technical concepts
  • Self-motivated with the ability to work independently
  • Passion for performance optimization and efficiency

Our ideal candidate is someone who is passionate about performance optimization and efficiency, with strong analytical thinking and problem-solving skills. If you're looking for a challenging role where you can apply your skills and knowledge to drive business results, we encourage you to apply.

  • High-Performance Data Architect

    5 days ago

    Malappuram, Kerala, India beBeeRedshift Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior AWS Redshift Engineer Role OverviewA senior-level position is available for a highly skilled Redshift engineer to lead the architecting, optimization, and scaling of AWS Redshift environments. This role will involve working closely with clients to ensure reliability, scalability, and efficiency of their data platforms.Job DescriptionThis is a key...

  • Chief Data Solutions Architect

    3 days ago

    Malappuram, Kerala, India beBeeDataSolutions Full time US$ 2,00,000 - US$ 2,40,000

    Job Title: Chief Data Solutions Architect","Description:","We are seeking a seasoned Chief Data Solutions Architect to design, develop and implement cutting-edge data warehousing solutions.","Key Responsibilities:","Data Modeling: Design logical and physical data models to ensure efficient data storage and retrieval.ETL Processes: Develop and optimize ETL...

  • Data Architect

    3 days ago

    Malappuram, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    We are seeking a seasoned Data Architect to spearhead the design and implementation of scalable data systems that fuel business growth.Key Responsibilities:Design, Develop, and Optimize Data SystemsA strong background in distributed computing frameworks and large-scale data platforms is essential for success.Expertise in SQL performance tuning and query...

  • Chief Data Architect Specialist

    2 days ago

    Malappuram, Kerala, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Enterprise Data ArchitectWe are seeking an experienced and skilled Enterprise Data Architect to lead our data architecture initiatives.This role involves managing and overseeing all activities that define client business data assets in alignment with the Client's Data & Analytics Strategy.The successful candidate will discover and analyze data and analytics...

  • Enterprise Data Architect

    5 days ago

    Malappuram, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Key Data Architect RoleJob Title: Key Data ArchitectWe are seeking an expert data architect to design, develop, and govern our enterprise data architecture and pipelines.Responsibilities:Design and implement scalable and robust data architectures for data warehousing and enterprise platforms using tools such as Big Query and Data Proc technologies.Develop...

  • Data Architect

    3 days ago

    Malappuram, Kerala, India beBeeData Full time ₹ 8,00,000 - ₹ 10,00,000

    Job Title: Data ArchitectData Engineer RoleWe are seeking a skilled data engineer to lead the design and development of our data pipelines using Databricks PySpark.Key Responsibilities:Data Pipeline Development:Design and develop efficient data pipelines using Databricks PySpark for extracting, transforming, and loading data from diverse sources into our...

  • Firmware Expert for High-Performance Platforms

    3 days ago

    Malappuram, Kerala, India beBeeCPU Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: CPU Firmware ArchitectWe are seeking a highly skilled Core CPU Architect to drive innovations in core CPU, firmware/OS enablement, and performance tuning for next-generation SoCs used in automotive and edge computing platforms.The ideal candidate will work at the intersection of CPU design and system software, collaborating with CPU design and...

  • Data Architect Lead

    18 hours ago

    Malappuram, Kerala, India beBeeDataEngineering Full time ₹ 25,00,000 - ₹ 40,00,000

    Job DescriptionThe position of Data Architect Lead is a key role in the development of our innovative data warehouse offerings. As part of our Data Warehouse team, you will be responsible for leading a team of Senior Engineers, proposing architecture, solving complex situations and data modeling, interacting directly with clients for requirement gathering,...

  • Chief Data Architect

    6 days ago

    Malappuram, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Role: As a data engineer in the data warehouse team you will be relied on to independently develop and deliver high-quality features and finish tasks to a high standard.You'll be part of an emerging team, focusing on building and improving our innovative BNL data warehouse offerings applying marketing suites.For this position, the ideal candidate has 8+...

  • High-Performance AI Accelerator Designer

    2 days ago

    Malappuram, Kerala, India beBeePerformance Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Overview:We are seeking a highly experienced Principal IP/RTL Design Engineer to join our team. As a key member of our design group, you will play a pivotal role in the development of novel high-performance AI accelerators from scratch.Your primary responsibilities will include designing and implementing high-performance TPUs/MPUs and other related AI...