Senior Big Data Professional

5 days ago

Udaipur, Rajasthan, India beBeeData Full time US$ 1,20,000 - US$ 1,40,000

We are seeking a talented Data Engineer to help us optimize and scale our data processing capabilities.

Role Overview

As a Data Engineer, you will design, build, and maintain high-performance data pipelines that process large amounts of data. You'll work on optimizing our existing systems, identifying and resolving performance bottlenecks, and implementing solutions that improve the overall efficiency of our platform.

Key Responsibilities:

  • Design and implement scalable batch processing systems using Python and big data technologies
  • Optimize database performance, focusing on slow-running queries and latency improvements
  • Use Python profilers and performance monitoring tools to identify bottlenecks
  • Reduce P95 and P99 latency metrics across our data platform
  • Build efficient ETL pipelines that can handle large-scale data processing
  • Collaborate with data scientists and product teams to understand data requirements
  • Monitor and troubleshoot data pipeline issues in production
  • Implement data quality checks and validation mechanisms
  • Document data architecture and engineering processes
  • Stay current with emerging big data technologies and best practices
Qualifications Required

• Bachelor's degree in Computer Science, Engineering, or related technical field • 4+ years of experience in data engineering roles • Strong Python programming skills with focus on data processing libraries • Experience with big data technologies (Spark, Hadoop, etc.) • Proven experience optimizing database performance (SQL or NoSQL) • Knowledge of data pipeline orchestration tools (Airflow, Luigi, etc.) • Understanding of performance optimization techniques and profiling tools • Experience with cloud platforms (AWS, GCP, or Azure) • Ability to translate business requirements into technical specifications • Ability to work in a collaborative team environment

Note: Preferred qualifications are listed below

Benefits

You will have the opportunity to work with a talented team of engineers, learn from experienced professionals, and grow your skills and knowledge in a dynamic and fast-paced environment.

Others

Please note that we are looking for a highly motivated individual who is passionate about performance optimization and efficiency.

  • Big Data Professional

    2 days ago

    Udaipur, Rajasthan, India beBeeBigData Full time ₹ 10,48,000 - ₹ 26,12,000

    Big Data Expert WantedWe are looking for a skilled Big Data expert to join our team. The ideal candidate will have experience in handling large data sets and developing strategies to improve data processing efficiency.The successful candidate will be responsible for designing, implementing, and maintaining big data solutions using various technologies such...

  • Senior Big Data Architect

    1 week ago

    Udaipur, Rajasthan, India beBeeDataEngineer Full time

    Job Summary:We are seeking a highly skilled Big Data Engineer to lead our team in developing and implementing large-scale data architectures. As a senior member of our engineering team, you will be responsible for designing and implementing data pipelines, working closely with clients and stakeholders to understand their requirements and develop solutions...

  • Chief Big Data Architect

    3 days ago

    Udaipur, Rajasthan, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Big Data Platform Engineer Job DescriptionWe are seeking an experienced Big Data Platform Engineer to join our team. In this role, you will be responsible for designing, developing, and maintaining a highly scalable and extensible big data platform that provides the foundation for collecting, storing, modeling, and analyzing massive data sets from multiple...

  • Big Data Specialist

    3 days ago

    Udaipur, Rajasthan, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    We are seeking a skilled Data Engineer to fill the role of Big Data Specialist.The successful candidate will be responsible for designing, developing, and maintaining large-scale data processing systems using Azure technologies such as ADF, ADB, PySpark, and SQL.Design and implement data pipelines using Azure Data Factory (ADF) and Azure Synapse Analytics...

  • Big Data Analyst

    3 days ago

    Udaipur, Rajasthan, India beBeedata Full time ₹ 20,00,000 - ₹ 25,00,000

    We are seeking a skilled Data Scientist to join our team.Skill: Big Data

  • Big Data Specialist

    5 days ago

    Udaipur, Rajasthan, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,50,000

    We are seeking a Senior Data Engineer to join our growing team of consultants. In this role, you will be responsible for designing, constructing, and optimizing large-scale data processing systems that enable advanced analytics and business intelligence.You will collaborate closely with data scientists, analysts, and other engineers to ensure the...

  • Senior Data Architect Position

    9 hours ago

    Udaipur, Rajasthan, India beBeeDataArchitect Full time ₹ 25,00,000 - ₹ 30,00,000

    Senior Data Architect PositionWe are looking for a highly experienced Senior Data Architect to lead our data warehouse team. The ideal candidate will have a strong background in designing and developing large-scale data systems, with expertise in cloud-based technologies such as AWS.Job Description:The Senior Data Architect will be responsible for:Designing...

  • Big Data Solutions Engineer

    5 days ago

    Udaipur, Rajasthan, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Data Engineer - Big Data SolutionsJob Description:We are seeking an experienced Data Engineer to lead the architecture and implementation of scalable, secure, and high-performance data solutions. As a key member of our team, you will design, develop, and maintain data pipelines and ETL processes on Databricks.Key Responsibilities:Design, develop,...

  • Big Data Project Manager

    2 days ago

    Udaipur, Rajasthan, India beBeeDelivery Full time US$ 1,00,000 - US$ 1,50,000

    Strategic Delivery LeadWe are seeking a seasoned Strategic Delivery Lead with expertise in managing large-scale projects within complex environments.Key Responsibilities:Deliver complex technical projects on time, within scope.Ensure client satisfaction and seamless execution.Manage project timelines, resource allocation, and stakeholder...

  • Big Data Engineer Position

    3 days ago

    Udaipur, Rajasthan, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior Data Processing EngineerWe are looking for a highly skilled professional to lead our data engineering team in designing, developing, and optimizing large-scale data pipelines and distributed data processing systems.Main Responsibilities:Develop efficient data processing solutions using Scala, Spark, and Python.Work on designing and integrating...