Big Data Engineer Opportunity

21 hours ago


Belgaum, Karnataka, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 17,50,000
Job Description

A big data engineer is needed to design, build and maintain high-performance data pipelines. The ideal candidate will have experience with big data technologies, such as Spark and Hadoop, and be able to optimize database performance.

The role involves working on scalable batch processing systems using Python and big data technologies, optimizing database performance, identifying and resolving performance bottlenecks, and implementing solutions that improve the overall efficiency of the platform.

Key Responsibilities:

  • Design and implement scalable batch processing systems using Python and big data technologies
  • Optimize database performance, focusing on slow-running queries and latency improvements
  • Use Python profilers and performance monitoring tools to identify bottlenecks
  • Reduce P95 and P99 latency metrics across our data platform
  • Build efficient ETL pipelines that can handle large-scale data processing

Qualifications Required:

  • Bachelor's degree in Computer Science, Engineering, or related technical field
  • 4+ years of experience in data engineering roles
  • Strong Python programming skills with focus on data processing libraries
  • Experience with big data technologies (Spark, Hadoop, etc.)
  • Proven experience optimizing database performance (SQL or NoSQL)

  • Big Data Engineer

    1 week ago


    Belgaum, Karnataka, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    We are seeking a skilled Big Data Engineer to manage our large-scale data processing systems. As a key member of the IT infrastructure team, you will be responsible for designing and implementing high-performance clusters to support big data workloads.The ideal candidate will have experience in Cloudera administration and data processing systems, with strong...


  • Belgaum, Karnataka, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Senior Big Data EngineerSkillful and experienced big data engineer sought after to design, build, deploy, and maintain large-scale data processing systems using cloud-based technologies. Key responsibilities include development of high-performance data pipelines, optimization of existing codebases, and implementation of data warehousing concepts.Required...


  • Belgaum, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Big Data Developer Position OverviewAs a seasoned Big Data Developer, you will be part of a fast-paced team that thrives in technical environments.This role is ideal for an engineer who not only excels in hands-on project support but also has a passion for coaching and developing junior talent.You will work on live client projects, provide technical...


  • Belgaum, Karnataka, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job OverviewA Senior Data Engineer leads a team of big data engineers, working closely with stakeholders and team members to understand their requirements and develop architectures that meet their needs.This role involves developing data pipelines for new sources, data transformations within the data lake, implementing GraphQL, working with NoSQL databases,...

  • Big Data Architect

    1 week ago


    Belgaum, Karnataka, India beBeeData Full time ₹ 80,00,000 - ₹ 1,50,00,000

    Job Title: GCP Data EngineerTransforming raw data into actionable insights is crucial for our business. As a key member of our dynamic team, you will design, develop, and maintain robust data pipelines and analytics platforms that serve as the backbone of our product development.You will collaborate with cross-functional teams including data scientists,...


  • Belgaum, Karnataka, India beBeeArchitect Full time US$ 1,25,000 - US$ 1,75,000

    This is an exciting opportunity to lead the development of our next-generation big data platform. As a Senior Big Data Solutions Architect, you will be responsible for designing and implementing scalable architecture for big data and micro-services environments.The ideal candidate will have extensive experience in design and architecture of big data...

  • Big Data Specialist

    6 days ago


    Belgaum, Karnataka, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Senior Data DeveloperThe role of Senior Data Developer is pivotal in crafting, implementing and managing extensive distributed data systems. Your expertise in big data technologies and relational databases will play a crucial part in driving business growth.Key Responsibilities:Designing and executing scalable data solutions to meet business needsMonitoring...


  • Belgaum, Karnataka, India beBeeBigDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    We are seeking a skilled Data Engineer to fill a key position in our organization. The ideal candidate will have experience in programming languages such as Java and Scala, with expertise in Maven, Apache Spark Frameworks, and Unix Shell scripting.Main Responsibilities:Design and implement scalable data processing pipelines using tools like Apache Beam,...


  • Belgaum, Karnataka, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Big Data Solution ArchitectAbout the Role:We are looking for a skilled professional to design and implement data solutions.The ideal candidate will have 9+ years of experience in data engineering and be proficient in programming languages such as Python and Java.Key Responsibilities:Maintain architecture principles, guidelines and standards for...


  • Belgaum, Karnataka, India beBeeDataSpecialist Full time ₹ 80,00,000 - ₹ 2,00,00,000

    Big Data Specialist Job DescriptionGreetings from our organization.We are currently seeking experienced professionals for Bigdata Scala Spark positions. The ideal candidate will have 6–12 years of experience in Bigdata and related technologies.The following skills and qualifications are required:More than 5.8 years of experience in Big Data...