High-Performance Data Engineer Expert Wanted

4 days ago

Anantapur, Andhra Pradesh, India beBeeData Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

Expert Big Data Engineer Wanted.

Our team is looking for a highly skilled data engineer to join our professional services. As a big data engineer at our company, you will be responsible for designing and building high-performance data pipelines that process large volumes of data.

The ideal candidate will have experience with Python, big data technologies, and database performance optimization. They should also have knowledge of data pipeline orchestration tools and the ability to work effectively in a collaborative environment.

The role requires a strong analytical mind and excellent problem-solving skills. The successful candidate will be able to work independently and as part of a team to achieve business objectives.

Key Responsibilities:
  • Design and implement scalable batch processing systems using Python and big data technologies
  • Optimize database performance, focusing on slow-running queries and latency improvements
  • Use Python profilers and performance monitoring tools to identify bottlenecks
  • Reduce P95 and P99 latency metrics across our data platform
  • Build efficient ETL pipelines that can handle large-scale data processing
  • Collaborate with data scientists and product teams to understand data requirements
  • Monitor and troubleshoot data pipeline issues in production
  • Implement data quality checks and validation mechanisms
  • Document data architecture and engineering processes
  • Stay current with emerging big data technologies and best practices
Qualifications Required:
  • Bachelor's degree in Computer Science, Engineering, or related technical field
  • 4+ years of experience in data engineering roles
  • Strong Python programming skills with focus on data processing libraries
  • Experience with big data technologies (Spark, Hadoop, etc.)
  • Proven experience optimizing database performance (SQL or NoSQL)
  • Knowledge of data pipeline orchestration tools (Airflow, Luigi, etc.)
  • Understanding of performance optimization techniques and profiling tools
  • Experience with cloud platforms (AWS, GCP, or Azure)
  • Ability to translate business requirements into technical specifications
  • Ability to work in UK timezone
Preferred Qualifications:
  • Master's degree in Computer Science or related field
  • Experience with SEO data or web crawling systems
  • Experience with Clickhouse Database
  • Knowledge of distributed systems and microservices architecture
  • Familiarity with container orchestration (Kubernetes, Docker)
  • Experience with real-time data processing
  • Contributions to open-source projects
  • Experience with machine learning operations

  • High-Performance Data Engineering Expert

    1 day ago

    Anantapur, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Senior Data Engineer">We are seeking an experienced professional to design and implement scalable, high-performance data pipelines using AWS cloud services and Databricks. The ideal candidate will have strong expertise in ETL/ELT workflows, big data environments, and data availability for analytics, AI/ML, and business intelligence use cases.">Key...

  • Data Testing Expert Wanted

    1 day ago

    Anantapur, Andhra Pradesh, India beBeeETL Full time ₹ 15,00,000 - ₹ 20,00,000

    Data Testing Expert WantedWe are seeking a skilled professional with 4-10 years of experience in data testing to drive excellence in this field.

  • High-Performance PostgreSQL Expert

    4 days ago

    Anantapur, Andhra Pradesh, India beBeePostgreSQL Full time US$ 1,50,000 - US$ 2,00,000

    Senior PostgreSQL Support Engineer Position Overview">Our organization is looking for a highly skilled Senior PostgreSQL Support Engineer to join our team. As a key member of our technical support team, you will be responsible for providing expert-level support and guidance to clients on PostgreSQL-related matters.Job DescriptionThe successful candidate will...

  • Cloud-Savvy Data Engineer Wanted

    4 days ago

    Anantapur, Andhra Pradesh, India beBeeSnowflake Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Snowflake Developer PositionWe are seeking a skilled Snowflake developer and infrastructure expert to oversee the full lifecycle of implementations, encompassing secure platform setup and cloud integration to high-performance data pipeline development.

  • High-Performing Digital Marketing Expert Sought

    2 days ago

    Anantapur, Andhra Pradesh, India beBeePerformanceMarketer Full time ₹ 1,80,00,000 - ₹ 2,80,00,000

    Digital Marketing Leader WantedAre you a seasoned marketing professional looking for a new challenge?At our company, digital marketing is not just a department - it's the engine that drives everything we do.Every campaign we launch, every account we manage, and every experiment we test all contribute to something bigger.We're searching for someone who can...

  • High-Performance Systems Engineer

    2 days ago

    Anantapur, Andhra Pradesh, India beBeePerformance Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    About us:We're a leading software giant with over 11 billion USD revenue, a global workforce of 240000 employees, and presence in 60+ countries. We deliver end-to-end technology services to clients worldwide.Job Summary:We're seeking a skilled Performance Engineer to join our team. As a key member, you'll be responsible for designing and implementing...

  • High-Performance Mobile App Developer

    15 hours ago

    Anantapur, Andhra Pradesh, India beBeeFlutter Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Are you a skilled mobile application developer looking to advance your career in cross-platform development? We are seeking an experienced Flutter & FlutterFlow Developer to join our dynamic team.The ideal candidate will have a strong foundation in mobile app development, with hands-on experience using both Flutter and Flutter Flow. In this role, you will...

  • High-Performance Network Architect Role

    2 days ago

    Anantapur, Andhra Pradesh, India beBeeNetwork Full time ₹ 40,00,000 - ₹ 50,00,000

    Senior Network Architect OpportunityWe're seeking a seasoned Senior Network Architect to spearhead the development of our cutting-edge Core Network-as-a-Service platform. This is an exceptional chance to leverage your expertise in designing and delivering scalable, high-performance network solutions.Key Responsibilities:Lead the design and implementation of...

  • Expert Frontend Engineer Wanted

    7 days ago

    Anantapur, Andhra Pradesh, India beBeeFrontend Full time US$ 1,80,000 - US$ 2,40,000

    Transform the way people learn and adapt in a rapidly changing world. We are seeking a highly skilled Frontend Developer to join our team.Job DescriptionAs a Frontend Developer, you will play a key role in designing, developing, and maintaining frontend projects. Your primary responsibility will be to create scalable, performant, and intuitive user...

  • High Performing Site Reliability Engineer Lead

    2 days ago

    Anantapur, Andhra Pradesh, India beBeeReliability Full time ₹ 10,00,000 - ₹ 15,00,000

    Job TitleAmbitious Site Reliability Engineer Lead to Drive High-Performing SystemsAbout the RoleThis senior-level position demands a results-driven professional to spearhead site reliability engineering practices, lead high-performing teams, and drive automation strategies.In this challenging role, you will collaborate with cross-functional teams to build...