High-Performance Data Engineer

24 hours ago

Ahmedabad, Gujarat, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

We are seeking a Data Engineer to join our team. This is a critical role in ensuring our data infrastructure can handle increasing volumes of data while maintaining exceptional performance standards.

Job Description:

The successful candidate will design, build, and maintain high-performance data pipelines that process terabytes of data. They will work on optimizing our existing systems, identifying and resolving performance bottlenecks, and implementing solutions that improve the overall efficiency of our platform.

Key Responsibilities:

  • Design and implement scalable batch processing systems using Python and big data technologies
  • Optimize database performance, focusing on slow-running queries and latency improvements
  • Use Python profilers and performance monitoring tools to identify bottlenecks
  • Reduce P95 and P99 latency metrics across our data platform
  • Build efficient ETL pipelines that can handle large-scale data processing
  • Collaborate with data scientists and product teams to understand data requirements
  • Monitor and troubleshoot data pipeline issues in production
  • Implement data quality checks and validation mechanisms
  • Document data architecture and engineering processes
  • Stay current with emerging big data technologies and best practices

Qualifications Required:

  • Bachelor's degree in Computer Science, Engineering, or related technical field
  • 4+ years of experience in data engineering roles
  • Strong Python programming skills with focus on data processing libraries
  • Experience with big data technologies (Spark, Hadoop, etc.)
  • Proven experience optimizing database performance (SQL or NoSQL)
  • Knowledge of data pipeline orchestration tools (Airflow, Luigi, etc.)
  • Understanding of performance optimization techniques and profiling tools
  • Experience with cloud platforms (AWS, GCP, or Azure)
  • Ability to translate business requirements into technical specifications
  • Ability to work in UK timezone

Preferred Qualifications:

  • Master's degree in Computer Science or related field
  • Experience with SEO data or web crawling systems
  • Experience with Clickhouse Database
  • Knowledge of distributed systems and microservices architecture
  • Familiarity with container orchestration (Kubernetes, Docker)
  • Experience with real-time data processing
  • Contributions to open-source projects
  • Experience with machine learning operations

Skills and Abilities:

  • Strong analytical thinking and problem-solving skills
  • Excellent attention to detail and commitment to data quality
  • Ability to work effectively in a collaborative team environment
  • Good communication skills to explain complex technical concepts
  • Self-motivated with the ability to work independently
  • Passion for performance optimization and efficiency

  • High-Performance Software Engineer

    1 day ago

    Ahmedabad, Gujarat, India beBeeSoftware Full time ₹ 10,00,000 - ₹ 30,00,000

    Job OverviewWe are seeking an experienced software engineer to design and develop high-performance, real-time web applications using React 18 and Next.js 14.Develop and maintain scalable web applications with a focus on performance, security, and accessibility.Leverage React Server Components, Suspense, and streaming SSR to build efficient server-first...

  • High-Growth Performance Marketer

    14 hours ago

    Ahmedabad, Gujarat, India beBeeMarketer Full time US$ 1,20,000 - US$ 1,50,000

    Performance Marketing RoleThis position is for a high-growth marketer looking to own and execute paid media strategies.Key ResponsibilitiesCreate and manage successful PPC campaigns on Google, Facebook, LinkedIn, and other platforms.Deliver performance against KPIs through expert-level campaign management skills.Develop innovative strategies that increase...

  • Chief Big Data Engineer

    1 day ago

    Ahmedabad, Gujarat, India beBeeAzure Full time ₹ 20,00,000 - ₹ 30,00,000

    Big Data and Azure Engineering Leadership OpportunityThis leadership role focuses on developing and managing high-performing data engineering teams, overseeing the creation of end-to-end data solutions using Azure Data Services and Databricks.The ideal candidate will lead cross-functional teams, collaborating with stakeholders to understand requirements and...

  • Optimize High-Performance Frontend Infrastructure

    1 day ago

    Ahmedabad, Gujarat, India beBeefrontend Full time ₹ 1,00,00,000 - ₹ 2,01,00,000

    Job Description">As a Senior Front-End Architect, you will lead the execution of engineering across our paid media funnels. This is a high-ownership, results-driven role for an engineer who understands conversion, attribution, and mobile performance.You will own the front-end stack: landing page builds, tracking logic, performance optimization, and rapid...

  • Senior Software Engineer

    4 weeks ago

    Ahmedabad, Gujarat, India Crest Data Full time

    Job DescriptionWe are looking for a strong ReactJS Lead Engineers to join our engineering team in Ahmedabad. The primary responsibility will be to lead the design and develop Enterprise Software for our Global Fortune 500 clients in Data Center and Big Data segments.Key Responsibilities -- Responsible for providing expertise in software development life...

  • High-Performance Cloud Database Engineer

    1 day ago

    Ahmedabad, Gujarat, India beBeeDatabase Full time ₹ 20,00,000 - ₹ 25,00,000

    Cloud Database Consultant – MS SQLThis position requires a seasoned database expert with expertise in designing and implementing scalable and secure database solutions on the cloud using MS SQL and Oracle. The successful candidate will lead delivery teams during customer workshops, engage with clients to define and design database architecture, and...

  • Data Engineer

    3 weeks ago

    Ahmedabad, Gujarat, India Indsafri Full time

    Hiring Now: Senior Data Engineers (Banking Domain – 2 Positions)Location: RemoteExperience: 7+ Years | Banking sector experience preferred Type: Contract About the OpportunityWe're looking for highly skilled Senior Data Engineers to join a mission-critical banking project. This is your chance to work on cutting-edge data pipelines, streaming platforms,...

  • Senior Data Engineer

    4 weeks ago

    Ahmedabad, Gujarat, India ConsultMeIn Full time

    PLEASE READ THE JOB DESCRIPTION BEFORE APPLYING. Mandatory – Active Python Coding Experience of 5+ Years.Role: Data Engineering ManagerExperience: 6 – 12 YearsCTC Budget: 20 – 35 LPA + 20% VariableLocation: Ahmedabad (work from office)Are you passionate about building modern data platforms and leading high-performing engineering teams? We're seeking a...

  • High-Performance Frontend Developer

    3 days ago

    Ahmedabad, Gujarat, India beBeeDeveloper Full time ₹ 20,00,000 - ₹ 25,00,000

    Dynamic Web Development ExpertPocket FM is a cutting-edge audio entertainment platform that revolutionizes storytelling through audiobooks, audio series, and podcasts across multiple languages. With millions of monthly active users and a vast creator community, we are redefining how content is consumed in the audio-first world.Key ResponsibilitiesDesign,...

  • Senior Data Engineer

    4 weeks ago

    Ahmedabad, Gujarat, India ConsultMeIn Private Limited Full time

    Mandatory Active Python Coding Experience of 5+ Years.Role : Data Engineering Manager.Experience : 6 12 Years.Location : Ahmedabad (work from office).Are you passionate about building modern data platforms and leading high-performing engineering teams? We're seeking a Data Engineering Manager to drive the design, development, and deployment of scalable...