High Performance Data Engineer

22 hours ago

Nashik, Maharashtra, India beBeeDataEngineer Full time US$ 1,25,000 - US$ 1,75,000

Data Engineer - About Our Company We are a leading SEO and content performance marketing platform that transforms online content into tangible business results. Our platform processes massive amounts of data to provide actionable insights to our clients.

Job Overview

We're looking for a talented Data Engineer to join our team to help us scale and optimize our data processing capabilities. As a Data Engineer, you will design, build, and maintain high-performance data pipelines that process terabytes of data. You'll work on optimizing our existing systems, identifying and resolving performance bottlenecks, and implementing solutions that improve the overall efficiency of our platform. This role is critical in ensuring our data infrastructure can handle increasing volumes of data while maintaining exceptional performance standards.

Key Responsibilities

  • Design and implement scalable batch processing systems using Python and big data technologies
  • Optimize database performance, focusing on slow-running queries and latency improvements
  • Use Python profilers and performance monitoring tools to identify bottlenecks
  • Reduce P95 and P99 latency metrics across our data platform
  • Build efficient ETL pipelines that can handle large-scale data processing
  • Collaborate with data scientists and product teams to understand data requirements
  • Monitor and troubleshoot data pipeline issues in production
  • Implement data quality checks and validation mechanisms
  • Document data architecture and engineering processes
  • Stay current with emerging big data technologies and best practices

Qualifications Required

  • Bachelor's degree in Computer Science, Engineering, or related technical field
  • 4+ years of experience in data engineering roles
  • Strong Python programming skills with focus on data processing libraries
  • Experience with big data technologies (Spark, Hadoop, etc.)
  • Proven experience optimizing database performance (SQL or NoSQL)
  • Knowledge of data pipeline orchestration tools (Airflow, Luigi, etc.)
  • Understanding of performance optimization techniques and profiling tools
  • Experience with cloud platforms (AWS, GCP, or Azure)
  • Ability to translate business requirements into technical specifications
  • Ability to work in UK timezone

Preferred Qualifications

  • Master's degree in Computer Science or related field
  • Experience with SEO data or web crawling systems
  • Experience with Clickhouse Database
  • Knowledge of distributed systems and microservices architecture
  • Familiarity with container orchestration (Kubernetes, Docker)
  • Experience with real-time data processing
  • Contributions to open-source projects

Skills and Abilities

  • Strong analytical thinking and problem-solving skills
  • Excellent attention to detail and commitment to data quality
  • Ability to work effectively in a collaborative team environment
  • Good communication skills to explain complex technical concepts
  • Self-motivated with ability to work independently
  • Passion for performance optimization and efficiency

  • High-Performance Data Engineer

    13 hours ago

    Nashik, Maharashtra, India beBeeDataEngineering Full time ₹ 1,80,00,000 - ₹ 2,40,00,000

    We're seeking a Data Engineering expert to design and implement large-scale data infrastructures for real-time data processing.Key ResponsibilitiesDeveloped high-performance data pipelines using Kafka, Flink, and Spark.Built scalable data architectures to support efficient data processing.Maintained data quality through robust data modeling and ETL...

  • High-Performance Data Pipeline Specialist

    2 weeks ago

    Nashik, Maharashtra, India beBeeCloudEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    We are seeking a skilled Cloud Engineer who is passionate about developing and deploying data pipeline solutions with Python.The ideal candidate will have hands-on experience with the Flask framework, Google Cloud Platform, serverless solutions like Cloud Run and Cloud Functions, as well as different data solutions and databases such as BigQuery, Cloud SQL,...

  • High-Performance Frontend Architect

    13 hours ago

    Nashik, Maharashtra, India beBeeFrontend Full time ₹ 80,00,000 - ₹ 1,20,00,000

    Senior Front End Developer Job DescriptionWe are seeking a skilled Senior Front End Engineer to shape our frontend architecture with modern tools like Next.js and Vite, leveraging the React ecosystem to create delightful, performant, and scalable experiences.Job OverviewThe ideal candidate will have a deep understanding of JavaScript/TypeScript, React,...

  • Performance Test Engineer

    7 hours ago

    Nashik, Maharashtra, India People Prime Worldwide Full time

    About Company :They balance innovation with an open, friendly culture and the backing of a long-established parent company, known for its ethical reputation. We guide customers from what's now to what's next by unlocking the value of their data and applications to solve their digital challenges, achieving outcomes that benefit both business and society.About...

  • Senior Data Engineer

    1 day ago

    Nashik, Maharashtra, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job OpportunitySeeking a seasoned leader to spearhead data engineering initiatives, leveraging expertise in Big Data platforms and cloud-native environments.About the RoleThe ideal candidate will direct a team of talented data engineers, guiding them in designing and delivering scalable data pipelines and analytics platforms that prioritize high performance,...

  • Senior Data Engineer

    2 weeks ago

    Nashik, Maharashtra, India SPIRO Full time

    Position: Senior Data Engineer Location: Pune Experience: 5+ yearsJob Summary:We are seeking an experienced Senior Data Engineer with a strong background in PySpark, Spark, and Big Data technologies. The ideal candidate will have over five years of hands-on experience designing, building, and optimizing large-scale data processing systems and pipelines.Key...

  • High Salary) Project Engineer

    3 weeks ago

    Nashik, Maharashtra, India ABB Full time

    Project Engineer - Low Voltage SwitchgearAt ABB, we are dedicated to addressing global challenges. Our core values: care, courage, curiosity, and collaboration - combined with a focus on diversity, inclusion, and equal opportunities - are key drivers in our aim to empower everyone to create sustainable solutions.Write the next chapter of your ABB story.This...

  • High-Performance Platform Professional

    2 days ago

    Nashik, Maharashtra, India beBeePlatform Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Staff EngineerAbout the RoleWe are seeking a seasoned Platform Engineer to join our team. This role will play a critical part in designing, building, and maintaining internal platforms and tools that enable software development teams to work efficiently and effectively.As a Staff Engineer, you will design and implement golden paths to streamline...

  • High-Performance API Developer

    4 days ago

    Nashik, Maharashtra, India beBeeSenior Full time ₹ 15,00,000 - ₹ 20,00,000

    We are seeking a highly skilled and experienced Senior API Developer to design, develop, and manage scalable, secure, and high-performance API solutions.Key ResponsibilitiesDesign, develop, and deploy APIs using APIGEE Edge / APIGEE X.Implement API proxies, policies (security, traffic management, mediation, etc.), and custom scripts.Collaborate with...

  • Senior Data Engineer

    1 day ago

    Nashik, Maharashtra, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    About this roleWe're looking for a skilled data engineer to join our team and take on the challenge of unlocking hidden value in marketing platforms.The mission is to extract every possible byte of data from these platforms, uncovering the 90% of capabilities that others often overlook.As a data engineer, your focus will be on building real-time monitoring...