Senior Data Engineer

24 hours ago

bangalore, India BrightEdge Full time

Big Data Engineer - BrightEdge About Us BrightEdge is a leading SEO and content performance marketing platform that transforms online content into tangible business results. Our platform processes massive amounts of data to provide actionable insights to our clients. We're looking for a talented Big Data Engineer to join our Professional Services to help us scale and optimize our data processing capabilities.


Role Overview

As a Big Data Engineer at BrightEdge, you will design, build, and maintain high-performance data pipelines that process terabytes of data. You'll work on optimizing our existing systems, identifying and resolving performance bottlenecks, and implementing solutions that improve the overall efficiency of our platform. This role is critical in ensuring our data infrastructure can handle increasing volumes of data while maintaining exceptional performance standards.


Key Responsibilities

● Design and implement scalable batch processing systems using Python and big data technologies

● Optimize database performance, focusing on slow-running queries and latency improvements

● Use Python profilers and performance monitoring tools to identify bottlenecks

● Reduce P95 and P99 latency metrics across our data platform

● Build efficient ETL pipelines that can handle large-scale data processing

● Collaborate with data scientists and product teams to understand data requirements

● Monitor and troubleshoot data pipeline issues in production

● Implement data quality checks and validation mechanisms

● Document data architecture and engineering processes

● Stay current with emerging big data technologies and best practices


Qualifications Required

● Bachelor's degree in Computer Science, Engineering, or related technical field

● 4+ years of experience in data engineering roles

● Strong Python programming skills with focus on data processing libraries

● Experience with big data technologies (Spark, Hadoop, etc.)

● Proven experience optimizing database performance (SQL or NoSQL)

● Knowledge of data pipeline orchestration tools (Airflow, Luigi, etc.)

● Understanding of performance optimization techniques and profiling tools

● Experience with cloud platforms (AWS, GCP, or Azure)

● Ability to translate business requirements into technical specifications

● Ability to work in UK timezone (12 PM IST to 9:30 PM IST)


Preferred

● Master's degree in Computer Science or related field

● Experience with SEO data or web crawling systems

● Experience with Clickhouse Database

● Knowledge of distributed systems and microservices architecture

● Familiarity with container orchestration (Kubernetes, Docker)

● Experience with real-time data processing

● Contributions to open-source projects

● Experience with machine learning operations Skills and Abilities

● Strong analytical thinking and problem-solving skills

● Excellent attention to detail and commitment to data quality

● Ability to work effectively in a collaborative team environment

● Good communication skills to explain complex technical concepts

● Self-motivated with the ability to work independently

● Passion for performance optimization and efficiency

  • Senior Data Engineer

    24 hours ago

    bangalore, India Publicis Production Full time

    Job Summary:We are seeking a proactive and self-motivated Senior Data Engineer with a proven track record in building scalable cloud-based data solutions across multiple cloud platforms to support our work in architecting, building and maintaining the data infrastructure. The specific focus for this role will start with GCP however we require experience with...

  • Senior Engineer, Data Engineering

    2 days ago

    Bangalore, India EVERSANA Full time

    Our global team of more than 7,000 employees is committed to creating and delivering next-generation commercialization services to the life sciences industry. We are grounded in our cultural beliefs and serve more than 650 clients ranging from innovative biotech start-ups to established pharmaceutical companies. Our products, services and solutions help...

  • Senior Data Engineer

    19 hours ago

    Bangalore, India Tata Consultancy Services Full time

    Greetings from TCS!!! TCS has been a great pioneer in feeding the fire of Techies like you. We are a global leader in the technology arena and there’s nothing that can stop us from growing together. Your role is of key importance, as it lays down the foundation for the entire project. Make sure you have a valid EP number before the interview. To create...

  • Senior Data Engineer

    2 days ago

    Bangalore, India Benchire Full time

    Hi, We are Hiring for a Senior data Engineer with 6-8 years of Experience for a IT Services company based in Bangalore . Requirements: · Min 6-8 years of professional experience · Minimum of three years of professional experience with Python · Professional experience in the field of data (e.g., data science, data engineering, data warehousing) ·...

  • Senior Data Engineer

    22 hours ago

    bangalore, India Benchire Full time

    Hi, We are Hiring for a Senior data Engineer with 6-8 years of Experience for a IT Services company based in Bangalore .Requirements:· Min 6-8 years of professional experience· Minimum of three years of professional experience with Python· Professional experience in the field of data (e.g., data science, data engineering, data warehousing)· Experience...

  • Senior Data Engineer

    24 hours ago

    bangalore, India HealthyMe Ai Full time

    About the RoleWe are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data. You will report to the Head of AI and Engineering and be responsible for designing, building, and operating the backbone of our AI-powered applications. This is a critical role where you will create scalable pipelines that...

  • Senior Data Engineer

    2 days ago

    Bangalore, India JRD Systems Full time

    We are seeking a Senior Data Engineer with deep expertise in AWS Cloud Development . This role is critical to both the development of new data products and the modernization of existing platforms. The ideal candidate is a seasoned data engineer with hands-on experience designing, building, and optimizing large-scale data pipelines and architectures ...

  • Senior Data Engineer

    16 hours ago

    Bangalore, India JRD Systems Full time

    We are seeking a Senior Data Engineer with deep expertise in AWS Cloud Development . This role is critical to both the development of new data products and the modernization of existing platforms. The ideal candidate is a seasoned data engineer with hands-on experience designing, building, and optimizing large-scale data pipelines and architectures ...

  • Senior Data Engineer

    22 hours ago

    bangalore, India JRD Systems Full time

    We are seeking a Senior Data Engineer with deep expertise in AWS Cloud Development. This role is critical to both the development of new data products and the modernization of existing platforms.The ideal candidate is a seasoned data engineer with hands-on experience designing, building, and optimizing large-scale data pipelines and architectures in both...

  • Senior Data Engineer

    22 hours ago

    bangalore, India The Mastermind Group Full time

    Senior Data Engineer Location: Remote (India) – Occasional travel to Riyadh, KSAContract Type: 12-Month ContractWork Week: Sunday–Thursday preferred (9 AM – 5 PM IST)Start Date: As soon as possibleAbout The Mastermind Group (TMG)TMG is a global leader in IT Spend Optimisation, helping enterprises take control of their tech investments across software,...