▷ (Immediate Start) Senior Data Engineer

2 days ago


India BrightEdge Full time

Big Data Engineer - BrightEdge About Us BrightEdge is a leading SEO and content performance marketing platform that transforms online content into tangible business results. Our platform processes massive amounts of data to provide actionable insights to our clients. We're looking for a talented Big Data Engineer to join our Professional Services to help us scale and optimize our data processing capabilities.

Role Overview

As a Big Data Engineer at BrightEdge, you will design, build, and maintain high-performance data pipelines that process terabytes of data. You'll work on optimizing our existing systems, identifying and resolving performance bottlenecks, and implementing solutions that improve the overall efficiency of our platform. This role is critical in ensuring our data infrastructure can handle increasing volumes of data while maintaining exceptional performance standards.

Key Responsibilities

● Design and implement scalable batch processing systems using Python and big data technologies

● Optimize database performance, focusing on slow-running queries and latency improvements

● Use Python profilers and performance monitoring tools to identify bottlenecks

● Reduce P95 and P99 latency metrics across our data platform

● Build efficient ETL pipelines that can handle large-scale data processing

● Collaborate with data scientists and product teams to understand data requirements

● Monitor and troubleshoot data pipeline issues in production

● Implement data quality checks and validation mechanisms

● Document data architecture and engineering processes

● Stay current with emerging big data technologies and best practices

Qualifications Required

● Bachelor's degree in Computer Science, Engineering, or related technical field

● 4+ years of experience in data engineering roles

● Strong Python programming skills with focus on data processing libraries

● Experience with big data technologies (Spark, Hadoop, etc.)

● Proven experience optimizing database performance (SQL or NoSQL)

● Knowledge of data pipeline orchestration tools (Airflow, Luigi, etc.)

● Understanding of performance optimization techniques and profiling tools

● Experience with cloud platforms (AWS, GCP, or Azure)

● Ability to translate business requirements into technical specifications

● Ability to work in UK timezone (12 PM IST to 9:30 PM IST)

Preferred

● Master's degree in Computer Science or related field

● Experience with SEO data or web crawling systems

● Experience with Clickhouse Database

● Knowledge of distributed systems and microservices architecture

● Familiarity with container orchestration (Kubernetes, Docker)

● Experience with real-time data processing

● Contributions to open-source projects

● Experience with machine learning operations Skills and Abilities

● Strong analytical thinking and problem-solving skills

● Excellent attention to detail and commitment to data quality

● Ability to work effectively in a collaborative team environment

● Good communication skills to explain complex technical concepts

● Self-motivated with the ability to work independently

● Passion for performance optimization and efficiency



  • Hyderabad, India NTT Data Full time

    Job Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Senior GenAI Engineers to join our team in Hyderabad, Telangana (IN-TG), India (IN). Location: | Experience: 8+...


  • Bengaluru, India NTT DATA, Inc. Full time

    Job Description Make an impact with NTT DATA Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion its a place where you can grow, belong and thrive. Your day at NTT...


  • Chennai, India NTT Data Full time

    Job Description At NTT DATA, we know that with the right people on board, anything is possible. The quality, integrity, and commitment of our employees are key factors in our company's growth, market presence and our ability to help our clients stay a step ahead of the competition. By hiring the best people and helping them grow both professionally and...


  • Hyderabad, India NTT Data Full time

    Job Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a AI Architects to join our team in Hyderabad, Telangana (IN-TG), India (IN). Location: | Experience: 15+ years (5+...


  • India Microsoft Full time

    Job Description Are you looking for an opportunity to join a team of engineers in positively affecting the experience of every consumer who uses Microsoft products The OSSE team in OPG group is focused on building client experiences and services that light up Microsoft Account experiences across all devices and platforms. We are passionate about working...


  • Mumbai, India Optum Full time

    Job Description Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by inclusion,...


  • India The Reliable Jobs Full time

    We’re looking to hire a highly capable AI Engineer with 3–5 years of hands-on experience in building LLM-powered applications. The ideal candidate should have strong expertise in working with LLMs, agentic workflows, and RAG systems, along with a solid foundation in Python. The engineer will be available to join immediately and can work *fully remote*.


  • Bengaluru, India NTT Data Full time

    Job Description Req ID:332499 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Digital Solution Cnslt. Lead Consultant to join our team in Bangalore, Karntaka (IN-KA), India...


  • Bengaluru, India Accuris Full time

    Job Description Job Title: Associate Software Engineer Location: Hybrid (2 days per week in Bengaluru office) Experience: Fresher Job Type: Full-Time Job Description We are seeking enthusiastic and motivated Associate Software Engineers who have recently graduated and are eager to start their professional journey with Accuris. The ideal candidate will...


  • Gurugram, India NTT DATA North America Full time

    Job Description Req ID: 321966 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Java Lead to join our team in Gurgaon, Haryna (IN-HR), India (IN). - Manages, resolves, and system...