High-Performance Data Architect

2 weeks ago

Ellore, Andhra Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

Big Data Engineer: Transforming Online Content into Business Results

About Us We're a leading SEO and content performance marketing platform that transforms online content into tangible business results. Our platform processes massive amounts of data to provide actionable insights.

Role Overview As a Big Data Engineer, you will design, build, and maintain high-performance data pipelines that process terabytes of data.

Key Responsibilities

  1. Design and implement scalable batch processing systems using Python and big data technologies
  2. Optimize database performance, focusing on slow-running queries and latency improvements
  3. Use Python profilers and performance monitoring tools to identify bottlenecks
  4. Reduce P95 and P99 latency metrics across our data platform
  5. Build efficient ETL pipelines that can handle large-scale data processing
  6. Collaborate with data scientists and product teams to understand data requirements
  7. Monitor and troubleshoot data pipeline issues in production
  8. Implement data quality checks and validation mechanisms
  9. Document data architecture and engineering processes
  10. Stay current with emerging big data technologies and best practices

Qualifications Required

  1. Bachelor's degree in Computer Science, Engineering, or related technical field
  2. 4+ years of experience in data engineering roles
  3. Strong Python programming skills with focus on data processing libraries
  4. Experience with big data technologies (Spark, Hadoop, etc.)
  5. Proven experience optimizing database performance (SQL or NoSQL)
  6. Knowledge of data pipeline orchestration tools (Airflow, Luigi, etc.)
  7. Understanding of performance optimization techniques and profiling tools
  8. Experience with cloud platforms (AWS, GCP, or Azure)
  9. Ability to translate business requirements into technical specifications
  10. Ability to work in UK timezone

Preferred

  1. Master's degree in Computer Science or related field
  2. Experience with SEO data or web crawling systems
  3. Experience with Clickhouse Database
  4. Knowledge of distributed systems and microservices architecture
  5. Familiarity with container orchestration (Kubernetes, Docker)
  6. Experience with real-time data processing
  7. Contributions to open-source projects
  8. Experience with machine learning operations Skills and Abilities Strong analytical thinking and problem-solving skills Excellent attention to detail and commitment to data quality Ability to work effectively in a collaborative team environment Good communication skills to explain complex technical concepts Self-motivated with the ability to work independently Passion for performance optimization and efficiency

  • Chief Data Transformation Officer

    4 days ago

    Ellore, Andhra Pradesh, India beBeeData Architect Full time ₹ 25,00,000 - ₹ 30,00,000

    Lead Large-Scale Data Engineering ProjectsAs a seasoned data architect, you will spearhead the development and implementation of cutting-edge data solutions. Your expertise in data integration, warehousing, and API-based integrations will be instrumental in transforming raw data sources into actionable insights.You will work closely with cross-functional...

  • High-Performance Redshift Data Engineer

    2 weeks ago

    Ellore, Andhra Pradesh, India beBeeRedshift Full time ₹ 30,00,000 - ₹ 40,00,000

    **Job Description**We are seeking a highly skilled Senior Redshift Engineer to support our clients in architecting, optimizing, and scaling AWS Redshift environments.Lead architecture review and validation for multiple AWS Redshift clustersValidate sizing assumptions and provide right-sizing recommendationsDefine and implement operational excellence best...

  • Data Architect

    4 days ago

    Ellore, Andhra Pradesh, India beBeeDataArchitect Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Data ArchitectAs a senior data architect, you will play a key role in designing and implementing data architectures that drive business value. Your expertise in data modeling, data warehousing, and big data technologies will be essential in ensuring the scalability and performance of our data platforms.

  • High-Performance Frontend Architect

    6 days ago

    Ellore, Andhra Pradesh, India beBeeSenior Full time ₹ 15,00,000 - ₹ 22,00,000

    About Our Role:We are seeking a highly skilled Senior Fullstack Developer to lead the launch of a new self-serve platform for our customers. The successful candidate will be responsible for spearheading the development of this new product and supporting its continued growth due to an increased demand from our customers.The ideal candidate will have...

  • High-Performance Data Developer

    1 week ago

    Ellore, Andhra Pradesh, India beBeeDataProfessional Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: High-Performance Data DeveloperWe are seeking an exceptional data professional to lead our application development, support, and enhancements. The ideal candidate will collaborate closely with the team to analyze business requirements, design robust technical solutions, and deliver high-quality software aligned with organizational standards and...

  • High-Performance Web Developer

    3 days ago

    Ellore, Andhra Pradesh, India beBeeSoftware Full time ₹ 20,00,000 - ₹ 25,00,000

    Expert Software EngineerWe are seeking a highly skilled and accomplished Expert Software Engineer to join our organization. This is an exceptional opportunity for a professional in Node.js and MongoDB to take on a leadership role and drive the design and development of scalable, high-performance web applications.Responsibilities:Lead the design and...

  • High-Performance Data Solutions Engineer

    2 weeks ago

    Ellore, Andhra Pradesh, India beBeeDatabricks Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Senior Databricks Data EngineerWe are seeking an accomplished data engineering professional to design, develop and maintain high-performance data pipelines using Databricks and PySpark. This role requires expertise in leveraging cloud services like AWS S3, Glue, Lambda, EMR, and Redshift to deliver scalable data solutions.Key Responsibilities:Design and...

  • Strategic Data Architect

    4 days ago

    Ellore, Andhra Pradesh, India beBeeData Full time ₹ 20,16,000 - ₹ 32,16,000

    Job Title: Strategic Data ArchitectWe are seeking a seasoned data architect to spearhead the design and implementation of scalable, secure, and high-performance data architectures across multiple cloud platforms.Key Responsibilities:Lead the development of robust data solutions that align with business objectives and drive revenue growth.Collaborate with...

  • Visionary Data Architect

    4 days ago

    Ellore, Andhra Pradesh, India beBeeData Full time ₹ 18,00,000 - ₹ 25,00,000

    Senior Lead Data EngineerTalent500 is seeking an experienced and visionary Senior Data Engineer to lead the design and implementation of scalable, high-performance data solutions.This role involves architecting and designing complex data pipelines using Databricks and Azure Data Services, leading the development of scalable data solutions using Python,...

  • Data Architect

    6 days ago

    Ellore, Andhra Pradesh, India beBeeDataArchitect Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Data ArchitectWe are seeking a highly skilled Data Architect to lead the development of our data infrastructure.Required Skills:• Proficient in Python and SQL, including popular libraries such as Pandas and NumPy.• Strong background in distributed data processing and storage technologies like Apache Spark and Hadoop.• Experience with...