Big Data Processing Expert

1 week ago

Alleppey, Kerala, India beBeeDataEngineer Full time ₹ 1,44,00,000 - ₹ 2,04,00,000

Job Summary:

We are seeking a skilled Data Engineer to join our team. As a key member of our professional services, you will design, build, and maintain high-performance data pipelines that process large volumes of data.

About the Role:

In this role, you will work on optimizing our existing systems, identifying and resolving performance bottlenecks, and implementing solutions that improve the overall efficiency of our platform.

Your Key Responsibilities:

  • Design and implement scalable batch processing systems using Python and big data technologies.
  • Optimize database performance, focusing on slow-running queries and latency improvements.
  • Use Python profilers and performance monitoring tools to identify bottlenecks.
  • Reduce P95 and P99 latency metrics across our data platform.
  • Build efficient ETL pipelines that can handle large-scale data processing.
  • Collaborate with data scientists and product teams to understand data requirements.
  • Monitor and troubleshoot data pipeline issues in production.
  • Implement data quality checks and validation mechanisms.
  • Document data architecture and engineering processes.
  • Stay current with emerging big data technologies and best practices.

Qualifications:

  • Bachelor's degree in Computer Science, Engineering, or related technical field.
  • 4+ years of experience in data engineering roles.
  • Strong Python programming skills with focus on data processing libraries.
  • Experience with big data technologies (Spark, Hadoop, etc.).
  • Proven experience optimizing database performance (SQL or NoSQL).
  • Knowledge of data pipeline orchestration tools (Airflow, Luigi, etc.).
  • Understanding of performance optimization techniques and profiling tools.
  • Experience with cloud platforms (AWS, GCP, or Azure).
  • Ability to translate business requirements into technical specifications.
  • Ability to work effectively in a collaborative team environment.

What We Offer:

  • A competitive salary and benefits package.
  • The opportunity to work with a talented team of professionals.
  • Professional development and growth opportunities.
  • A dynamic and supportive work environment.

About Us:

We are a leading SEO and content performance marketing platform that transforms online content into tangible business results.

  • Big Data Expert

    3 days ago

    Alleppey, Kerala, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Big Data SpecialistWe are seeking an experienced professional to design and implement big data solutions using Scala Spark and related technologies. The ideal candidate will have a strong background in big data technologies, excellent problem-solving skills, and the ability to work with large datasets.Key Responsibilities:Develop and maintain complex data...

  • Data Architect

    3 days ago

    Alleppey, Kerala, India beBeeHadoop Full time ₹ 10,00,000 - ₹ 17,50,000

    Big Data Hadoop DeveloperWe are seeking a seasoned expert in big data technologies to drive the development of scalable and efficient solutions.About the PositionThe ideal candidate will possess hands-on experience with Hadoop ecosystem tools, including Scala, Spark, and Hive, as well as a strong understanding of object-oriented programming and HDFS...

  • Big Data Specialist

    7 days ago

    Alleppey, Kerala, India beBeeData Full time US$ 72,000 - US$ 1,80,000

    Welcome to our job post for a skilled Big Data professional.This is an exciting opportunity to work on large-scale data management and analysis.Key Responsibilities:Analyze complex data sets to identify trends and insightsDevelop and implement data processing pipelines using big data toolsRequired Skills:Mandatory Skills:

  • Senior Big Data Engineer

    3 days ago

    Alleppey, Kerala, India beBeeDataEngineer Full time ₹ 8,00,000 - ₹ 15,00,000

    Big Data Developer Job DescriptionThis is a challenging role that requires the design and development of big data pipelines using Scala, Python or Java. The ideal candidate will have 2+ years of experience in big data engineering and a strong understanding of big data concepts, including Hadoop and Spark.Key Responsibilities:Develop big data pipelines that...

  • Big Data Cloud Architect

    3 days ago

    Alleppey, Kerala, India beBeecloud Full time ₹ 40,00,000 - ₹ 50,00,000

    Big Data Cloud ArchitectWe are seeking a skilled Big Data Cloud Architect to join our team."],

  • Big Data Systems Architect

    1 day ago

    Alleppey, Kerala, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Data Engineering RoleWe are seeking a Senior Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data processing systems.You will work closely with cross-functional teams, including analytics and business teams, to improve data models that feed business...

  • Big Data Engineer

    15 hours ago

    Alleppey, Kerala, India beBeeData Full time ₹ 19,42,500 - ₹ 25,15,000

    As a data engineer, you will be responsible for designing and developing large-scale data pipelines using Azure Databricks. This is an exciting opportunity to work with big data technologies such as Spark, Hadoop, and NoSQL databases.About the RoleDevelop ETL (Extract, Transform, Load) processes to integrate data from various sources.Requirements5-12 years...

  • Unlock the Power of Big Data as a Senior Data Engineer

    6 days ago

    Alleppey, Kerala, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    Senior Data EngineerWe are seeking a skilled Senior Data Engineer to join our team.This is a full-time role for a highly experienced ETL Developer based in Bengaluru, working with one of our esteemed overseas clients. The role involves understanding requirements, designing, developing, and testing of ETL architecture, transformation jobs, and workflow...

  • Data Scientist

    3 days ago

    Alleppey, Kerala, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job OpportunityWe're seeking a talented Data Engineer with expertise in cloud computing platforms, technologies, and data engineering best practices to build scalable and efficient data solutions that support menu and marketing analytics.Design and implement data pipelines that ensure reliable and high-quality menu data.Collaborate with cross-functional...

  • Process Transformation Expert

    15 hours ago

    Alleppey, Kerala, India beBeeDataTransformation Full time ₹ 5,00,000 - ₹ 10,00,000

    Job Opportunity:Process Transformation ExpertSignavio Process Manager is a powerful tool for creating and designing process models. We are seeking an experienced professional to utilize this software, leveraging industry-standard methodologies to drive business process improvement.Key Responsibilities Include:Create detailed process maps in Signavio Process...