Big Data Specialist

13 hours ago

Malappuram, Kerala, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

Reimagining Data Infrastructure for Enhanced Performance

We are seeking a seasoned Data Engineer to join our team and contribute to the development of high-performance data pipelines that process massive amounts of data. The ideal candidate will have experience in designing, building, and maintaining scalable batch processing systems using Python and big data technologies.

The successful candidate will be responsible for optimizing database performance, identifying and resolving performance bottlenecks, and implementing solutions that improve the overall efficiency of our platform. This role is critical in ensuring our data infrastructure can handle increasing volumes of data while maintaining exceptional performance standards.

Key Responsibilities:

  • Design and implement scalable batch processing systems using Python and big data technologies
  • Optimize database performance, focusing on slow-running queries and latency improvements
  • Use Python profilers and performance monitoring tools to identify bottlenecks
  • Reduce P95 and P99 latency metrics across our data platform
  • Build efficient ETL pipelines that can handle large-scale data processing

Qualifications Required:

  • Bachelor's degree in Computer Science or related field
  • 4+ years of experience in data engineering roles
  • Strong Python programming skills with focus on data processing libraries
  • Experience with big data technologies (Spark, Hadoop, etc.)
  • Proven experience optimizing database performance (SQL or NoSQL)

This role offers an opportunity to work on challenging projects, collaborate with experienced professionals, and contribute to the growth of our organization. If you are a motivated and detail-oriented individual with a passion for performance optimization, we encourage you to apply.

Benefits

  • Opportunity to work on challenging projects
  • Collaboration with experienced professionals
  • Contribution to the growth of our organization

Skills and Abilities

  • Strong analytical thinking and problem-solving skills
  • Excellent attention to detail and commitment to data quality
  • Ability to work effectively in a collaborative team environment
  • Good communication skills to explain complex technical concepts
  • Self-motivated with the ability to work independently

  • Big Data Specialist

    4 days ago

    Malappuram, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title:Big Data SpecialistJob Description:We are seeking a highly skilled Big Data Specialist to lead the design, development, and deployment of large-scale data systems. The ideal candidate will have expertise in Python and cloud technologies, preferably Azure.Responsibilities:Design, develop, and deploy big data systems to drive business growth and...

  • Big Data Specialist

    1 week ago

    Malappuram, Kerala, India beBeeDataSpecialist Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Big Data SpecialistAs a key member of our team, you will play a critical role in designing and developing large-scale data pipelines to ensure data is clean, secure, and accessible for analytics and operations.Responsibilities:Design scalable data architectures using Azure Data Factory and Databricks.Collaborate with cross-functional teams to...

  • Big Data Engineer

    2 days ago

    Malappuram, Kerala, India beBeeDataScientist Full time ₹ 20,00,000 - ₹ 30,00,000

    About Big Data Development RoleKey responsibilities for this position include performing hands-on big data development work, collaborating with junior engineers, reviewing code, and assisting in designing solutions using ETL processes.This involves working with Hadoop, Hive, HDFS, Apache Spark, and Kafka to integrate data from various sources. Strong...

  • Big Data Solutions Architect

    6 days ago

    Malappuram, Kerala, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Opportunity:We are seeking an experienced Big Data Developer to drive data insights and inform business decisions.The ideal candidate will have a strong background in big data technologies, including Scala, AWS, and Python or Java.Key Responsibilities:Design and develop scalable big data architectures using Hadoop and Spark.Analyze large datasets to...

  • Big Data Administrator

    2 days ago

    Malappuram, Kerala, India beBeeDataLake Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    About This RoleOur client is a global technology consulting and digital solutions company that enables enterprises to reimagine business models and accelerate innovation through digital technologies. Powered by over 84,000 professionals across more than 30 countries, it caters to numerous clients with its extensive domain and technology expertise to help...

  • Big Data Professional

    3 days ago

    Malappuram, Kerala, India beBeeData Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    About Our Data Expert RoleWe are seeking a seasoned data professional with extensive experience in working with large datasets. The ideal candidate will have a strong background in big data technologies, including Spark, SQL, Hive, and Scala.

  • Big Data Engineering Leader

    2 days ago

    Malappuram, Kerala, India beBeeDataEngineer Full time ₹ 24,00,000 - ₹ 36,00,000

    Job OverviewWe are seeking a skilled Big Data Engineering leader to join our team.The successful candidate will be responsible for designing, implementing, and maintaining large-scale big data systems. This includes leading the data platform and pipeline along with risk evaluation, providing technical leadership on data platform design, rollout, and...

  • Big Data Architect with Fabric

    6 days ago

    Malappuram, Kerala, India beBeeData Full time ₹ 9,00,000 - ₹ 12,00,000

    Job Title:Big Data Architect with FabricThe ideal candidate for this role will be a highly motivated and skilled data engineer who is passionate about designing, building, and maintaining large-scale data systems. This position requires expertise in big data technologies such as Hadoop, Spark, and NoSQL databases.

  • Chief Big Data Architect

    2 days ago

    Malappuram, Kerala, India beBeeBigDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Overview:A high-performing Big Data Engineering Leader oversees the development of scalable data solutions, collaborating closely with cross-functional teams to drive business outcomes.Key Responsibilities:Design and implement complex data pipelines using batch processing and real-time streaming technologies.Collaborate with stakeholders to define data...

  • Big Data Solutions Architect

    1 week ago

    Malappuram, Kerala, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 21,00,000

    Job OpportunityWe are seeking a highly skilled data engineering professional to join our team.The ideal candidate will have a strong background in big data technologies and experience with PySpark, Hive, Spark, HBase, DQ tool, and Agile Scrum methodologies.Key responsibilities include designing, developing, and maintaining large-scale data processing...