Big Data Engineer Lead

2 days ago


Kolkata, West Bengal, India beBeeBigDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000
Job Description

We are seeking a visionary Data Architecture Specialist to spearhead the development of our Enterprise TruRisk Platform.

As a key member of our engineering team, you'll be responsible for designing, developing, and supporting a highly scalable, distributed SaaS-based Security Risk Prioritization product.

This cutting-edge solution leverages big data and micro-services technology to work with billions of transactions daily, pushing the boundaries of innovation and excellence.

Key Responsibilities:
  • Be the thought leader in data platform and pipeline along with risk evaluation
  • Provide technical leadership on data platform design, roll out, and evolution
  • Liaison to product teams, professional services, and sales engineers on solution and trade-off reviews
  • Drive technology explorations and roadmaps
  • Ensure the quality of architecture and design of systems
Qualifications
  • Bachelor's degree in computer science or equivalent
  • 8+ years of total experience
  • 4+ years of relevant experience in design and architecture of big data solutions using Spark
  • In-depth experience in understanding big data events flow pipeline, performance testing, search solutions, Kafka, data lakes, messaging queues, caching components, and Presto/Airflow technology
  • Knowledge of RDBMS/NoSQL, Oracle, Cassandra, Redis, Hadoop, lambda architecture, and kappa/kappa++ architectures
  • Experience in working with ML models engineering and related deployment

  • Big Data Innovator

    5 days ago


    Kolkata, West Bengal, India beBeeGcpEngineer Full time ₹ 18,00,000 - ₹ 30,00,000

    Data Engineer Role">This is an exciting opportunity to work as a Data Engineer in our organization. We are looking for someone who can design, develop, and optimize data pipelines using GCP BigQuery, Dataflow, and Apache Airflow to support large-scale data analytics. As a Data Engineer, you will be responsible for utilizing the Big Data Hadoop ecosystem to...


  • Kolkata, West Bengal, India beBeeBigData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job OverviewAs a Senior Big Data Engineer, you will be responsible for leading big data initiatives and driving business outcomes through technical innovation. The ideal candidate will have experience in managing large-scale data systems, designing and implementing efficient ingestion, transformation, and enrichment pipelines."],


  • Kolkata, West Bengal, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job OpportunitySr. Data Architect - Big Data SpecialistWe are seeking a highly skilled and experienced Senior Data Architect to join our team as a Big Data Specialist. As a key member of our data engineering team, you will be responsible for designing, developing, and implementing large-scale data processing systems using Big Data technologies.You will lead...


  • Kolkata, West Bengal, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 25,50,000

    Big Data Engineer Role\This role involves leading the development of high-performance big data solutions. The ideal candidate will have 8+ years of experience in big data development and engineering, with strong hands-on expertise in Hadoop, Hive, HDFS, Apache Spark, and Kafka.\The key responsibilities include performing hands-on big data development work,...


  • Kolkata, West Bengal, India beBeeData Full time ₹ 0 - ₹ 1

    Big Data Specialist\We are seeking a skilled Big Data Specialist to drive data innovation and growth across our global operations.\The ideal candidate will have at least 5-8 years of experience in big data engineering with strong expertise in:\Key Technologies:\Palantir Foundry / WorkshopPySparkTypescript\About the Role:\You will leverage your expertise in...


  • Kolkata, West Bengal, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Software Engineering ProfessionalWe are looking for an experienced Software Engineering Professional to join our team.This is a highly demanding role that requires the ability to design and implement scalable data architectures, develop and optimize ETL/ELT pipelines, and perform data ingestion, transformation, and orchestration across structured...

  • Big Data Specialist

    6 days ago


    Kolkata, West Bengal, India beBeeDataEngineer Full time US$ 8,00,000 - US$ 12,00,000

    Job Title: Big Data Specialist About the Role:We are seeking a highly skilled professional to join our team as a Data Engineer. As a Data Engineer, you will be responsible for designing and developing scalable data architectures, ensuring high-performance data processing, and optimizing data quality. Key Responsibilities:Design and develop scalable data...


  • Kolkata, West Bengal, India beBeeData Full time ₹ 1,00,00,000 - ₹ 2,50,00,000

    Cloud Data EngineerAzure Databricks engineers design, implement, and manage scalable big data processing pipelines on the cloud.Key Responsibilities:Develop and maintain large-scale ETL processes using Azure Databricks.Collaborate with cross-functional teams to integrate data pipelines with business applications.Ensure data quality, security, and compliance...


  • Kolkata, West Bengal, India beBeeTechnical Full time US$ 1,80,000 - US$ 2,50,000

    Job DescriptionWe are seeking a seasoned professional to lead our team of engineers in building a scalable and extensible big data platform.The ideal candidate will have a strong track record of relevant work experience and a computer science or related technical discipline.Responsibilities include:Aligning the organization with key client...


  • Kolkata, West Bengal, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Key Results and Activities:Study the existing data landscape and understand the current integration framework, performing impact assessments as required.Develop Spark jobs using Scala for new project requirements, enhancing efficiency and productivity.Improve existing Spark jobs for ongoing product enhancements, ensuring optimal performance and results.Tune...