Senior Big Data Expert

2 days ago

Guntur, Andhra Pradesh, India beBeeBigData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000
Big Data Engineer Position

We are seeking a highly skilled and experienced Big Data Engineer to join our team. As a key member of our engineering organization, you will be responsible for delivering high-quality features of our Enterprise TruRisk Platform.

This platform helps customers measure, communicate, and eliminate cyber risks. You will work closely with a team of engineers and architects to prototype, design, develop, and support a highly scalable, distributed SaaS-based Security Risk Prioritization product.

This is an excellent opportunity to be part of a team building Qualys' next-generation platform using Big Data & Micro-Services based technology to process over billions of transactions data per day.

You will leverage open-source technologies and work on challenging and business-impacting initiatives.

Key Responsibilities:
  • Lead the development of data platforms and pipelines along with risk evaluation.
  • Provide technical guidance to the engineering organization on data platform design, roll out, and evolution.
  • Serve as a liaison to product teams, professional services, and sales engineers on solution and trade-off reviews and represent engineering in such conversations.
  • Drive technology explorations and roadmaps.
  • Ensure the quality of architecture and design of systems.
Qualifications:
  • Bachelor's degree in computer science or equivalent.
  • 8+ years of total experience.
  • 4+ years of relevant experience in design and architecture Big Data solutions using Spark.
  • 3+ years of experience working with engineering resources for innovation.
  • 4+ years of experience understanding Big Data events flow pipeline.
  • 3+ years of experience in performance testing for large infrastructure.
  • 3+ In-depth experience in understanding various search solutions solr/elastic.
  • 3+ years of experience in Kafka.
  • In-depth experience in Data lakes and related ecosystems.
  • In-depth experience of messaging queue.
  • In-depth experience in giving requirements to build a scalable architecture for Big Data and Micro-services environments.
  • In-depth experience in understanding caching components or services.
  • Knowledge in Presto technology.
  • Knowledge in Airflow.
  • Hands-on experience in scripting and automation.
  • In-depth understanding of RDBMS/NoSQL, Oracle, Cassandra, Kafka, Redis, Hadoop, lambda architecture, kappa, kappa++ architectures with Flink data streaming and rule engines.
  • Experience in working with ML models engineering and related deployment.
  • Design and implement secure Big Data clusters to meet many compliance and regulatory requirements.
  • Experience leading the delivery of large-scale systems focused on managing the infrastructure layer of the technology stack.
  • Strong experience in doing performance benchmarking testing for Big Data technologies.
  • Strong troubleshooting skills.
  • Experience leading development life cycle process and best practices.
  • Experience in Big Data services administration would be added value.
  • Experience with Agile Management (SCRUM, RUP, XP), OO Modeling, working on internet, UNIX, Middleware, and database-related projects.
  • Experience mentoring/training the engineering community on complex technical issues.
  • Project management experience.

  • Expert Big Data Professional

    6 days ago

    Guntur, Andhra Pradesh, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Expert Big Data ProfessionalWe are seeking a seasoned expert to fill the role of Big Data Hadoop Scala Engineer.Key Responsibilities:Design, develop and deploy large-scale data processing systems using Hadoop and Spark.Collaborate with cross-functional teams to identify business requirements and develop data-driven solutions.Stay up-to-date with...

  • Big Data Expert

    6 days ago

    Guntur, Andhra Pradesh, India beBeeData Full time ₹ 20,00,000 - ₹ 30,00,000

    Unlock the Power of Big Data">Greetings from our organization.We are currently seeking a professional with 6-12 years of experience in Big Data and related technologies, including PySpark/Scala Spark/Java Spark SQL to lead data-driven projects efficiently.Key skills we're looking for include:More than 5.8 years of experience in big data initiatives.A good...

  • Senior Big Data Specialist

    4 days ago

    Guntur, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,10,000

    Job OverviewWe are seeking a skilled and seasoned data engineer with strong expertise in SQL, big data processing, and modern data platforms.The ideal candidate will drive initiatives to develop and continuously improve the Data/AI Practice by designing, building, and optimising data pipelines for large-scale structured and unstructured datasets.Design and...

  • Big Data Specialist

    1 week ago

    Guntur, Andhra Pradesh, India beBeeBigData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Posting for Big Data SpecialistGreetings from our organization.We are seeking a seasoned Big Data Engineer to join our team. As a Big Data Specialist, you will be responsible for designing, developing, and implementing large-scale data processing systems using technologies such as PySpark and Hive.The ideal candidate should have at least 6 years of...

  • Big Data Cloud Solutions Specialist

    6 days ago

    Guntur, Andhra Pradesh, India beBeeCloud Full time ₹ 15,00,000 - ₹ 25,00,000

    Cloud Big Data ArchitectWe are looking for skilled and passionate experts in cloud computing with a strong focus on big data management and data quality skills.This is a full-time role offering flexibility for remote work, requiring a minimum of 3–4 years of experience in Azure and overall professional experience of less than 10 years.Required Skills &...

  • Big Data Architect

    1 week ago

    Guntur, Andhra Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Big Data Architect We are seeking a skilled Big Data Architect to join our team. The ideal candidate will have experience with designing and implementing large-scale data systems. Key Responsibilities:Design and implement big data solutions using Apache Druid, Kafka, Hadoop, Spark, and Flink.Develop and maintain scalable data pipelines that meet...

  • Senior Big Data Solutions Architect

    3 days ago

    Guntur, Andhra Pradesh, India beBeeBigDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    We are seeking a skilled Big Data Engineer with expertise in AWS Cloud Services and Big Data technologies to design, architect, and implement scalable data engineering solutions.Key ResponsibilitiesDesign and develop Big Data architectures leveraging AWS services for large-scale, complex data processing.Build and maintain data pipelines using Spark (Scala)...

  • Big Data Professional

    1 week ago

    Guntur, Andhra Pradesh, India beBeeDataScience Full time ₹ 20,00,000 - ₹ 25,00,000

    Greetings from our Data Science teamKey Responsibilities:Leading big data projects with diverse skill sets.Requirements:Expertise in PySpark, Hive and Spark.Familiarity with HBase, DQ tool, Agile Scrum experience.Benefits:Exposure in data ingestion from disparate sources onto big data platform.Preferred Qualifications:5+ years of experience in data science...

  • Chief Big Data Architect

    1 week ago

    Guntur, Andhra Pradesh, India beBeeDataEngineer Full time US$ 1,80,000 - US$ 2,00,000

    Job Role: Senior Data EngineerOverview:We are seeking a skilled Data Engineer to design, build and maintain high-performance data pipelines that process large amounts of data. The ideal candidate will have strong expertise in big data technologies and experience working with data processing systems.Key Responsibilities:Data Pipeline Design: Develop scalable...

  • Big Data Engineer

    6 days ago

    Guntur, Andhra Pradesh, India beBeeData Full time ₹ 1,44,00,000 - ₹ 2,16,00,000

    As a Big Data Engineer, you will play a key role in designing and executing large-scale distributed data systems.You will be responsible for monitoring performance and optimizing existing projects, researching new technologies and integrating them into our platform.The ideal candidate has 2 to 4 years of experience with big data technologies such as Apache...