Lead Big Data Architect

3 hours ago

Vadodara, Gujarat, India beBeeDataEngineer Full time ₹ 2,05,43,257 - ₹ 2,51,52,929
Job Title: Lead Big Data Architect

This role involves designing and implementing highly scalable, distributed SaaS-based security risk prioritization products.

  • The ideal candidate will have expertise in big data solutions using Spark and experience with engineering resources for innovation.
  • They will be responsible for delivering roadmap features of Enterprise TruRisk Platform, helping customers measure, communicate, and eliminate cyber risks.

Key Responsibilities:

  1. Prototyping, designing, developing, and supporting a highly scalable distributed SaaS-based Security Risk Prioritization product.
  2. Building Qualys' next-generation platform using Big Data & Micro-Services based technology.
  3. Leverage open-source technologies to process billions of transactions per day.

Required Skills and Qualifications:

  • Bachelor's degree in computer science or equivalent.
  • 8+ years of total experience.
  • 4+ years of relevant experience in design and architecture Big Data solutions using Spark.
  • 3+ years of experience working with engineering resources for innovation.
  • 4+ years of experience understanding Big Data events flow pipeline.
  • 3+ years of experience in performance testing for large infrastructure.
  • 3+ years of in-depth experience understanding various search solutions (Solr/Elastic).
  • 3+ years of experience with Kafka.
  • In-depth experience with Data Lakes and related ecosystems.
  • In-depth experience with messaging queues.
  • In-depth experience giving requirements to build scalable architecture for Big Data and Micro-services environments.
  • In-depth experience understanding caching components or services.
  • Knowledge of Presto technology.
  • Knowledge of Airflow.
  • Hands-on experience in scripting and automation.
  • In-depth understanding of RDBMS/NoSQL, Oracle, Cassandra, Kafka, Redis, Hadoop, Lambda Architecture, Kappa, Kappa++ architectures with Flink data streaming and rule engines.
  • Experience working with ML models engineering and related deployment.
  • Design and implement secure big data clusters to meet many compliances and regulatory requirements.
  • Experience leading the delivery of large-scale systems focused on managing the infrastructure layer of the technology stack.
  • Strong experience in doing performance benchmarking testing for Big Data technologies.
  • Strong troubleshooting skills.
  • Experience leading development life cycle processes and best practices.
  • Experience in Big Data services administration would be added value.
  • Experience with Agile Management (Scrum, RUP, XP), OO Modeling, working on internet, UNIX, Middleware, and database-related projects.
  • Experience mentoring/training the engineering community on complex technical issues.
  • Project management experience.

Benefits:

  • Come work at a place where innovation and teamwork come together to support exciting missions.
  • We are seeking a talented professional who can drive technology explorations and roadmaps.

  • Data Architect Lead

    23 hours ago

    Vadodara, Gujarat, India beBeeArchitect Full time ₹ 1,72,80,000 - ₹ 2,59,20,000

    Job Overview:We are seeking a highly skilled Data Architect Lead to spearhead our data strategy at a global scale.Key Responsibilities:Design and implement end-to-end data pipelines, ensuring seamless integration with Big Data tools and frameworksDevelop and maintain scalable data architectures, driving business value through efficient data processing and...

  • Lead Big Data Architect

    1 week ago

    Vadodara, Gujarat, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Description:We are seeking a highly skilled Data Engineer to join our team of consultants.In this role, you will be responsible for designing, constructing, and optimizing large-scale data processing systems that enable advanced analytics and business intelligence.You will collaborate closely with data scientists, analysts, and other engineers to ensure...

  • Senior Big Data Architect

    1 week ago

    Vadodara, Gujarat, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Big Data Engineer LeadWe are seeking a skilled and experienced Big Data Engineer to lead our team in designing, developing, and maintaining large-scale data systems.This is a key role that requires a strong technical background, excellent leadership skills, and the ability to work collaboratively with cross-functional teams.Job Description:In this role, you...

  • Big Data Hadoop Developer

    4 days ago

    Vadodara, Gujarat, India beBeeData Full time ₹ 9,00,000 - ₹ 13,50,000

    Expert Data Solutions ArchitectWe are seeking an experienced professional to lead the design and implementation of scalable data processing solutions using Hadoop, Spark, and Scala.Key Responsibilities:Develop, refine, and optimize queries to enhance performance.Work on big data ecosystem tools such as Hive and HDFS.Strong foundation in object-oriented...

  • Big Data Administrator

    3 hours ago

    Vadodara, Gujarat, India beBeebigdata Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    About UsWe are a leading organization in the field of big data and cloud technology. Our mission is to empower businesses to innovate and succeed through our expertise.

  • Big Data and Cloud Expert

    4 days ago

    Vadodara, Gujarat, India beBeeCloud Full time ₹ 15,00,000 - ₹ 20,00,000

    About the RoleWe are seeking an experienced Cloud and Big Data Architect to join our team at our Global Solution Centre in Bengaluru.Main Responsibilities:Design and develop hybrid cloud architectures for big data processing and storage.Migrate on-premises applications and databases to the cloud, ensuring seamless integration and data governance.Ensure data...

  • Big Data Expert

    1 week ago

    Vadodara, Gujarat, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Senior Big Data EngineerWe are seeking a talented Senior Big Data Engineer to join our Professional Services team. As a key member of our engineering group, you will play a critical role in designing, building, and maintaining high-performance data pipelines that process massive amounts of data.This is an exciting opportunity to leverage your expertise in...

  • Cloud Data Architect

    24 hours ago

    Vadodara, Gujarat, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Big Data Engineering ExpertJob Description:We are seeking a seasoned Big Data Engineer to join our team. This is a challenging opportunity for an experienced professional to leverage their technical expertise in designing and implementing scalable data engineering solutions.The ideal candidate will bring strong hands-on experience in architecting, building,...

  • Data Engineering Lead

    2 days ago

    Vadodara, Gujarat, India beBeeData Full time ₹ 10,00,000 - ₹ 15,00,000

    Job Title: Data Architect LeaderRole OverviewLead the development of robust data engineering platforms and analytics solutions.Key Responsibilities:Design and implement highly available data and analytics platforms with a minimum of 9-12 years of professional experience in the field.Breathe life into data-driven solutions for analytics and science by...

  • Lead Data Innovator

    2 days ago

    Vadodara, Gujarat, India beBeeData Full time ₹ 18,00,000 - ₹ 23,00,000

    Job TitleChief Data ArchitectJob DescriptionWe are seeking a skilled Chief Data Architect to lead the technical aspects of implementing data pipeline and migration requirements, ensuring that our platform is being used to its fullest potential.The ideal candidate will have experience in designing and building applications around business stakeholder needs,...