Big Data Engineer

3 weeks ago


Pune, India Qualys Full time

We are seeking a talented Big Data Engineer to deliver roadmap features of Enterprise TruRisk Platform which would help customers to Measure, Communicate and Eliminate Cyber Risks.

Working with a team of engineers and architects, you will be responsible for prototyping, designing, developing and supporting a highly scalable, distributed SaaS based Security Risk Prioritization product.

This is a fantastic opportunity to be an integral part of a team building Qualys next generation platform using Big Data & Micro-Services based technology to process over billions of transactions data per day, leverage open-source technologies, and work on challenging and business-impacting initiatives.

Responsibilities:

  • Liason to product teams, professional services and sales engineers on solution and trade-off reviews and represent engineering in such conversations.
  • Support the team in technology explorations and roadmaps.
  • Functionally decompose complex problems into simple, straight-forward solutions.
  • Fully and completely understand system interdependencies and limitations.
  • Possess expert knowledge in performance, scalability, enterprise system architecture, and engineering best practices.
  • Leverage knowledge of internal and industry prior art in design decisions.
  • Effectively research and benchmark cloud technology against other competing systems in the industry.

Qualifications:

  • Bachelor’s degree in computer science or equivalent
  • 2+ years of total experience.
  • 2+ years of relevant experience in design and architecture Big Data solutions using Spark
  • 2+ years experience in working with engineering resources for innovation.
  • 2+ years experience in understanding Big Data events flow pipeline.
  • 2+ years experience in performance testing for large infrastructure.
  • Understanding various search solutions solr/elastic.
  • Understanding in Kafka
  • Knowledge in Presto technology.
  • Knowledge in Airflow.
  • Hands-on experience in scripting and automation
  • Understanding of RDBMS/NoSQL, Oracle , Cassandra , Kafka , Redis, Hadoop, lambda architecture, kappa , kappa ++ architectures with flink data streaming and rule engines
  • Experience in working with ML models engineering and related deployment.

  • Big Data Engineer

    1 day ago


    Pune, India Qualys Full time

    We are seeking a talented Big Data Engineer to deliver roadmap features of Enterprise TruRisk Platform which would help customers to Measure, Communicate and Eliminate Cyber Risks. Working with a team of engineers and architects, you will be responsible for prototyping, designing, developing and supporting a highly scalable, distributed SaaS based Security...

  • Big Data Engineer

    3 weeks ago


    pune, India Qualys Full time

    We are seeking a talented Big Data Engineer to deliver roadmap features of Enterprise TruRisk Platform which would help customers to Measure, Communicate and Eliminate Cyber Risks.Working with a team of engineers and architects, you will be responsible for prototyping, designing, developing and supporting a highly scalable, distributed SaaS based Security...

  • Big Data Engineer

    1 month ago


    Pune, India Angel and Genie Full time

    Lead/Senior Big Data Engineer Experience: 6 - 10 Years Location: Pune Type: Full-time Job Profile We are looking for a Big Data Engineer who will work on building, and managing Big Data Pipelines for us to deal with the huge structured data sets that we use as an input to accurately generate analytics at scale for our valued Customers. The primary focus will...

  • Big Data Engineer

    1 month ago


    Pune, India Angel and Genie Full time

    Lead/Senior Big Data EngineerExperience: 6 - 10 YearsLocation: PuneType: Full-timeJob ProfileWe are looking for a Big Data Engineer who will work on building, and managing Big Data Pipelines forus to deal with the huge structured data sets that we use as an input to accurately generate analytics atscale for our valued Customers. The primary focus will be on...

  • Big Data Engineer

    1 month ago


    Pune, India Angel and Genie Full time

    Lead/Senior Big Data EngineerExperience: 6 - 10 YearsLocation: PuneType: Full-timeJob ProfileWe are looking for a Big Data Engineer who will work on building, and managing Big Data Pipelines forus to deal with the huge structured data sets that we use as an input to accurately generate analytics atscale for our valued Customers. The primary focus will be on...

  • Big Data Engineer

    3 weeks ago


    Pune, India Qualys Full time

    We are seeking a talented Big Data Engineer to deliver roadmap features of Enterprise TruRisk Platform which would help customers to Measure, Communicate and Eliminate Cyber Risks. Working with a team of engineers and architects, you will be responsible for prototyping, designing, developing and supporting a highly scalable, distributed SaaS based Security...

  • Big Data Engineer

    3 weeks ago


    Pune, India Qualys Full time

    We are seeking a talented Big Data Engineer to deliver roadmap features of Enterprise TruRisk Platform which would help customers to Measure, Communicate and Eliminate Cyber Risks. Working with a team of engineers and architects, you will be responsible for prototyping, designing, developing and supporting a highly scalable, distributed SaaS based Security...

  • Lead Big Data Engineer

    2 months ago


    pune, India Qualys Full time

    We are seeking a talented Lead Big Data Engineer to deliver roadmap features of Enterprise TruRisk Platform which would help customers to Measure, Communicate and Eliminate Cyber Risks.Working with a team of engineers and architects, you will be responsible for prototyping, designing, developing and supporting a highly scalable, distributed SaaS based...

  • Big Data Engineer

    5 days ago


    Pune, India K-RY Tech Advisory Full time

    Requirements:Should haveminimum 3 years of experience on working Big DatatechnologiesGood Programmingskills.Hands on Experience in AutomatingBackend Applications (e.g. db REST API s)Handson experience with Automating any backend applications (e.g dbserver side).Knowledge of relational databasesand SQLGood debuggingskills.Strong working experience working...

  • Big Data Engineer

    4 days ago


    pune, India K-RY Tech Advisory Full time

    Requirements:Should haveminimum 3 years of experience on working Big Datatechnologies Good Programmingskills. Hands on Experience in AutomatingBackend Applications (e.g. db REST API s) Handson experience with Automating any backend applications (e.g dbserver side). Knowledge of relational databasesand SQL Good debuggingskills. Strong working experience...

  • Lead Big Data Engineer

    2 months ago


    Pune, India Qualys Full time

    We are seeking a talented Lead Big Data Engineer to deliver roadmap features of Enterprise TruRisk Platform which would help customers to Measure, Communicate and Eliminate Cyber Risks. Working with a team of engineers and architects, you will be responsible for prototyping, designing, developing and supporting a highly scalable, distributed SaaS based...

  • Big Data Engineer

    4 days ago


    Pune, India Enterprise Minds, Inc Full time

    Hi Folks, Greetings from Enterprise MInds!! We‘re thrilled to announce an exciting opportunity to join our dynamic team at Enterprise Minds. We are on the lookout for a passionate and talented ‘GCP Data Engineer‘ About us: Enterprise Minds India is a Product Engineering company headquartered in San Francisco, In India Bangalore. Hyderabad and Pune,...


  • Pune, India Qualys Full time

    Come work at a place where innovation and teamwork come together to support the most exciting missions in the world!We are seeking a talented Lead Big Data Engineer to deliver roadmap features of Enterprise TruRisk Platform which would help customers to Measure, Communicate and Eliminate Cyber Risks.Working with a team of engineers and architects, you will...

  • Senior Data Engineer

    4 weeks ago


    pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • Senior Data Engineer

    2 months ago


    Pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • Lead Big Data Engineer

    2 months ago


    pune, India Qualys Full time

    Come work at a place where innovation and teamwork come together to support the most exciting missions in the world! We are seeking a talented Lead Big Data Engineer to deliver roadmap features of Enterprise TruRisk Platform which would help customers to Measure, Communicate and Eliminate Cyber Risks. Working with a team of engineers and architects,...

  • Lead Big Data Engineer

    2 months ago


    Pune, India Qualys Full time

    Come work at a place where innovation and teamwork come together to support the most exciting missions in the world! We are seeking a talented Lead Big Data Engineer to deliver roadmap features of Enterprise TruRisk Platform which would help customers to Measure, Communicate and Eliminate Cyber Risks. Working with a team of engineers and architects, you...

  • Staff Engineer

    4 days ago


    Pune, India Seagate Full time

    We are a proactive, highly solutions oriented and collaborative team that works with all the various business groups across the organization. Our purpose is capturing massive amounts of data is to transform this vital information into concrete and valuable insights that will allow Seagate to make better and more strategic business decisions.If you're a...

  • Staff Engineer

    5 days ago


    Pune, India Seagate Full time

    We are a proactive, highly solutions oriented and collaborative team that works with all the various business groups across the organization. Our purpose is capturing massive amounts of data is to transform this vital information into concrete and valuable insights that will allow Seagate to make better and more strategic business decisions. If you're a...

  • Big Data Engineer

    2 months ago


    Pune, India Www.Huquo.com Full time

    Big Data Engineer( Lead assistant manager-Manager) Job Description : Must Have : Tech savvy engineer - willing and able to learn new skills, track industry trend.- 5 - 7 years of total experience of solid data engineering experience, especially in Open Source, data-intensive, distributed environments with minimum 5 years of experience in big data related...