Big Data Engineer

3 weeks ago

pune, India Qualys Full time
We are seeking a talented Big Data Engineer to deliver roadmap features of Enterprise TruRisk Platform which would help customers to Measure, Communicate and Eliminate Cyber Risks.
Working with a team of engineers and architects, you will be responsible for prototyping, designing, developing and supporting a highly scalable, distributed SaaS based Security Risk Prioritization product.
This is a fantastic opportunity to be an integral part of a team building Qualys next generation platform using Big Data & Micro-Services based technology to process over billions of transactions data per day, leverage open-source technologies, and work on challenging and business-impacting initiatives.
Responsibilities:
Liason to product teams, professional services and sales engineers on solution and trade-off reviews and represent engineering in such conversations.
Support the team in technology explorations and roadmaps.
Functionally decompose complex problems into simple, straight-forward solutions.
Fully and completely understand system interdependencies and limitations.
Possess expert knowledge in performance, scalability, enterprise system architecture, and engineering best practices.
Leverage knowledge of internal and industry prior art in design decisions.
Effectively research and benchmark cloud technology against other competing systems in the industry.
Qualifications:
Bachelor’s degree in computer science or equivalent
2+ years of total experience.
2+ years of relevant experience in design and architecture Big Data solutions using Spark
2+ years experience in working with engineering resources for innovation.
2+ years experience in understanding Big Data events flow pipeline.
2+ years experience in performance testing for large infrastructure.
Understanding various search solutions solr/elastic.
Understanding in Kafka
Knowledge in Presto technology.
Knowledge in Airflow.
Hands-on experience in scripting and automation
Understanding of RDBMS/NoSQL, Oracle , Cassandra , Kafka , Redis, Hadoop, lambda architecture, kappa , kappa ++ architectures with flink data streaming and rule engines
Experience in working with ML models engineering and related deployment.

  • Big Data Engineer

    6 days ago

    Pune, Maharashtra, India Stratacent Full time

    Position Title:Big Data EngineerLocation:Pune/ BangaloreExperience : 5+ YearsShift Timings:UK ShiftPosition Summary:We seek an experienced Senior Big Data Engineer to lead and enhance our data engineering initiatives. The ideal candidate will possess advanced expertise in Impala, Spark, Scala, Hive, Hadoop, and other Big Data technologies. You will be...

  • Big Data Engineer

    2 weeks ago

    pune, India Stratacent Full time

    Position Title:  Big Data Engineer Location:  Pune/ Bangalore Experience : 5+ Years Shift Timings:  UK Shift Position Summary: We seek an experienced Senior Big Data Engineer to lead and enhance our data engineering initiatives. The ideal candidate will possess advanced expertise in Impala, Spark, Scala, Hive, Hadoop, and other Big Data technologies. You...

  • Big Data Engineer

    6 days ago

    Pune, Maharashtra, India Stratacent Full time

    Position Title: Big Data Engineer Location: Pune/ Bangalore Experience : 5+ Years Shift Timings: UK Shift Position Summary: We seek an experienced Senior Big Data Engineer to lead and enhance our data engineering initiatives. The ideal candidate will possess advanced expertise in Impala, Spark, Scala, Hive, Hadoop, and other Big Data technologies. You...

  • Big Data Engineer

    6 days ago

    Pune, Maharashtra, India Stratacent Full time

    Position Title: Big Data EngineerLocation: Pune/ BangaloreExperience: 5+ YearsShift Timings: UK ShiftPosition Summary:We seek an experienced Senior Big Data Engineer to lead and enhance our data engineering initiatives. The ideal candidate will possess advanced expertise in Impala, Spark, Scala, Hive, Hadoop, and other Big Data technologies. You will be...

  • Big Data Engineer

    4 weeks ago

    Pune, India Qualys Full time

    We are seeking a talented Big Data Engineer to deliver roadmap features of Enterprise TruRisk Platform which would help customers to Measure, Communicate and Eliminate Cyber Risks. Working with a team of engineers and architects, you will be responsible for prototyping, designing, developing and supporting a highly scalable, distributed SaaS based Security...

  • Big Data Engineer

    6 days ago

    Pune, Maharashtra, India Techno Wise Full time

    Job Role : Big Data EngineerRelevant Experience : 3+ yearsLocation : Navi Mumbai /Bengaluru/PuneNotice Period : Immediate or serving Notice PeriodPrimary Skills : Big Data, PySpark, Cloud- Azure or AWS, Databricks, SQL, PythonOverview :We are seeking a talented Big Data Engineer proficient in PySpark to join our dynamic team. The ideal candidate will play a...

  • Big Data Engineer

    6 days ago

    Pune, Maharashtra, India Qualys Full time

    We are seeking a talented Big Data Engineer to deliver roadmap features of Enterprise TruRisk Platform which would help customers to Measure, Communicate and Eliminate Cyber Risks. Working with a team of engineers and architects, you will be responsible for prototyping, designing, developing and supporting a highly scalable, distributed SaaS based Security...

  • Big Data Engineer

    2 months ago

    Pune, India Angel and Genie Full time

    Lead/Senior Big Data EngineerExperience: 6 - 10 YearsLocation: PuneType: Full-timeJob ProfileWe are looking for a Big Data Engineer who will work on building, and managing Big Data Pipelines forus to deal with the huge structured data sets that we use as an input to accurately generate analytics atscale for our valued Customers. The primary focus will be on...

  • Big Data Engineer

    2 months ago

    Pune, India Angel and Genie Full time

    Lead/Senior Big Data Engineer Experience: 6 - 10 Years Location: Pune Type: Full-time Job Profile We are looking for a Big Data Engineer who will work on building, and managing Big Data Pipelines for us to deal with the huge structured data sets that we use as an input to accurately generate analytics at scale for our valued Customers. The primary focus will...

  • Big Data Engineer

    2 months ago

    Pune, India Angel and Genie Full time

    Lead/Senior Big Data EngineerExperience: 6 - 10 YearsLocation: PuneType: Full-timeJob ProfileWe are looking for a Big Data Engineer who will work on building, and managing Big Data Pipelines forus to deal with the huge structured data sets that we use as an input to accurately generate analytics atscale for our valued Customers. The primary focus will be on...

  • Big Data Engineer

    6 days ago

    Pune, Maharashtra, India Draftmason Enterprises Full time

    Designation : Big Data EngineerExperience : - 8 YearsSalary Range : upto 30 LPAJob Location : Kharadi, PuneType Of Employment : FT, PermanentWorking Mode : Hybrid (3 days WFO)Working Days : Mon - FriReports To : Director - Data EngineeringThe Opportunity :We are looking for talented, motivated, and self-driven Big Data Engineers who specialize in data-driven...

  • Big Data Engineer

    1 month ago

    Pune, India Qualys Full time

    We are seeking a talented Big Data Engineer to deliver roadmap features of Enterprise TruRisk Platform which would help customers to Measure, Communicate and Eliminate Cyber Risks. Working with a team of engineers and architects, you will be responsible for prototyping, designing, developing and supporting a highly scalable, distributed SaaS based Security...

  • Big Data Engineer

    2 months ago

    Pune, India Qualys Full time

    We are seeking a talented Big Data Engineer to deliver roadmap features of Enterprise TruRisk Platform which would help customers to Measure, Communicate and Eliminate Cyber Risks. Working with a team of engineers and architects, you will be responsible for prototyping, designing, developing and supporting a highly scalable, distributed SaaS based Security...

  • Big Data Engineer

    3 weeks ago

    Pune, India Qualys Full time

    We are seeking a talented Big Data Engineer to deliver roadmap features of Enterprise TruRisk Platform which would help customers to Measure, Communicate and Eliminate Cyber Risks. Working with a team of engineers and architects, you will be responsible for prototyping, designing, developing and supporting a highly scalable, distributed SaaS based Security...

  • Big Data Engineer

    1 month ago

    Pune, India Qualys Full time

    We are seeking a talented Big Data Engineer to deliver roadmap features of Enterprise TruRisk Platform which would help customers to Measure, Communicate and Eliminate Cyber Risks. Working with a team of engineers and architects, you will be responsible for prototyping, designing, developing and supporting a highly scalable, distributed SaaS based Security...

  • Big Data Engineer

    3 weeks ago

    Pune, India Qualys Full time

    We are seeking a talented Big Data Engineer to deliver roadmap features of Enterprise TruRisk Platform which would help customers to Measure, Communicate and Eliminate Cyber Risks. Working with a team of engineers and architects, you will be responsible for prototyping, designing, developing and supporting a highly scalable, distributed SaaS based Security...

  • Big Data Engineer

    3 weeks ago

    Pune, India Qualys Full time

    We are seeking a talented Big Data Engineer to deliver roadmap features of Enterprise TruRisk Platform which would help customers to Measure, Communicate and Eliminate Cyber Risks. Working with a team of engineers and architects, you will be responsible for prototyping, designing, developing and supporting a highly scalable, distributed SaaS based Security...

  • Big Data Engineer

    6 days ago

    Pune, Maharashtra, India Angel and Genie Full time

    Lead/Senior Big Data EngineerExperience: YearsLocation: PuneType: Full-timeJob ProfileWe are looking for a Big Data Engineer who will work on building, and managing Big Data Pipelines forus to deal with the huge structured data sets that we use as an input to accurately generate analytics atscale for our valued Customers. The primary focus will be on...

  • Big Data Engineer

    3 weeks ago

    Pune, India K-RY Tech Advisory Full time

    Requirements:Should haveminimum 3 years of experience on working Big DatatechnologiesGood Programmingskills.Hands on Experience in AutomatingBackend Applications (e.g. db REST API s)Handson experience with Automating any backend applications (e.g dbserver side).Knowledge of relational databasesand SQLGood debuggingskills.Strong working experience working...

  • Big Data Engineer

    4 weeks ago

    Pune, India K-RY Tech Advisory Full time

    Requirements:Should haveminimum 3 years of experience on working Big DatatechnologiesGood Programmingskills.Hands on Experience in AutomatingBackend Applications (e.g. db REST API s)Handson experience with Automating any backend applications (e.g dbserver side).Knowledge of relational databasesand SQLGood debuggingskills.Strong working experience working...