Senior Big Data Engineer

2 weeks ago

Pune, India Devlats Pvt Ltd Full time

Sr. Big Data Engineer

Location : Pune

Experience : 8+ years overall; 6+ years relevant

Mode : Hybrid

Role Overview :

We are seeking a talented Sr. Big Data Engineer to design, develop, and support a highly scalable, distributed SaaS-based Security Risk Prioritization product. You will lead the design and evolution of our data platform and pipelines, providing technical leadership to a team of engineers and architects.

Key Responsibilities :

- Provide technical leadership on data platform design, roadmaps, and architecture.

- Design and implement scalable architecture for Big Data and Microservices environments.

- Drive technology explorations, leveraging knowledge of internal and industry prior art.

- Ensure quality architecture and design of systems, focusing on performance, scalability, and security.

- Mentor and provide technical guidance to other engineers.

Required Skills & Technologies :

Mandatory : Kafka, Scala, Spark

.
- Big Data & Data Streaming : Spark, Kafka, Hadoop, Presto, Airflow, Data lakes, lambda architecture, kappa, and kappa ++ architectures with flink data Databases & Caching : RDBMS, NoSQL, Oracle, Cassandra, Search Solutions : Solar, ML & Automation : Experience with ML models engineering and related deployment, scripting, and Architecture : In-depth experience with messaging queues and caching components.


Other Skills : Strong troubleshooting and performance benchmarking skills for Big Data technologies.


Qualifications :

- Bachelors degree in Computer Science or equivalent.

- 8+ years of total experience, with 6+ years relevant.


- 2+ years in designing Big Data solutions with Spark.

- 3+ years with Kafka and performance testing for large infrastructure.


(ref:hirist.tech)

  • Big Data Engineer

    3 weeks ago

    Pune, Maharashtra, India Merito Full time

    Job Description :We are looking for a Big Data Engineer who will work on building, and managing Big Data Pipelines for us to deal with the huge structured data sets that we use as an input to accurately generate analytics at scale for our valued Customers. The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining,...

  • Big Data Engineer

    1 week ago

    Pune, India Information Technology Full time

    Big Data EngineerKey Responsibilities :- Build and manage highly scalable Big Data pipelines for large structured datasets.- Collaborate with Product Management & Engineering leadership to design and implement optimal solutions.- Participate in design discussions and contribute to selecting, integrating, and maintaining Big Data frameworks.- Develop...

  • Big Data Engineer

    7 days ago

    Pune, Maharashtra, India Information Technology Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Big Data EngineerKey Responsibilities : - Build and manage highly scalable Big Data pipelines for large structured datasets. - Collaborate with Product Management & Engineering leadership to design and implement optimal solutions. - Participate in design discussions and contribute to selecting, integrating, and maintaining Big Data frameworks. -...

  • Senior Big Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Citi Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Job Description:The Applications Development Senior big Data Engineer is responsible for accomplishing results through the management of a team or department in an effort to establish and implement new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to drive applications systems...

  • Big Data Engineer

    3 weeks ago

    Pune, Maharashtra, India WorkiFicient Full time

    To be successful in this role, you should possess : - Collaborate closely with Product Management and Engineering leadership to devise and build the right solution.- Participate in Design discussions and brainstorming sessions to select, integrate, and maintain Big Data toolsand frameworks required to solve Big Data problems at scale.- Design and implement...

  • Senior Big Data Architect

    2 weeks ago

    Pune, India Mycitypune Full time

    Job Description - Qualification: Hold a University degree, preferably in Computer Science/IT/Engineering or in a related field - Experience: 3-5 years of hands on experience across Big Data project implementations. - Skills: Familiar with designing high volume and fast big data solutions. Ability to articulate and hold solution discussion with key...

  • Big Data Engineer

    7 days ago

    Pune, Maharashtra, India Information Technology Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Key ResponsibilitiesBuild and manage highly scalable Big Data pipelines for large structured datasets.Collaborate with Product Management & Engineering leadership to design and implement optimal solutions.Participate in design discussions and contribute to selecting, integrating, and maintaining Big Data frameworks.Develop distributed data processing systems...

  • Senior Big Data Architect

    2 weeks ago

    Pune, Maharashtra, India Mycitypune Full time

    Job Description- Qualification: Hold a University degree, preferably in Computer Science/IT/Engineering or in a related field- Experience: 3-5 years of hands on experience across Big Data project implementations.- Skills: Familiar with designing high volume and fast big data solutions. Ability to articulate and hold solution discussion with key stakeholders...

  • Big Data Engineer

    3 weeks ago

    Pune, Maharashtra, India Nice Software Solutions Pvt. Ltd. Full time

    Big Data Engineer (PySpark)Location: Pune/Nagpur (WFO)Experience: 8 - 12 YearsEmployment Type: Full-timeJob OverviewWe are looking for an experienced Big Data Engineer with strong expertise in PySpark and Big Data ecosystems. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines while ensuring high...

  • Big Data Engineer

    4 weeks ago

    Pune, Maharashtra, India Nice Software Solutions Pvt. Ltd. Full time

    Big Data Engineer (PySpark) Location: Pune/Nagpur (WFO) Experience: 8 - 12 Years Employment Type: Full-time Job Overview We are looking for an experienced Big Data Engineer with strong expertise in PySpark and Big Data ecosystems. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines while ensuring high...