Big Data Production Systems Engineer

3 weeks ago

Pune, Maharashtra, India Fulcrum Digital Full time
Job Title: Big Data Production Systems Engineer

About the Role:

At Fulcrum Digital, we are seeking a highly skilled Big Data Production Systems Engineer to join our team. As a key member of our engineering team, you will be responsible for planning, managing, and overseeing all aspects of our Production Environment for Big Data Platforms.

Key Responsibilities:

* Plan, manage, and oversee all aspects of a Production Environment for Big Data Platforms.
* Define strategies for Application Performance Monitoring, Optimization in Prod environment.
* Respond to Incidents and improvise platform based on feedback and measure the reduction of incidents over time.
* Ensure that batch production scheduling and process are accurate and timely.
* Create and execute queries to big data platform and relational data tables to identify process issues or to perform mass updates.
* Perform ad hoc requests from users such as data research, file manipulation/transfer, research of process issues, etc.
* Take a holistic approach to problem solving, by connecting the dots during a production event through the various technology stack that makes up the platform, to optimize meantime to recover.
* Engage in and improve the whole lifecycle of services—from inception and design, through deployment, operation and refinement.
* Analyze ITSM activities of the platform and provide feedback loop to development teams on operational gaps or resiliency concerns.
* Support services before they go live through activities such as system design consulting, capacity planning and launch reviews.
* Support the application CI/CD pipeline for promoting software into higher environments through validation and operational gating, and lead in DevOps automation and best practices.
* Maintain services once they are live by measuring and monitoring availability, latency and overall system health.
* Scale systems sustainably through mechanisms like automation and evolving systems by pushing for changes that improve reliability and velocity.

Requirements:

* Experience in Linux and Knowledge on ITSM/ITIL.
* Experience in the Big Data technologies (Hadoop, Spark, Nifi, Impala).
* 2+ years of Experience in running Big Data production systems.
* Good to have experience in industry standard CI/CD tools like Git/BitBucket, Jenkins, Maven.
* Solid grasp of SQL or Oracle fundamentals.
* Experience with scripting, pipeline management, and software design.
* Systematic problem-solving approach, coupled with strong communication skills and a sense of ownership and drive.
* Ability to help debug and optimize code and automate routine tasks.
* Ability to support many different stakeholders. Experience in dealing with difficult situations and making decisions with a sense of urgency is needed.
* Appetite for change and pushing the boundaries of what can be done with automation.
* Experience in working across development, operations, and product teams to prioritize needs and to build relationships are a must.
* Experience designing and implementing an effective and efficient CI/CD flow that gets code from dev to prod with high quality and minimal manual effort is desired.
* Good Handle on Change Management and Release Management aspects of Software.

What We Offer:

* Opportunity to work with a global team spread across tech hubs in multiple geographies and time zones.
* Ability to share knowledge and explain processes and procedures to others.

How to Apply:

If you are a motivated and experienced Big Data Production Systems Engineer looking for a new challenge, please submit your application.

Language: English

  • Big Data Systems Engineer

    4 weeks ago

    Pune, Maharashtra, India Fulcrum Digital Full time

    About the RoleFulcrum Digital is a cutting-edge digital transformation company that provides innovative technology services across various industries. We're seeking a highly skilled Big Data Systems Engineer to join our team.Key ResponsibilitiesDesign and implement robust Big Data platforms to ensure high availability and performance.Develop and maintain...

  • Big Data Production Systems Engineer

    3 weeks ago

    Pune, Maharashtra, India Fulcrum Digital Full time

    About the RoleFulcrum Digital is a digital transformation and technology services company that accelerates innovation and growth for its clients. As a key member of our team, you will play a crucial role in ensuring the reliability and performance of our Big Data platforms.Key ResponsibilitiesPlan, manage, and oversee all aspects of a Production Environment...

  • Big Data System Reliability Engineer

    2 weeks ago

    Pune, Maharashtra, India Fulcrum Digital Full time

    Job Description:Fulcrum Digital is a cutting-edge digital transformation company that provides innovative technology services across various industries. We are seeking a skilled Big Data System Reliability Engineer to join our team.The Role:As a Big Data System Reliability Engineer, you will be responsible for planning, managing, and overseeing all aspects...

  • Big Data System Reliability Engineer

    3 weeks ago

    Pune, Maharashtra, India Fulcrum Digital Full time

    About the RoleFulcrum Digital is a cutting-edge digital transformation company that accelerates innovation and provides technology services across various industries. We're seeking a skilled Big Data System Reliability Engineer to join our team.Key ResponsibilitiesDesign and implement strategies for application performance monitoring and optimization in our...

  • Big Data Systems Reliability Engineer

    3 weeks ago

    Pune, Maharashtra, India Fulcrum Digital Full time

    About the RoleFulcrum Digital is a digital transformation company that accelerates innovation and technology services. We're looking for a skilled Big Data Systems Reliability Engineer to join our team.Key ResponsibilitiesDesign and implement strategies for Application Performance Monitoring and Optimization in Production environments.Develop and maintain...

  • Data Engineer

    3 weeks ago

    Pune, Maharashtra, India NTT DATA Services Full time

    Job Title: Data Engineer - Big Data SpecialistWe are seeking a highly skilled Data Engineer to join our team in Pune, India. As a Data Engineer, you will work on exciting big data related projects that require large data sets to be processed via a vendor sourced solution on a daily, weekly and monthly basis.Key Responsibilities:Analyzing data sets and...

  • Big Data Systems Engineer

    3 weeks ago

    Pune, Maharashtra, India Fulcrum Digital Full time

    About the RoleFulcrum Digital is a cutting-edge digital transformation company that accelerates innovation and technology services. Our services span various industries, including banking, financial services, insurance, retail, higher education, food, healthcare, and manufacturing.The ChallengeDesign and oversee the production environment for Big Data...

  • Big Data Production Systems Manager

    6 days ago

    Pune, Maharashtra, India Fulcrum Digital Full time

    Job Role OverviewFulcrum Digital is an agile and next-generation digital accelerating company providing digital transformation and technology services across various industries. As a key member of our team, you will play a pivotal role in ensuring the reliability and performance of our Big Data Platforms.Key ResponsibilitiesThe ideal candidate will be...

  • Big Data Systems Engineer

    4 weeks ago

    Pune, Maharashtra, India Fulcrum Digital Full time

    About the RoleFulcrum Digital is a cutting-edge digital transformation company that provides innovative technology services across various industries. As a key member of our team, you will play a crucial role in ensuring the smooth operation of our Big Data platforms.Key ResponsibilitiesDesign and implement strategies for Application Performance Monitoring...

  • Big Data Engineer

    4 weeks ago

    Pune, Maharashtra, India Seven N Half Full time

    Job Title: Lead Big Data DeveloperThis is an exciting opportunity to join our team at Seven N Half as a Lead Big Data Developer. We are a fast-paced software company that partners with innovative B2B and B2C SaaS companies for their digital transformation needs.Job Summary:We are seeking a highly skilled and experienced Big Data Developer to lead our team in...

  • Big Data System Reliability Engineer

    2 weeks ago

    Pune, Maharashtra, India Fulcrum Digital Full time

    About the RoleFulcrum Digital is a digital transformation and technology services company that accelerates innovation across various industries. We are seeking a skilled System Reliability Engineer to join our team.Key Responsibilities:Plan, manage, and oversee all aspects of a Production Environment for Big Data Platforms.Develop strategies for Application...

  • Big Data Production Systems Specialist

    6 days ago

    Pune, Maharashtra, India Fulcrum Digital Full time

    About the RoleFulcrum Digital is an agile and next-generation digital accelerating company providing digital transformation and technology services from ideation to implementation. These services have applicability across a variety of industries, including banking & financial services, insurance, retail, higher education, food, health care, and...

  • Big Data Engineer

    1 month ago

    Pune, Maharashtra, India Mig Staffing Full time

    We are looking to hire a talented big data engineer to develop and manage our company's Big Data solutions. In this role, you will be required to design and implement Big Data tools and frameworks, implement ELT processes, collaborate with development teams, build cloud platforms, and maintain the production system.To ensure success as a big data...

  • Big Data System Reliability Engineer

    3 weeks ago

    Pune, Maharashtra, India Fulcrum Digital Full time

    About the RoleFulcrum Digital is a digital transformation and technology services company that accelerates innovation and growth for its clients. We provide a range of services, from ideation to implementation, across various industries including banking, financial services, insurance, retail, higher education, food, healthcare, and manufacturing.Key...

  • Big Data Systems Architect

    1 week ago

    Pune, Maharashtra, India Fulcrum Digital Full time

    About the RoleFulcrum Digital is a cutting-edge digital acceleration company providing digital transformation and technology services. Our services span across various industries, including banking, financial services, insurance, retail, higher education, food, healthcare, and manufacturing.The ideal candidate will be responsible for planning, managing, and...

  • Senior Data Engineer

    4 weeks ago

    Pune, Maharashtra, India RS Consultants Full time

    Job Title : Senior Data Engineer. Location : Pune. Experience Level : 3+ Years. Company Type : AI/ML startup. Please apply only if you are comfortable working with Early stage startup. Company Overview : Join our client a pioneering startup founded by renowned tech experts, marking their second venture in the AI and ML field. The founders previously...

  • Big Data Engineer

    1 month ago

    Pune, Maharashtra, India Mig Staffing Full time

    Job Description : We are looking to hire a talented big data engineer to develop and manage our company's Big Data solutions. In this role, you will be required to design and implement Big Data tools and frameworks, implement ELT processes, collaborate with development teams, build cloud platforms, and maintain the production :- Meeting with managers to...

  • Data Engineer

    6 days ago

    Pune, Maharashtra, India Virtusa Full time

    About the RoleAt Virtusa, we are seeking a highly skilled Data Engineer (Big Data) to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems using big data technologies such as Apache Spark, Hadoop, and Hive.Responsibilities• Design, develop, and...

  • Senior Big Data Engineer

    3 weeks ago

    Pune, Maharashtra, India Circana Full time

    Job DescriptionCircana is seeking a highly skilled Senior Big Data Engineer to lead our big data initiatives and drive innovation in data engineering.Key ResponsibilitiesDesign and develop scalable big data architectures using Hadoop and Spark frameworks.Lead a team of data engineers to develop and deploy big data solutions.Collaborate with cross-functional...

  • Big Data Engineer

    2 weeks ago

    Pune, Maharashtra, India F337 Deutsche India Private Limited, Pune Branch Full time

    Job SummaryF337 Deutsche India Private Limited, Pune Branch is seeking a highly skilled Big Data Engineer to join our team. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Hadoop and Scala technologies.Key ResponsibilitiesDesign and develop data processing pipelines using...