Data Platform Infrastructure Specialist

2 weeks ago

Bengaluru, Karnataka, India PhonePe Full time
About PhonePe Group
PhonePe is a leading digital payments company with 500 million registered users and 37 million merchants covering over 99% of India's postal codes. On the back of its leadership in digital payments, PhonePe has expanded into financial services, insurance, mutual funds, stock broking, and lending. The company aims to offer every Indian equal opportunities for progress by unlocking money flow and access to services.

Our Culture
At PhonePe, we strive to create an environment where you can give your best at work, every day. We empower our people and trust them to do the right thing. Here, you own your work from start to finish, right from day one. Being enthusiastic about technology is a big part of being at PhonePe. If you like building tech that impacts millions, ideating with top minds, and executing on your dreams with purpose and speed, join us.

Job Overview
As a Data Platform Infrastructure Specialist, you will play a critical role in deploying, ensuring reliability, scalability, and performance of our Cloudera Data Platform infrastructure. You will collaborate closely with cross-functional teams to design, implement, and maintain robust systems supporting data-driven initiatives. The ideal candidate will have a deep understanding of Cloudera Data Platform, strong troubleshooting skills, and a proactive mindset towards automation and optimization. You will ensure the smooth functioning, operation, performance, and security of large high-density Cloudera-based infrastructure.

Main Responsibilities
• Implementation of Cloudera Data Platform: Lead the implementation process of Cloudera Data Platform on-premises, including planning, installation, configuration, and integration with existing systems. • Infrastructure Management: Manage and maintain the Cloudera-based infrastructure, ensuring optimal performance, high availability, and scalability. This includes monitoring system health, troubleshooting issues, and performing routine maintenance tasks. • Data Security and Compliance: Implement and enforce security best practices to safeguard data integrity and confidentiality within the Cloudera environment. Ensure compliance with relevant regulations and standards (e.g., GDPR, HIPAA, DPR). • Performance Optimization: Continuously optimize the Cloudera infrastructure to enhance performance, efficiency, and cost-effectiveness. Identify and resolve bottlenecks, tune configurations, and implement best practices for resource utilization. • Capacity Planning: Monitor resource utilization trends and plan for future capacity needs. Proactively identify potential capacity constraints and propose solutions to address them. • Backup and Disaster Recovery: Implement robust backup and disaster recovery strategies to ensure data protection and business continuity. Test and maintain backup and recovery procedures regularly. • Patches & Upgrades: Routinely apply recommended patches and perform rolling upgrades of the platform in accordance with the advisory from Cloudera, InfoSec, and Compliance. • Documentation and Knowledge Sharing: Create comprehensive documentation for configurations, processes, and procedures related to the Cloudera Data Platform. Share knowledge and best practices with team members to foster continuous learning and improvement. • Collaboration and Communication: Collaborate effectively with cross-functional teams, including data engineers, developers, and IT operations personnel. Communicate project status, issues, and resolutions clearly and promptly.

Requirements
• Bachelor's degree in Computer Science, Engineering, or a related field. • Proficiency in Linux system administration, shell scripting, and networking concepts. • 5+ years of experience in managing Big Data infrastructure, terraform. • Strong understanding of distributed computing principles and experience with Hadoop ecosystem technologies (HDFS, MapReduce, YARN, Hive, Spark, etc.). • Hands-on experience with configuration management tools (e.g., Salt, Ansible, Puppet, Chef). • Strong scripting skills (e.g., Python, Bash) for automation and troubleshooting. • Experience with monitoring and logging solutions (e.g., Prometheus, Grafana, ELK stack). • Knowledge of networking principles and protocols (TCP/IP, UDP, DNS, DHCP, etc.). • Experience with managing *nix based machines and strong working knowledge of quintessential Unix programs and tools (e.g. Ubuntu, Fedora, Redhat, etc.). • Excellent communication skills and the ability to collaborate effectively with cross-functional teams. • Excellent analytical, problem-solving, and troubleshooting skills. • Proven ability to work well under pressure and manage multiple priorities simultaneously.

Preferred Qualifications
• Cloudera Certified Administrator (CCA) or Cloudera Certified Professional (CCP) certification preferred. • Minimum 5 years of experience in managing and administering medium/large hadoop based environments (> 100 machines), including Cloudera Data Platform (CDP) experience is highly desirable. • Familiarity with Open Data Lake components such as Ozone, Iceberg, Spark, Flink, etc. • Familiarity with containerization and orchestration technologies (e.g. Docker, Kubernetes, OpenShift) is a plus.

  • Data Platform Infrastructure Specialist

    1 week ago

    Bengaluru, Karnataka, India PhonePe Full time

    We are seeking an experienced Data Platform Infrastructure Specialist to join our team at PhonePe. The ideal candidate will have a strong understanding of Hadoop ecosystem technologies, including Cloudera Data Platform (CDP), and experience with designing, setting up, and managing large-scale infrastructure.Key Responsibilities:Design, implement, and...

  • Infrastructure Platform Specialist

    3 days ago

    Bengaluru, Karnataka, India ACL Digital Full time

    Job DescriptionWe are seeking a highly skilled Infrastructure Platform Specialist to join our team at ACL Digital. This role will be responsible for designing and implementing infrastructure platforms for software development, including its infrastructure.About the Role:Design and implement continuous integration and deployment (CI/CD) pipelines for...

  • IT Infrastructure Specialist

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    NTT DATA is a trusted global innovator of business and technology services, serving 75% of the Fortune Global 100.We are committed to helping clients innovate, optimize and transform for long term success.As a Global Top Employer, we have diverse experts in more than 50 countries and a robust partner ecosystem of established and start-up companies.Our...

  • Platform Specialist | Infrastructure Architect

    1 month ago

    Bengaluru, Karnataka, India Squarepoint Capital Full time

    Job Overview:Squarepoint Capital is seeking a highly skilled Platform Specialist to join our team. As a Platform Specialist, you will play a crucial role in delivering mission-critical platform infrastructure using the DevOps methodology.Key Responsibilities:Design, monitor, and scale platform infrastructure.Automate everyday tasks with scripting and...

  • Data Infrastructure Specialist

    3 weeks ago

    Bengaluru, Karnataka, India Duronto Technologies Full time

    Job Description:As a skilled Data Infrastructure Specialist at Duronto Technologies, you will collaborate closely with our GenAI experts to design, build, and maintain the data pipelines and infrastructure necessary for developing and deploying powerful GenAI models. Responsibilities:Partner with GenAI Data Scientists to understand their data needs and...

  • Cloud Data Infrastructure Specialist

    2 weeks ago

    Bengaluru, Karnataka, India SkillRecruit Full time

    Job SummaryWe are seeking a highly skilled Cloud Data Infrastructure Specialist to join our team at SkillRecruit. This role is ideal for experienced professionals who can design, develop, and maintain large-scale data infrastructure on Google Cloud Platform.

  • Automation Infrastructure Solutions Specialist

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Title: Automation Infrastructure Solutions SpecialistAbout the Role:We are seeking a highly skilled Automation Infrastructure Solutions Specialist to join our team in Bangalore, India. The successful candidate will be responsible for designing and developing automation solutions using Ansible Tower to streamline and automate infrastructure tasks.Key...

  • Cloud Infrastructure Specialist

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job DescriptionN TT DATA is a $30 billion trusted global innovator of business and technology services, striving to hire exceptional individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Cloud Infrastructure Specialist to join our team in India.About...

  • Data Infrastructure Specialist for AI Workloads

    2 days ago

    Bengaluru, Karnataka, India ApicalGo Consultancy Full time

    Company Overview :ApicalGo Consultancy is a leading provider of data infrastructure solutions, specializing in supporting AI applications on the AWS cloud platform.Salary :$120,000 - $180,000 per year, depending on experience.Job Description :We are seeking an experienced Data Infrastructure Specialist to design, develop, and maintain our data infrastructure...

  • Network Infrastructure Specialist

    1 month ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job DescriptionMake a meaningful impact with NTT DATANTT DATA is a global leader in business and technology services. We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize and transform for long-term success. As a seasoned Network Infrastructure Specialist, you will play a critical role in delivering exceptional...

  • Data Engineering Infrastructure Specialist

    3 weeks ago

    Bengaluru, Karnataka, India Groww Full time

    About Groww">We are a passionate group of people focused on making financial services accessible to every Indian through a multi-product platform. Every day, we help millions of customers take charge of their financial journey.Our company is built around customer obsession. Every product, every design, and every algorithm is executed with the customers'...

  • ML Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job OverviewNTT DATA is seeking a skilled ML Engineer - Cloud Infrastructure Specialist to join our team.Estimated Salary: ₹1,200,000 - ₹2,400,000 per annumKey Responsibilities:Design and implement efficient CI/CD pipelines using Vertex AI Pipelines and Cloud Build for automating the entire ML lifecycle on GCP.Develop and manage infrastructure as code...

  • Big Data Infrastructure Specialist

    2 weeks ago

    Bengaluru, Karnataka, India I Square Soft Full time

    About the Role: We are seeking an experienced Big Data Infrastructure Specialist to join our team at I Square Soft. In this role, you will be responsible for guiding the full lifecycle of a Hadoop solution, including requirements analysis, platform selection, and technical architecture design. Key Responsibilities: Infra design and build, testing, and...

  • Network Infrastructure Specialist Advisor

    1 month ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    We are seeking an experienced Network Routing and Switching Specialist to join our team at NTT DATA Services. This role will involve designing, implementing, and maintaining enterprise-level network infrastructure components, ensuring compliance with industry standards and best practices.Key Responsibilities:Design and implement network architectures using...

  • Data Infrastructure Optimization Specialist

    1 week ago

    Bengaluru, Karnataka, India PhonePe Full time

    Job OverviewAs a Data Infrastructure Optimization Specialist, you will play a critical role in ensuring the reliability, scalability, and performance of our Cloudera Data Platform (CDP) infrastructure. You will collaborate closely with cross-functional teams to design, implement, and maintain robust systems that support our data-driven initiatives.The ideal...

  • Data Center Operations Specialist

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job OverviewNTT DATA is a global leader in IT services, with a strong presence in the data center industry. We are seeking an experienced Data Center Operations Specialist to join our team.About the RoleThe successful candidate will be responsible for the design, installation, and maintenance of complex mechanical, electrical, and infrastructure systems in...

  • System Administrator

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    About the RoleWe are seeking a highly skilled System Administrator to join our team in Bangalore, India. As an IT Infrastructure Specialist, you will be responsible for deploying and managing new computers, connecting them to the server, and deploying new software and hardware updates.Key ResponsibilitiesDeploying new computers and configuring SCCM settings...

  • Enterprise IT Infrastructure Specialist

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job OverviewWe are seeking an experienced Enterprise IT Infrastructure Specialist to join our team in Bangalore, India. As a key member of our infrastructure team, you will be responsible for designing, implementing, and maintaining enterprise-level IT systems and services.About the RoleThis role is expected to provide BAU operational support across a wide...

  • Data Protector Specialist

    1 month ago

    Bengaluru, Karnataka, India NTT DATA Full time

    About the RoleWe are currently seeking a highly skilled Data Protector Specialist to join our team at NTT DATA. The successful candidate will have a strong background in Data Protector and Storeonce, with experience in designing, implementing, and managing complex backup systems.Main ResponsibilitiesDesign and implement Data Protector and Storeonce solutions...

  • Chief Data Infrastructure Specialist

    20 hours ago

    Bengaluru, Karnataka, India Ascendion Full time

    About the RoleWe are seeking a highly skilled Chief Data Infrastructure Specialist to join our team. This role will be based in Bengaluru, Hyderabad, Chennai, Pune, or Vadodara, with hybrid work arrangements.