Data Platform Operations Expert

2 weeks ago

Bengaluru, Karnataka, India PhonePe Full time

About the Role:

We are seeking a highly skilled Data Platform Operations Expert to join our team at PhonePe. As a Site Reliability Engineer, you will play a critical role in deploying, maintaining, and ensuring the reliability, scalability, and performance of our Cloudera Data Platform (CDP) infrastructure.

Key Responsibilities:

  • You will work on tasks related to the implementation of Cloudera Data Platform on-premises, planning, installation, configuration, and integration with existing systems.
  • Manage and maintain the Cloudera-based infrastructure, ensuring optimal performance, high availability, and scalability. This includes monitoring system health and performing routine maintenance tasks.
  • Develop strong troubleshooting skills and operational expertise in areas such as system capacity, bottlenecks, memory, CPU, OS, storage, and networking.
  • Create runbooks and automate them using scripting tools like Shell scripting, Python, etc.
  • Work with configuration management tools like Terraform, Ansible, or SALT.
  • Implement and enforce security best practices to safeguard data integrity and confidentiality within the Cloudera environment. Ensure compliance with relevant regulations and standards.
  • Continuously optimize the Cloudera infrastructure to enhance performance, efficiency, and cost-effectiveness. Identify and resolve bottlenecks, tune configurations, and implement best practices for resource utilization.
  • Plan and perform Hadoop cluster planning, monitor resource utilization trends, and plan for future capacity needs. Proactively identify potential capacity constraints and propose solutions to address them.
  • Collaborate effectively with infrastructure, network, database, application, and business intelligence teams to ensure high data quality and availability.
  • Develop tools and services to enhance debuggability and supportability.
  • Routinely apply recommended patches and perform rolling upgrades of the platform.
  • Create comprehensive documentation for configurations, processes, and procedures related to the Cloudera Data Platform. Share knowledge and best practices with team members to foster continuous learning and improvement.
  • Collaborate effectively with cross-functional teams, including data engineers, developers, and IT operations personnel. Communicate project status, issues, and resolutions clearly and promptly.

Requirements:

  • Bachelor's degree in Computer Science, Engineering, or a related field.
  • Proficiency in Linux system administration, shell scripting, and networking concepts.
  • Strong understanding of networking, open-source technologies, and tools.
  • 3-5 years of experience in designing, setting up, and managing large-scale Hadoop clusters.
  • Strong understanding of distributed computing principles and experience with Hadoop ecosystem technologies.
  • Experience with Kerberos and LDAP.
  • Strong knowledge of databases like MySQL, NoSQL, SQL Server.
  • Hands-on experience with configuration management tools.
  • Strong scripting skills for automation and troubleshooting.
  • Experience with monitoring and logging solutions.
  • Knowledge of networking principles and protocols.
  • Excellent communication skills and the ability to collaborate effectively with cross-functional teams.

Estimated Salary: ₹1,200,000 - ₹1,800,000 per annum

  • Data Platform Solutions Expert

    3 days ago

    Bengaluru, Karnataka, India HEVO DATA Full time

    About the RoleWe're seeking a skilled Data Platform Solutions Expert to join our Sales team at HEVO DATA. This is an exciting opportunity for someone with a strong background in Data Domain to work closely with sales professionals, helping them understand customers' business and technical needs and demonstrate how our platform can solve their real-time data...

  • Enterprise ServiceNow Developer

    2 weeks ago

    Bengaluru, Karnataka, India Awign Expert Full time

    About Us: Awign Expert, a division of Awign, empowers professionals by connecting them with top companies and managing administrative tasks. We provide access to exciting project-based opportunities, handle onboarding, feedback, conflict resolution, and payroll.Key Responsibilities:We are seeking an experienced ServiceNow Developer to join our team as an...

  • Data Quality Assurance Expert

    2 weeks ago

    Bengaluru, Karnataka, India Awign Expert Full time

    Job Summary:Data Quality Assurance ExpertA talented Data Quality Assurance Expert is required by Awign Expert to ensure the accuracy, completeness, and consistency of our data. This role will play a crucial part in testing and validating data to maintain the highest standards of quality.About the Role:This position involves collaborating with...

  • Insurance Platform Implementation Expert

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    About the Role: We are seeking an Insurance Platform Implementation Expert to join our team in Bangalore, India. Job Description: The successful candidate will participate in various streams of insurance platform implementation projects and collaborate with agile team members to achieve project and client goals. Key Responsibilities: Experience in Guidewire...

  • Data Platform Maintenance Expert

    3 days ago

    Bengaluru, Karnataka, India MResult Full time

    About the RoleWe are seeking a highly skilled Data Platform Maintenance Expert to join our team at MResult. As a key member of our organization, you will be responsible for monitoring and maintaining the health, stability, and performance of our Qlik SaaS & on-Prem environments.ResponsibilitiesInstallation, configuration, and deployment of Qlik applications,...

  • Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Awign Expert Full time

    We are seeking a skilled Data Engineer to join our Data Science team at Awign Expert, India's largest work-as-a-service platform.About Us:Awign Expert is a division of Awign that connects skilled professionals with exciting project-based opportunities from top companies. Our mission is to empower professionals to focus on their work by managing...

  • Data Engineer

    4 weeks ago

    Bengaluru, Karnataka, India Awign Expert Full time

    About Awign Expert:A leading work-as-a-service platform, connecting skilled professionals with top companies for project-based opportunities.Job Description:As a Data Engineer with our Data Science team, you will play a critical role in enriching and maintaining our central repository of datasets. Your mission will be to develop and implement robust data...

  • Data and Analytics Transformation Expert

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job DescriptionNegotiating a salary of $120,000 - $180,000 per year.About the RoleWe are seeking a Data & Analytics Principal Consultant to join our team in Bangalore, India. The ideal candidate will have 2+ years of experience with SAP Business Technology Platform (BTP), CAPM, and related services. Strong analytical skills and attention to detail are...

  • Data Centre Operations Specialist

    4 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job OverviewWe are seeking a skilled Data Centre Operations Specialist to join our team in Bangalore, India. This is a fantastic opportunity for individuals passionate about technology and data centre operations.About the RoleThe successful candidate will be responsible for maintaining the efficiency and reliability of our server infrastructure, ensuring...

  • Unified Operations Expert

    2 weeks ago

    Bengaluru, Karnataka, India Artificial Intelligence Global Company Full time

    We are seeking a highly skilled and experienced Unified Operations Expert to join our team at Artificial Intelligence Global Company. In this role, you will be responsible for leading medium to large-scale unified operations projects on Aveva System Platform.Key Responsibilities:Lead requirement gathering, customer workshops, and elaborate requirements to...

  • Strategic HR Consultant for Global Operations

    3 weeks ago

    Bengaluru, Karnataka, India Wipro Digital Operations and Platforms Full time

    **About the Role**We are seeking a skilled Sr. Consultant-HR Shared Services to join our team at Wipro Digital Operations and Platforms in Bangalore.Salary: ₹20-35 Lakhs per annum, based on experience and qualifications.Job Overview:** As a key member of our HR Shared Services team, you will be responsible for providing expert-level support for global HR...

  • Data Engineer Expert

    3 weeks ago

    Bengaluru, Karnataka, India HyrHub Full time

    Data Engineer ExpertHyrHub is seeking a highly skilled Data Engineer Expert to join our team.We are looking for an exceptional professional with expertise in managing model operations on the Dataiku platform, alongside a strong background in data engineering practices.In this role, you will be responsible for building and maintaining robust data pipelines,...

  • Data Engineering Expert for Cloud Platforms

    3 days ago

    Bengaluru, Karnataka, India BYTESPRINT TALENT SEARCH LLP Full time

    **Job Title:** Data Engineering Expert for Cloud Platforms **About the Role:We are seeking a highly skilled Data Engineer to join our team at Bytesprint Talent Search LLP. As a key member of our data engineering team, you will be responsible for designing and developing scalable data pipelines, integrating new API connections, and collaborating with...

  • Senior Backend Developer for Cloud Platforms

    2 weeks ago

    Bengaluru, Karnataka, India Awign Expert Full time

    About the JobWe are looking for a skilled Senior Backend Developer to join our team at Awign Expert. As a key member of our development team, you will be responsible for designing and implementing backend services using Node.js/Express or Ruby on Rails.Key Responsibilities:Develop and maintain scalable backend services with expertise in Node.js/Express or...

  • Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job OverviewWe are seeking a highly skilled Data Engineer to join our team in Bangalore, India. As a key member of our team, you will play a crucial role in designing and implementing data pipelines, ensuring high-quality data for business insights.About the RoleThis is an exciting opportunity to work with cutting-edge technology and contribute to the growth...

  • Data Security Expert for Concentric Platform

    2 weeks ago

    Bengaluru, Karnataka, India Clear Ventures Full time

    About Clear VenturesWe are a forward-thinking organization seeking an experienced Data Security Expert to join our team. This role will play a critical part in helping our clients maximize the value they derive from Concentric platform.Job Description:The successful candidate will be responsible for analyzing customer data on Concentric Platform, extracting...

  • Critical Facilities Operations and Maintenance Engineer Expert

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    About the RoleThe Senior Specialist position at NTT DATA is a unique opportunity to leverage your technical expertise in electrical and HVAC systems maintenance. As an advanced subject matter expert, you will work with major systems within a facility or building, ensuring regular maintenance and optimal operational efficiency.ResponsibilitiesDesigns, plans,...

  • Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India Awign Expert Full time

    About Awign ExpertA division of Awign, India's largest work-as-a-service platform, connecting skilled professionals with exciting project-based opportunities from top companies, handling onboarding, feedback, conflict resolution, and payroll.Job SummaryWe are seeking a highly skilled Data Engineer to join our Data Science team. As a Data Engineer, you will...

  • Cloud Security Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Netskope Full time

    About NetskopeNetskope is a leading cloud security company that provides innovative solutions to protect data in the cloud and beyond. We are committed to creating a culture of openness, honesty, and transparency, which is reflected in our open office layouts and collaborative workspaces.Our team at Netskope is uniquely positioned at the intersection of...

  • Highly Skilled Go and Java Developer Wanted for Enterprise-Focused Platform

    3 weeks ago

    Bengaluru, Karnataka, India Awign Expert Full time

    About Awign Expert:A cutting-edge platform that empowers businesses to hire, assess, and manage top-notch resources for large-scale gig-based projects. This innovative platform provides experts with a gateway to build a lucrative freelance/consulting career with global enterprises.About the Client:A global leader in next-generation digital services and...