Big Data Platform Specialist

5 days ago


bangalore, India beBeeData Full time

Job Title: Big Data Platform SpecialistLocation: Ghansoli, MumbaiWork Mode: OnsiteExperience: 6–8 YearsShift: 16×5 Rotational (Morning / Afternoon / General) Weekend & Night support on need basisAbout the RoleWe are seeking an experienced Big Data Platform Specialist to join our team. The ideal candidate will bring strong expertise in Databricks administration, Spark debugging, and Azure cloud support to ensure reliable and high-performing data platform operations.Key ResponsibilitiesAct as First-Level Escalation for 24×7 monitoring of Databricks clusters, jobs, workflows, repos, and data pipelines.Troubleshoot and analyze issues related to Cluster failures/auto-scaling problems, Job failures (PySpark, Scala, Spark SQL, DLT), Workspace & availability issues.Work closely with application development teams to remediate pipeline failures.Participate in Sev1/Sev2 incident resolution and prepare RCA reports.Implement workspace governance, RBAC, cluster policies, and data security best practices.Ensure compliance with audit and platform governance requirements.Build dashboards/logging for job performance, cluster utilization, and failure analytics.Maintain SOPs, runbooks, and architecture documentation.Identify recurring issues and collaborate with L3/platform engineering teams.Debug complex Spark issues (OOM, long GC cycles, driver/executor failures).Required Skills and Qualifications6–10 years of experience in Big Data/Cloud Data Platform Support.Strong SME-level experience with Databricks (clusters, jobs, repos, MLflow, warehouse).Expertise in UNIX, SQL, Shell Scripting, and Azure Cloud.Strong knowledge of Apache Spark and Spark UI/JOB debugging.Experience with CI/CD pipelines using Azure DevOps.EducationB.E/B.Tech/MCA



  • bangalore, India beBeeData Full time

    Big Data SpecialistA specialist with hands-on experience of big data tools, Python, and object-oriented programming is required.Develop, tweak queries, and enhance performance.Deliver code, set up environment, connectivity, deploy the code in production after thorough testing.Prior knowledge of DWH and Data Lake is advantageous.The ideal candidate should...

  • Big Data

    2 weeks ago


    bangalore, India Tata Consultancy Services Full time

    Greetings from TCS!TCS is hiring for Big Data Required Technical Skill Set -MS Azure Cloud Platform, Big Data with Hadoop, Python, Hive, Azure data and admin analysisLocation: - Chennai / BangaloreDesired Experience Range: 5 to 12 yearsMust to HaveHands on experience in installation, configuration, supporting and managing Hadoop clusters using Hortonworks...


  • bangalore, India beBeeDataOps Full time

    Job OpportunityWe are seeking a skilled professional to join our team as a Data Operations Specialist.Manage and support high-performance big data platforms for continuous improvement.Support analytics solutions based on Spark clusters, Airflow workflow management systems, and Tableau visualization platforms.Participate in on-duty rotations, resolve...


  • bangalore, India beBeeDataEngineering Full time

    About the RoleWe invite applications for a Data Engineering Specialist role at HCLTech.This position involves working with various data processing tools such as BigQuery, Cloud Composer or Airflow, Dataflow or Dataproc or Datafusion, and utilizing programming languages like Python or Pyspark and SQL.Design, develop, and maintain large-scale data processing...

  • Platform Data Lead

    4 days ago


    bangalore, India ZeroFOX Full time

    Opportunity OverviewAs a Platform Data Specialist team member, you will join the Technology Operations team, a group of highly skilled individuals working to protect enterprise-level commercial customers from digital risk. Using our proprietary platform, this role focuses on supporting our Platform Specialist team by identifying and conducting detailed...

  • Big Data Developer

    7 hours ago


    bangalore, India UST Full time

    We are seeking a Big Data Engineer with strong hands-on experience in Spark and AWS technologies. The ideal candidate should demonstrate a deep understanding of big data concepts, programming fundamentals, and the ability to solve complex problems related to scalability, failure handling, and optimization. Key Responsibilities: Design, develop, and optimize...

  • AI Architect

    7 hours ago


    bangalore, India beBeeDataEngineer Full time

    Job OverviewYou will be an integral part of our AI Platform Team, supporting the next generation AI architecture for various research and engineering teams.Partner with vendors and infrastructure engineering teams to ensure security and service availabilityCollaborate with engineering teams, researchers, and data scientists to fix production issues related...

  • Big Data Developer

    3 weeks ago


    Bangalore Division, India Sourcebae Full time

    🚀 Job Alert: Senior Big Data Engineer (5-8 Yrs) | Spark, Python, Scala 🚀 Are you a seasoned Big Data Engineer ready to build and optimize large-scale, distributed data processing applications? We are seeking a senior engineer with 5-8 years of experience in the core Big Data ecosystem to deliver high-performance solutions. This is a great opportunity...


  • bangalore, India beBeeDataEngineer Full time

    Job DescriptionWe are seeking a candidate for our big data operations team to support the central SRE team in managing production data pipelines. The ideal candidate should have exposure to AWS data Services and Snowflake DW environment.Required Skills and QualificationsStrong exposure to manage data pipelines on AirflowHands on or working knowledge of AWS...


  • bangalore, India AMISEQ Full time

    SRE & Devops (Big Data) Immediate Joiner only Bengaluru, KA Exp- 3-6 Years You will be a member of our AI Platform Team, supporting the next generation AI architecture for various research and engineering teams within the organization. ● You'll partner with vendors and the infrastructure engineering team for security and service availability ● You'll fix...