Lead Databricks Analyst

3 weeks ago

Erode, India Rialtes Full time

Location: RemoteEmployment Type: Full-TimeOverviewRialtes is seeking a Databricks Support Analyst to manage platform operations, ensure reliability of clusters and jobs, and support development of data workflows. Role requires hands-on experience with Databricks administration, SQL-based development, and basic Python.Key ResponsibilitiesPrimary: Platform SupportMonitor and maintain Databricks clusters, jobs, workflows, and schedules.Troubleshoot issues related to compute resources, job failures, data ingestion completeness, schema changes, and data accuracy.Manage user provisioning, access controls, workspace permissions, and catalogs using Unity Catalog aligned with governance standards.Ensure cost-optimized cluster usage and enforce security, tagging, and compliance policies.Collaborate with Cloud Ops, Data Engineering, and InfoSec teams to resolve platform-wide incidents.Secondary: Design & DevelopmentAssist in building Databricks workflows for ETL, analytics, and machine learning pipelines.Support development and optimization of notebooks and scripts—primarily SQL, with some Python for transformations and validations.Implement best practices for job cluster configuration, Photon acceleration, Delta Lake, and Unity Catalog integration.Participate in unit testing, functional testing, UAT cycles, and production migration of Databricks jobs.Contribute to documentation including runbooks, SOPs, job catalogs, and data lineage.Qualifications5 years of experience in Databricks, data engineering support, or cloud platform operations.Strong SQL skills; working knowledge of Python preferred.Hands-on experience with Databricks clusters, job orchestration, Delta Lake, and Unity Catalog.Understanding of ETL workflows, CI/CD for data pipelines, and cloud environments (AWS/Azure/GCP).Strong debugging skills for job failures, performance bottlenecks, and ingestion issues.Ability to work in fast-paced environments with cross-functional teams.Nice-to-HaveDatabricks Certified Associate or equivalent.Exposure to MLflow, Data Quality (DQ) frameworks, or Databricks Workflows orchestration.Experience with Git, DevOps tools, or monitoring solutions (CloudWatch, Azure Monitor, etc.).

  • Databricks Architect

    2 weeks ago

    Erode, India HARP Full time

    Lead the architecture, design, and implementation of data lakehouse solutions leveraging Databricks, Delta Lake, Unity Catalog, and Apache Spark.Define and enforce architectural best practices for data ingestion, ETL/ELT processing, data transformation, governance, and analytics.Oversee deployment, scaling, configuration, and cost optimization of Databricks...

  • AVP - Databricks Architect

    4 weeks ago

    Erode, India Impetus Career Consultants Full time

    Assistant Vice President – Lead Databricks ArchitectShift Type: UK ShiftWork Model: 5 Days Work From OfficeLead the design and delivery of large-scale data engineering solutions on Azure and Databricks Lakehouse. This role focuses on scalable data pipelines, Unity Catalog governance, ML/LLM enablement, and driving engineering excellence.Key...

  • Lead Data Analyst

    5 days ago

    erode, India beBeeData Full time

    Lead Data AnalystOur organization is looking for a highly skilled Lead Data Analyst to spearhead our data-driven initiatives. As a key player in our team, you will design and implement advanced analytics solutions to drive business success.Develop, refine and deploy predictive models using machine learning algorithms and statistical techniques.Analyze...

  • Sustainability-Focused Data Engineer Opportunity

    4 days ago

    erode, India beBeeData Full time

    Job Overview:We are seeking a seasoned Databricks Data Engineer to drive our Sustainability initiative forward. This pivotal role involves building data pipelines and models to support product-level carbon footprint analysis.Key Responsibilities:Develop and optimize ETL/ELT pipelines on Databricks using PySpark and SQL for carbon footprint analytics.Build...

  • Senior Data Engineering Specialist

    10 hours ago

    erode, India beBeeDataEngineer Full time

    Job DescriptionWe are seeking a highly skilled professional to join our data engineering team as a Senior Data Engineer. The ideal candidate will have extensive hands-on experience in building and optimizing data ingestion and transformation pipelines using Azure Data Platform, Databricks, Snowflake, and Kafka.The successful candidate will be responsible for...

  • Strategic Portfolio Analyst

    5 days ago

    erode, India beBeeInvestment Full time

    Role OverviewArcana seeks highly skilled analysts to build institutional-grade analytics for leading hedge funds and asset managers.Work closely with portfolio managers, risk managers, analysts, and CIOs from top hedge funds and asset managers.Uncover alpha, beta, and idiosyncratic drivers in portfolios.Design and validate cutting-edge analytics that address...

  • Cloud Data Engineering Expert

    5 days ago

    erode, India beBeeData Full time

    About the RoleAs a Cloud Data Engineer, you will play a crucial part in designing, developing, and maintaining scalable ETL pipelines using cloud-native tools. Your expertise will be invaluable in architecting and implementing data lakes and data warehouses on cloud platforms.You will develop and optimize data ingestion, transformation, and loading processes...

  • Data Architecture Specialist

    2 days ago

    erode, India beBeeData Full time

    Cloud Data ArchitectThe cloud data architect will be responsible for designing and developing scalable, secure, and efficient data platforms and systems. The role requires expertise in Azure Databricks, Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), Event Hub, and other Azure services.Create and implement data solutions using Azure technologies to...

  • Data Architect

    13 hours ago

    erode, India beBeeData Full time

    Data Engineering PositionAbout UsWe are a fast-growing distributed workforce enabler, helping companies scale with top global talent. We empower businesses by providing world-class software engineers, operations support, and infrastructure to help them grow faster and better.Position: Snowflake & Databricks Data Engineer / Data Science EngineerExperience: 9+...

  • Senior Business Intelligence Developer

    5 days ago

    erode, India beBeeData Full time

    Key Financial Analyst Position AvailableAbout the JobWe are seeking a skilled Data Engineer with expertise in designing and developing dimensional data models to support financial reporting. The successful candidate will work closely with stakeholders to understand complex financial concepts, translate them into scalable data models, and build robust data...