Databricks Expert

1 week ago

Noida Gurgaon Gurugram, India beBeeData Full time US$ 1,00,000 - US$ 1,50,000

We're seeking an experienced Databricks Expert to join our team. This role requires a strong understanding of Databricks administration, coupled with expertise in AWS infrastructure and data warehousing concepts.

Key Responsibilities
  • Databricks Infrastructure Management: Manage and optimize Databricks clusters at scale, ensuring high availability and performance.
  • Deployment & Configuration: Oversee deployments within Databricks and work with Databricks System tables for monitoring and management.
  • Troubleshooting & Support: Provide strong troubleshooting capabilities for issues within Databricks notebooks and address Databricks-related queries from the analyst community.
  • Cloud & Data Platform Fundamentals: Apply good knowledge of AWS services and strong fundamentals of Data Warehousing (DW) / Data Lakehouse (DH) concepts.
  • Coding & Automation: Utilize Spark/Python for scripting and automation within the Databricks environment.
  • Containerization & Orchestration: Work with Docker and Kubernetes.
  • AWS Services Integration: Leverage knowledge of relevant AWS services such as S3, Lambda, and EMR.
Required Skills
  • Good knowledge of AWS, Databricks, and Unity Catalog.
  • Strong experience in managing Databricks clusters and deployments.
  • Strong fundamentals of Data Warehousing (DW) / Data Lakehouse (DH) concepts.
  • Strong troubleshooting abilities within the Databricks environment.
  • Proficiency in Spark/Python (either coding skills).
  • Experience with Docker, Kubernetes, and AWS services (S3, Lambda, EMR).
  • Expertise in managing clusters at scale and troubleshooting within Databricks.
  • Experience working with Databricks System tables.
  • Strong knowledge of Databricks infrastructure and administration to support the Analyst community in addressing Databricks-related queries and troubleshooting issues in notebooks.
Qualifications
  • Bachelor's degree in Computer Science, Engineering, or a related field.
  • Proven experience as a Databricks Admin or in a similar role.
  • Typically seeking candidates with 6+ years of relevant experience.
  • Certified Databricks Engineer is required.

  • Databricks Expert

    2 weeks ago

    Noida, Uttar Pradesh, India beBeeData Full time ₹ 18,00,000 - ₹ 24,00,000

    Job Title: Databricks ProfessionalWe are seeking a skilled Databricks professional to join our team. As a key member, you will design, build, and maintain scalable data pipelines and workflows using Azure Databricks.Key Responsibilities:Develop ETL pipelines using Python, SQL, and Delta Live TablesManage job execution through Databricks Jobs, including...

  • Data Engineer

    6 days ago

    Noida, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 1,40,000 - ₹ 28,00,000

    Job Title: Data Engineer - Databricks ExpertWe are seeking an experienced data engineer to lead our Databricks team in designing and implementing scalable data solutions on the cloud. As a proactive and innovative professional, you will be responsible for architecting efficient data models, collaborating with cross-functional teams, and ensuring the...

  • Azure Databricks Developer

    2 days ago

    Noida, India Coforge Full time

    Core Responsibilities- Seasoned Databricks developer having 6+ years of experience is expected to design, build, and maintain scalable data pipelines and workflows using Azure Databricks. This includes: - Developing ETL pipelines using Python, SQL, and Delta Live Tables - Managing job execution through Databricks Jobs, including scheduling and...

  • Azure Databricks Developer

    3 weeks ago

    Noida, Uttar Pradesh, India Coforge Full time

    Core Responsibilities- Seasoned Databricks developer having 6+ years of experience is expected to design, build, and maintain scalable data pipelines and workflows using Azure Databricks. This includes: Developing ETL pipelines using Python, SQL, and Delta Live Tables Managing job execution through Databricks Jobs, including scheduling and parameterisation...

  • Azure Databricks Developer

    2 weeks ago

    Noida, Uttar Pradesh, India Coforge Full time

    Core Responsibilities-Seasoned Databricks developer having 6+ years of experience is expected to design, build, and maintain scalable data pipelines and workflows using Azure Databricks. This includes:- Developing ETL pipelines using Python, SQL, and Delta Live Tables- Managing job execution through Databricks Jobs, including scheduling and parameterisation-...

  • Azure Databricks Developer

    1 week ago

    Noida, Uttar Pradesh, India Coforge Full time

    Core Responsibilities-Seasoned Databricks developer having 6+ years of experience is expected to design, build, and maintain scalable data pipelines and workflows using Azure Databricks. This includes:Developing ETL pipelines using Python, SQL, and Delta Live TablesManaging job execution through Databricks Jobs, including scheduling and...

  • Azure Databricks Developer

    3 days ago

    Noida, India Coforge Full time

    Core Responsibilities- Seasoned Databricks developer having 6+ years of experience is expected to design, build, and maintain scalable data pipelines and workflows using Azure Databricks. This includes: Developing ETL pipelines using Python, SQL, and Delta Live Tables Managing job execution through Databricks Jobs, including scheduling and...

  • Azure Databricks Developer

    3 days ago

    Noida, India Coforge Full time

    Core Responsibilities-Seasoned Databricks developer having 6+ years of experience is expected to design, build, and maintain scalable data pipelines and workflows using Azure Databricks. This includes:Developing ETL pipelines using Python, SQL, and Delta Live TablesManaging job execution through Databricks Jobs, including scheduling and...

  • Azure Databricks Developer

    2 days ago

    Noida, India Coforge Full time

    Core Responsibilities-Seasoned Databricks developer having 6+ years of experience is expected to design, build, and maintain scalable data pipelines and workflows using Azure Databricks. This includes:Developing ETL pipelines using Python, SQL, and Delta Live TablesManaging job execution through Databricks Jobs, including scheduling and...

  • Unlock Your Potential as a Databricks Data Engineering Expert

    2 weeks ago

    Noida, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 1,04,000 - ₹ 1,30,878

    Transform your career as a high-impact Data Engineering Expert on the Databricks platform.Our team seeks a skilled professional to design, develop, and optimize data processing pipelines that drive business success. As a key member of our engineering team, you will collaborate with cross-functional groups to migrate existing solutions, ensure the reliability...