Cloud Data Engineer

2 days ago

Hyderabad Secunderabad Telangana Bengaluru Bangalore, India beBeeData Full time ₹ 8,00,000 - ₹ 20,00,000
Databricks Expert

This role focuses on leveraging Databricks as a cloud-based data and AI platform to drive business growth and innovation. Key responsibilities include:

  • Workspace Optimization: Streamline Databricks workspace management, ensuring seamless collaboration and efficient resource allocation.
  • User Identity Management: Develop and implement robust user identity management systems, incorporating multi-factor authentication and fine-grained access control.
  • Cluster Administration: Configure and optimize Databricks clusters for maximum performance and efficiency, balancing compute resources with scalability needs.
  • Security & Compliance: Implement and maintain industry-leading security standards, including encryption, access policies, and compliance frameworks.
  • Performance Enhancement: Troubleshoot and resolve complex performance issues related to Databricks workloads, collaborating with cross-functional teams to drive resolution.
  • Integration & Automation: Integrate Databricks with other cloud services (AWS, Azure, GCP), streamlining workflows and enhancing overall system efficiency.
  • Monitoring & Logging: Design and implement monitoring tools, analyzing logs to ensure optimal system health and prevent potential issues.
  • Data Governance: Develop and enforce Unity Catalog governance strategies, managing structured data access and ensuring regulatory compliance.
  • Collaboration: Foster close working relationships with data engineers, analysts, and scientists, providing expert guidance and support to enhance their workflows.
Required Skills and Qualifications
  • Proficiency in Python or Scala programming languages for scripting and automation.
  • Extensive knowledge of cloud platforms (AWS).
  • Familiarity with Databricks Delta Lake and MLflow.
  • Understanding of ETL processes and data warehousing concepts.
  • Strong analytical and problem-solving skills, with the ability to drive results-oriented solutions.
What We Offer

This is an exciting opportunity to join a cutting-edge team and contribute to shaping the future of data and AI. As a key member of our organization, you can expect:

  • A competitive compensation package.
  • Ongoing training and professional development opportunities.
  • A dynamic and collaborative work environment.

  • Cloud Data Engineer

    2 days ago

    Hyderabad / Secunderabad, Telangana, India beBeeDataEngineering Full time

    Key ObjectivesWe are seeking an experienced data engineer to design and implement a future-proof, cloud-native data processing framework.The ideal candidate will have extensive experience in building scalable data solutions, strong analytical skills, and a passion for leveraging GCP Services to develop tools and frameworks that support data engineering...

  • Cloud Data Engineer

    4 days ago

    Kolkata, Bengaluru / Bangalore, Hyderabad / Secunderabad, Telangana, India beBeeData Full time ₹ 8,00,000 - ₹ 20,00,000

    Job Title: Cloud Data EngineerAbout This RoleWe are seeking an experienced Cloud Data Engineer to join our team. In this role, you will be responsible for architecting and developing cloud-native solutions using R software development skills.Key ResponsibilitiesData Engineering: Design, develop, and maintain large-scale data pipelines and architectures using...

  • Senior Cloud Data Engineer

    4 days ago

    Bengaluru / Bangalore, Kolkata, Hyderabad / Secunderabad, Telangana, India beBeeDataEngineering Full time ₹ 12,00,000 - ₹ 30,00,000

    Cloud Data Engineer JobWe are looking for a skilled Cloud Data Engineer to join our team. As a Cloud Data Engineer, you will be responsible for designing and developing scalable data pipelines using Google Cloud Platform services.You will work on building and maintaining data lakes and data warehouses, implementing and optimizing data ingestion from various...

  • Cloud Data Engineering Expert

    4 days ago

    Hyderabad / Secunderabad, Telangana, Bengaluru / Bangalore, Chennai, India beBeeDataEngineer Full time ₹ 8,00,000 - ₹ 12,00,000

    Job OverviewAs a senior cloud data engineer, you will play a crucial role in designing and implementing scalable data pipelines using Python and Spark in Azure Databricks.Key ResponsibilitiesDevelop and optimize efficient data orchestration workflows using DatabricksImplement CI/CD pipelines with GitHub for seamless automated deploymentsDesign and manage...

  • Cloud-Based Data Engineer

    2 days ago

    Hyderabad / Secunderabad, Telangana, India beBeeDataengineering Full time

    Data Engineer Position OverviewWe are seeking a skilled Data Engineer to join our team. The ideal candidate will have experience working with cloud-based data platforms and be able to design, develop, and implement scalable data solutions.About the RoleAs a Data Engineer, you will work closely with our Data Science team to architect and implement data...

  • Cloud Data Engineer

    4 days ago

    Hyderabad / Secunderabad, Telangana, Pune, Chennai, India beBeeCloud Full time ₹ 12,00,000 - ₹ 30,00,000

    Job Title: Scalable Data EngineerJob DescriptionWe are seeking a skilled Cloud Data Engineer to design, develop and maintain scalable data pipelines using Spark and Databricks. The ideal candidate will have experience working with cloud platforms such as AWS, Azure and GCP, and a deep understanding of data engineering, ETL processes and cloud-native...

  • Cloud Engineer

    1 day ago

    Hyderabad / Secunderabad, Telangana, India beBeeCloud Full time ₹ 9,00,000 - ₹ 12,00,000

    Job Overview:We are seeking a skilled professional to join our team as a Cloud Engineer. In this role, you will be responsible for designing, implementing, and maintaining scalable cloud-based architectures using Google Cloud Platform (GCP) services.Key Responsibilities:Develop and maintain automation scripts and backend services using Python.Write complex...

  • Cloud Data Architect

    2 days ago

    Hyderabad / Secunderabad, Telangana, Bengaluru / Bangalore, Kolkata, India beBeeDataEngineer Full time ₹ 9,00,000 - ₹ 12,00,000

    Job OverviewWe are seeking a highly skilled Data Engineer to design and develop scalable data pipelines using Google Cloud services. The ideal candidate will have a strong understanding of data engineering principles, experience with GCP tools, and the ability to work collaboratively with stakeholders.Key Responsibilities:Design and develop scalable ETL/ELT...

  • Senior Data Engineer

    2 days ago

    Hyderabad / Secunderabad, Telangana, India beBeeDataEngineering Full time ₹ 9,00,000 - ₹ 12,00,000

    We are seeking a highly skilled Data Engineering professional with a strong background in Google Cloud Platform (GCP), BigQuery, Looker, and SQL.Key ResponsibilitiesData Solution Design & Development: We require an individual to design, develop, and maintain robust and scalable data solutions on GCP.BigQuery & Data Warehousing: The ideal candidate will work...

  • Cloud-Based Data Engineering Specialist

    2 days ago

    Chennai, Hyderabad / Secunderabad, Telangana, Bengaluru / Bangalore, India beBeeDataEngineer Full time ₹ 8,00,000 - ₹ 12,00,000

    Job TitleAzure Databricks EngineerAbout the RoleThis position involves designing and optimizing scalable data pipelines using Python and Spark in Azure Databricks. The ideal candidate will leverage Databricks workflows and Asset Bundles for efficient data orchestration, implement and manage CI/CD pipelines using GitHub for automated deployments, and apply...