Cloud Data Engineer

6 hours ago

Hyderabad, Telangana, India beBeeCloudDataEngineer Full time ₹ 12,00,000 - ₹ 20,00,000
Job Title: Cloud Data Engineer

We are seeking a skilled cloud data engineer to monitor and maintain Databricks jobs, troubleshoot issues, ensure platform reliability, and manage access controls.

Main Responsibilities:

  • Monitor hourly and daily Databricks jobs, investigate failures, and implement fixes to minimize downtime.
  • Identify, log, and track defects/bugs through ticketing systems, ensuring timely resolution.
  • Manage Databricks access via Azure AD groups with Admin, Edit, and Read permissions.
  • Provide production support for Databricks environments, including cluster operations, job failures, and notebook troubleshooting.
  • Collaborate with data engineers and platform teams to resolve platform-related incidents and performance bottlenecks.
  • Proactively monitor system health, resource utilization, and performance metrics.
  • Implement and enforce archival/retention policies for Databricks storage to optimize costs and performance.
  • Support CI/CD pipelines (Jenkins, Azure Automation) and automate repetitive operational tasks.
  • Maintain technical documentation, SOPs, and runbooks for Databricks operations.
About the Role
  • Bachelor's degree in Computer Science, IT, or equivalent professional experience required.
  • 5+ years of experience in data engineering, cloud operations, or database administration required.
  • Excellent problem-solving skills, communication, and cross-team collaboration abilities required.
Requirements
  • Strong knowledge of Azure (AWS/GCP acceptable) and cloud-native services required.
  • Experience in SRE or production support environments with SLAs and ticketing systems (ServiceNow, Jira) required.
  • Proficiency in Python or Scala for data processing and automation required.
  • Familiarity with Power BI/Tableau for building monitoring and cost dashboards required.
  • Knowledge of CI/CD tools, version control (Git), and scripting languages (PowerShell, Bash) required.
  • Understanding of cloud cost optimization and usage tracking required.
Nice to Have
  • Experience with Databricks Lakehouse/Madelaine architecture beneficial.
  • Background in monitoring, logging, and incident response for data platforms beneficial.

Key Performance Indicators (KPIs): Minimize downtime, ensure platform reliability, and manage access controls effectively.

Contact Information: Please submit your resume and cover letter to apply for this position.

  • Salesforce Data Cloud Consultant

    3 weeks ago

    Hyderabad, Telangana, India NTT Data Full time

    Job DescriptionNTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Salesforce Data Cloud Consultant to join our team in Hyderabad, Telangana, India.Job Title: Salesforce Data Cloud...

  • Cloud Data Engineer

    7 days ago

    Hyderabad, Telangana, India beBeeData Full time ₹ 16,12,039 - ₹ 20,25,321

    Job Title: Cloud Data EngineerWe are seeking a skilled Cloud Data Engineer to join our team. This role involves designing, maintaining, and optimizing secure and scalable data movement services in a cloud-native environment.Key Responsibilities:Hands-On Data Integration Engineering: Develop and implement data integration solutions using cloud-based...

  • Azure Data Engineer

    1 week ago

    Hyderabad, Telangana, India Enable Data Incorporated Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Enable Data Incorporated is currently seeking a skilled and experienced Azure Data Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, Enable Data has developed deep expertise across various industries. We work closely with our customers to leverage modern solutions and technologies to drive...

  • Cloud Data Engineer

    10 hours ago

    Hyderabad, Telangana, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 25,00,000

    Cloud Data Engineer Role OverviewWe are seeking a highly skilled Cloud Data Engineer to join our team. The ideal candidate will be responsible for designing, developing, and maintaining data pipelines and analytical solutions on Snowflake, ensuring high performance, scalability, and reliability.

  • Azure Data Engineer ll

    4 weeks ago

    Hyderabad, Telangana, India Enable Data Incorporated Full time

    Enable Data Incorporated is currently seeking a skilled and experienced Azure Data Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, Enable Data has developed deep expertise across various industries. We work closely with our customers to leverage modern solutions and technologies to drive...

  • Cloud Data Engineer

    10 hours ago

    Hyderabad, Telangana, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Cloud Data ArchitectThis role entails designing, building, and maintaining scalable cloud-native data pipelines utilizing AWS.The ideal candidate should possess expertise in ETL tools such as Glue, Pyspark, and Python, along with strong coding skills.Additionally, proficiency in data warehousing solutions like Snowflake, BigQuery, Lakehouse, and Delta Lake...

  • Cloud Data Engineer

    2 days ago

    Hyderabad, Telangana, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 30,00,000

    Cloud Data Engineering SpecialistJob Description:We are seeking an experienced Cloud Data Engineering Specialist to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and optimizing robust, scalable, and secure cloud-based data pipelines and infrastructure.You will work with diverse datasets and...

  • Cloud Data Engineering Opportunities

    2 days ago

    Hyderabad, Telangana, India beBeeDataEngineer Full time ₹ 35,00,000 - ₹ 42,00,000

    Cloud Data Engineer PositionThe role of a Cloud Data Engineer involves collaborating with stakeholders to identify business requirements for data-related projects and designing, implementing, and maintaining data architectures for cloud-based services.Key Responsibilities:Design and implement efficient ETL processes to load data into data...

  • Cloud Data Engineering Lead

    14 hours ago

    Hyderabad, Telangana, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Data Engineer - Cloud TechnologiesWe are seeking a seasoned Senior Data Engineer with extensive experience in cloud technologies. As a pivotal member of our data engineering team, you will play a crucial role in designing, implementing, and optimizing data pipelines.

  • Cloud Data Engineering Expert

    3 days ago

    Hyderabad, Telangana, India beBeeDataEngineer Full time US$ 8,00,000 - US$ 12,50,000

    About the RoleWe are seeking a seasoned and proficient Senior Data Engineer with substantial experience in cloud technologies. As a pivotal member of our data engineering team, you will play a crucial role in designing, implementing, and optimizing data pipelines, ensuring seamless integration with cloud platforms.