Senior Cloud Data Engineer

2 days ago

Gandhinagar, Gujarat, India beBeeData Full time ₹ 16,62,390 - ₹ 20,19,900

Job Overview

We are seeking an expert in data engineering to oversee the development and maintenance of our Azure-based platform. This role combines system reliability, security auditing, and DevOps practices to ensure a robust, secure, and scalable data infrastructure.

Key Responsibilities:

  • Monitor and maintain Databricks-based data pipelines and Azure data services (e.g., Data Lake, Synapse, Key Vault).
  • Implement CI/CD pipelines using Azure DevOps for data engineering workflows.
  • Conduct regular system health checks and performance tuning of clusters and jobs.
  • Automate infrastructure provisioning using tools like Terraform or ARM templates.
  • Use monitoring tools (e.g., Azure Monitor, Log Analytics, Prometheus) to track system metrics and alert on anomalies.
  • Perform security audits using tools like Databricks Security Analysis Tool (SAT) to ensure compliance with best practices.
  • Manage secrets and credentials securely using Azure Key Vault and Databricks secret scopes.
  • Collaborate with security teams to enforce network security, access control, and data encryption policies.
  • Maintain operational runbooks and incident response plans.

Qualifications:

  • Bachelor's degree in computer science, Engineering, or related field.
  • 5+ years of experience in DevOps, cloud operations, or data platform support.
  • Proficiency in Azure services, Databricks, and scripting languages (Python, Bash).
  • Experience with CI/CD tools (Azure DevOps, GitHub Actions) and infrastructure-as-code.
  • Familiarity with security frameworks and auditing tools in cloud environments.
  • Strong troubleshooting skills and a proactive approach to system reliability.

  • Cloud Data Engineer

    22 hours ago

    Gandhinagar, Gujarat, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Data Engineering OpportunityWe are seeking an experienced Data Engineer to join our team in building scalable data pipelines and cloud-native solutions. The ideal candidate will be proficient in designing, developing, and optimizing robust data ingestion pipelines using cloud services such as Pub/Sub, Dataflow, and Cloud Storage.Key Responsibilities:Design...

  • Senior Cloud Data Engineer

    2 weeks ago

    Gandhinagar, Gujarat, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,40,00,000

    Job Opportunity Overview">We are seeking highly skilled professionals to join a mission-critical banking project as Senior Data Engineers.This is your chance to work on cutting-edge data pipelines, streaming platforms, and cloud-based infrastructures—building scalable, high-performance solutions for a leading financial services environment.What You'll Work...

  • Cloud Data Engineer

    4 days ago

    Gandhinagar, Gujarat, India beBeeData Full time ₹ 13,00,000 - ₹ 20,10,000

    Cloud Data Engineering Position\Our organization seeks a seasoned data engineer with expertise in designing, building, and maintaining large-scale data pipelines.\The successful candidate will be responsible for developing, constructing, testing, and maintaining data acquisition pipelines for large volumes of structured and unstructured data in Google...

  • Senior Cloud Data Specialist

    2 days ago

    Gandhinagar, Gujarat, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Data Engineer Position">As a senior data engineer, you will be responsible for designing and developing large-scale data processing systems. Your expertise in Python and cloud computing will be crucial in driving business success.Responsibilities:Design, develop, and maintain scalable data infrastructure solutionsCollaborate with cross-functional teams to...

  • AWS Cloud Data Engineer Leader

    7 days ago

    Gandhinagar, Gujarat, India beBeeCloud Full time ₹ 15,00,000 - ₹ 25,00,000

    Achieve Excellence in Cloud Data Engineering as a Senior AWS Glue Developer.Job Summary:Design and implement scalable data ingestion and transformation solutions using AWS services.Main Responsibilities:Develop and manage serverless data pipelines with AWS Glue, ensuring seamless data flow and efficient processing.Migrate legacy ETL processes to ELT,...

  • Cloud Data Engineer

    1 week ago

    Gandhinagar, Gujarat, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Cloud Data Engineer Opportunity As a Cloud Data Engineer, you will collaborate closely with data scientists to design and develop innovative algorithms that provide valuable insights into our data. The role involves building complex data pipelines to clean, transform, and aggregate data from diverse sources. Your expertise in big data and cloud technologies...

  • Cloud Data Engineer

    6 days ago

    Gandhinagar, Gujarat, India beBeeData Full time ₹ 35,00,000 - ₹ 45,00,000

    Data Modeler Job DescriptionThis role involves the design, development and optimization of scalable data pipelines using Azure Data Factory, Databricks and Kafka.The ideal candidate will bring expertise in cloud-based data engineering, healthcare data modeling and consulting with a strong background in Azure, Databricks, Azure Data Factory (ADF), Kafka and...

  • AWS Cloud Data Specialist

    1 week ago

    Gandhinagar, Gujarat, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Senior AWS Data Engineer Job DescriptionThe position of Senior AWS Data Engineer involves designing, developing, and deploying end-to-end data pipelines on the AWS cloud infrastructure using services such as Amazon S3, AWS Glue, AWS Lambda, Amazon Redshift, etc. This role requires a deep understanding of data processing and transformation workflows using...

  • Senior Data Engineering Specialist

    2 days ago

    Gandhinagar, Gujarat, India beBeeSenior Full time ₹ 20,00,000 - ₹ 30,00,000

    We are seeking an experienced Senior ETL Developer to join our organization. The ideal candidate will have a proven track record of designing, developing, and deploying scalable data pipelines and ETL processes using Databricks.Key Responsibilities:Design and develop efficient ETL processes and data pipelines that meet business requirementsOptimize Spark...

  • Lead Data Engineering Specialist

    2 days ago

    Gandhinagar, Gujarat, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior Data Engineer Job DescriptionWe are seeking a highly skilled Senior Data Engineer to lead our data engineering efforts. The ideal candidate will have expertise in cloud platforms, ETL processes, data warehousing, and big data technologies.Job RequirementsTo design, deploy, and maintain large-scale data platforms with high efficiency and scalability.To...