Cloud Data Engineer

3 days ago

Mysore, Karnataka, India beBeeData Full time ₹ 10,00,000 - ₹ 20,00,000

Cloud Data Engineer (Azure Databricks)

This position involves designing and developing data ingestion pipelines for integrating multiple sources into Databricks. As a key team member, you will be responsible for implementing and maintaining Continuous Integration/Continuous Deployment (CI/CD) pipelines for data workflows.

Key Responsibilities:

  • Develop and deploy scalable data ingestion pipelines to integrate multiple sources into Azure Databricks.
  • Design and implement CI/CD pipelines for automated deployment and testing of data workflows.
  • Maintain containerized applications using Kubernetes for efficient data processing.
  • Evaluate and improve data integrity, security, and compliance throughout the ingestion process.
  • Collaborate with cross-functional teams to develop and optimize data ingestion strategies.

Required Skills & Qualifications:

  • Proven experience in data ingestion and pipeline development.
  • Hands-on experience with CI/CD tools (GitHub Actions, Jenkins, Azure DevOps).
  • Strong knowledge of Kubernetes and container orchestration.
  • Experience with Databricks, Spark, and data lake architectures.
  • Proficiency in Python, Scala, or SQL for data processing.
  • Familiarity with cloud platforms such as AWS, Azure, or GCP.

Preferred Qualifications:

  • Experience with Infrastructure as Code (Terraform, Helm).
  • Background in streaming data ingestion (Kafka, Kinesis).
  • Knowledge of data governance and security best practices.

We offer flexible working hours and opportunities for professional growth.

  • Cloud Data Engineer

    2 hours ago

    Mysore, Karnataka, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Cloud Data Engineer – BFSI DomainWe are seeking a skilled Cloud Data Engineer to join our prestigious BFSI project. In this role, you will collaborate with data science teams to design and implement scalable data pipelines.Your primary responsibilities include collaborating with cross-functional teams, building back-end systems using agile development...

  • Cloud Architect

    13 hours ago

    Mysore, Karnataka, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior AWS Data Engineer Job OpportunityThis key role involves designing, developing, and deploying comprehensive data pipelines on Amazon Web Services (AWS) cloud infrastructure using various services such as Amazon S3, AWS Glue, AWS Lambda, and Amazon Redshift.The ideal candidate will have a strong proficiency in AWS services, Apache Spark for data...

  • Principal Cloud Engineer

    1 day ago

    Mysore, Karnataka, India beBeeData Full time ₹ 1,20,00,000 - ₹ 1,80,00,000

    Job Summary:Highly skilled professionals with strong hands-on experience in Databricks and AWS are sought after to join our dynamic data engineering team.The ideal candidate will be well-versed in PySpark, CI/CD pipelines, and Terraform for infrastructure as code. Experience with Data Access Broker (DAB) is highly preferred.Key Responsibilities:Design,...

  • Senior Data Engineer

    17 hours ago

    Mysore, Karnataka, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job OverviewWe are seeking an experienced Big Data Engineer to join our data engineering team. The ideal candidate will have a proven track record in building, scaling, and optimizing big data pipelines, as well as hands-on experience with distributed data systems and cloud-based solutions.The successful candidate will be responsible for designing,...

  • Senior Cloud Data Architect

    17 hours ago

    Mysore, Karnataka, India beBeeDataEngineer Full time ₹ 1,00,00,000 - ₹ 1,50,00,000

    About us:We are an e-commerce focused end-to-end data analytics firm assisting enterprises and brands in making informed business decisions to maximize value.Our work spans data extraction, transformation, visualization, and analysis delivered via industry-leading products, solutions, and services. We have developed a proprietary ETL tool called Daton....

  • Senior Cloud Data Architect

    13 hours ago

    Mysore, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Cloud Data Engineer Position">This is a highly sought-after role for a skilled Cloud Data Engineer to build complex algorithms, model front-end and back-end data sources, and develop efficient data pipelines using Google Cloud Platform (GCP) services.">Responsibilities:">The ideal candidate will work closely with the data science team to design and implement...

  • Cloud Data Architect

    7 hours ago

    Mysore, Karnataka, India beBeeData Full time ₹ 20,00,000 - ₹ 30,00,000

    Job OverviewWe are seeking a highly skilled Data Engineer to join our team.Main ResponsibilitiesDeep understanding of distributed computing systems and deep learning frameworks, specifically Ray.Maintenance, monitoring, and troubleshooting of production and non-production environments.Automation of deployment and orchestration of services into cloud...

  • Visionary Data Cloud Architect

    1 day ago

    Mysore, Karnataka, India beBeeDataCloudExpert Full time ₹ 17,28,105 - ₹ 23,10,800

    Sought after Salesforce Data Cloud Architect to spearhead innovative data cloud initiatives, leveraging 10+ years of hands-on expertise.This role demands deep understanding of Salesforce Data Cloud and proven leadership skills to guide technical teams, design scalable architectures, and drive enterprise-wide data-driven transformations.As a key player in...

  • Cloud-Based Data Professional

    1 day ago

    Mysore, Karnataka, India beBeeRequirements Full time ₹ 80,00,000 - ₹ 1,20,00,000

    Azure Data Engineer PositionWe seek an expert in cloud-based data platforms to design, build, and maintain scalable data pipelines using ADF and Azure Database Services.Develop and deploy data processing solutions with PySpark and SQL.Collaborate with cross-functional teams to integrate data engineering solutions with business requirements.The ideal...

  • Cloud Data Solutions Expert

    1 day ago

    Mysore, Karnataka, India beBeeDataArchitect Full time ₹ 15,00,000 - ₹ 25,00,000

    Data ArchitectJob Summary:We are seeking an experienced and innovative Data Architect to lead multiple data engagements on GCP Cloud for data lakes, data engineering, data migration, data warehouse, and business intelligence.The ideal candidate will have a strong background in cloud-based solutions, data integration, and business intelligence with 10-15...