Cloud-Based Big Data Engineer

5 days ago

Kozhikode, Kerala, India beBeeDataEngineering Full time US$ 1,08,500 - US$ 1,53,865

Azure Data Engineer Role

We are seeking a highly skilled professional to help our clients harness the power of data and drive digital transformation.

As an Azure Data Engineer, you will be responsible for designing and implementing scalable data pipelines using Azure Databricks (PySpark/Scala), developing and deploying Azure Function Apps for event-driven data processing and automation, and integrating Databricks with other Azure services.

  • Main Responsibilities:
  • Design and implement scalable data pipelines using Azure Databricks (PySpark/Scala).
  • Develop and deploy Azure Function Apps for event-driven data processing and automation.
  • Integrate Databricks with other Azure services like Data Lake Storage, Synapse, Event Hubs, Key Vault, etc.
  • Optimize Spark jobs for performance and cost-efficiency.
  • Implement CI/CD pipelines using Azure DevOps for Databricks notebooks and Function Apps.
  • Monitor and troubleshoot production workloads, ensuring high availability and reliability.
  • Collaborate with data scientists, analysts, and business stakeholders to deliver data solutions.

Required Skills & Qualifications:

  • Strong experience with Azure Databricks and Apache Spark (PySpark or Scala).
  • Proficiency in developing Azure Function Apps using C#, Python, or JavaScript.
  • Solid understanding of Azure Data Lake, Event Hubs, Blob Storage, and Key Vault.
  • Experience with CI/CD pipelines, Git, and Infrastructure as Code (ARM/Bicep/Terraform).
  • Familiarity with data modeling, ETL/ELT processes, and data governance.
  • Strong problem-solving skills and ability to work in an agile environment.

Benefits and Opportunities:

  • Pursue your passion for cloud-based big data engineering and analytics.
  • Work on diverse projects with top-notch professionals from around the globe.
  • Grow with our dynamic team by taking on new challenges and responsibilities.
  • Gain valuable industry experience and build your network of contacts.
  • Enjoy competitive compensation and benefits packages.

About Us:

We strive to provide innovative and effective solutions that meet the unique needs of our clients. Our team consists of dedicated professionals passionate about delivering exceptional results. Together, we aim to make a lasting impact on the world.

  • Big Data Engineer

    3 days ago

    Kozhikode, Kerala, India beBeeData Full time ₹ 18,00,000 - ₹ 27,00,000

    Big Data Engineers are responsible for designing, developing and maintaining large-scale data pipelines using cloud-based platforms.Job Role:Develop data engineering solutions to drive business insightsCollaborate with cross-functional teams to deliver high-quality data solutionsIntegrate machine learning models into production-ready codeKey...

  • Big Data Cloud Platform Manager

    1 day ago

    Kozhikode, Kerala, India beBeeData Full time ₹ 18,00,000 - ₹ 25,00,000

    About People Prime Worldwide:Our client is a global technology consulting and digital solutions company that enables enterprises to reimagine business models and accelerate innovation through digital technologies.We are seeking a highly skilled On-prem Cloud Era Big Data Administrator to manage big data platforms in our team.The ideal candidate will be...

  • Big Data Expert

    5 days ago

    Kozhikode, Kerala, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Big Data Engineer RoleWe are seeking a highly skilled data professional to join our team.About the Position:The ideal candidate will have experience with big data, scalable architectures, and cloud services.A minimum of 2+ years of experience in the field is required.Key Responsibilities:Design, implement, and deploy large-scale data processing...

  • Data Engineer

    1 week ago

    Kozhikode, Kerala, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Unlock Your Potential as a Data Engineering ExpertDesign and implement scalable data processing pipelines using cloud-based services.Develop efficient data warehousing solutions leveraging database services.Utilize big data processing and analytics tools for data-driven insights.As a seasoned data engineer, you will be part of a dynamic team that drives...

  • Big Data Engineer Position

    1 week ago

    Kozhikode, Kerala, India beBeeData Full time ₹ 12,00,000 - ₹ 22,00,000

    Job Title:Data ArchitectAbout the Role:We are seeking an experienced data architect to design, develop and implement scalable data systems that support real-time and batch data processing.You will collaborate with cross-functional teams to deliver reliable, high-quality data architectures that power analytics, insights and data-driven decision-making.Key...

  • Cloud Data Engineer

    5 days ago

    Kozhikode, Kerala, India beBeeDataEngineering Full time ₹ 10,00,000 - ₹ 30,00,000

    About the RoleWe are seeking a seasoned professional to lead our data engineering efforts on Google Cloud Platform. With 6-12 years of experience in designing and implementing scalable data pipelines, transforming logics, and data models, you will be responsible for delivering high-quality solutions that drive business growth.Key Responsibilities:Design and...

  • Big Data Solutions Architect

    7 days ago

    Kozhikode, Kerala, India beBeeData Full time ₹ 1,00,00,000 - ₹ 1,50,00,000

    Big Data EngineerWe are looking for a skilled Big Data Engineer to join our team. As a Big Data Engineer, you will be responsible for designing, building, and maintaining large-scale data pipelines that handle terabytes of structured and unstructured data.The ideal candidate has 1–2 years of experience in big data engineering and is excited to solve tough...

  • Big Data Specialist

    1 week ago

    Kozhikode, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Cloud Data EngineerOur organization seeks an experienced data engineer to design and implement scalable, high-performance data pipelines using AWS cloud services and Databricks. The ideal candidate will have a strong understanding of big data frameworks, data warehousing, and data modeling.Job Summary:The data engineer will be responsible for designing,...

  • Cloud Data Solutions Developer

    5 days ago

    Kozhikode, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Description:The role of Data Engineer involves designing and implementing cloud-based data engineering solutions. This includes the development of scalable, distributed enterprise data systems and the creation of automated cloud solutions.Key Responsibilities:Architecting and delivering highly scalable, distributed, cloud-based enterprise data...

  • Cloud Data Engineer Opportunity

    1 day ago

    Kozhikode, Kerala, India beBeeCloudEngineer Full time ₹ 16,15,797 - ₹ 20,39,878

    Job DescriptionAs a Cloud Data Engineering expert, you will design and implement scalable data pipelines using GCP services. This includes orchestrating complex workflows using Apache Airflow and other tools, processing large datasets using ETL techniques and Big Query, and developing and maintaining RESTful or GraphQL APIs for data integration.Key...