Cloud-Based Data Engineer

23 hours ago

Madurai, Tamil Nadu, India beBeeDataEngineer Remote Work Freelance Full time ₹ 80,00,000 - ₹ 1,50,00,000

Cloud-Based Data Engineer Job Description:

We are seeking a highly skilled Data Engineer to join our company. The ideal candidate will have a good understanding of cloud-based solutions, data integration, and data cleanup.

The successful candidate will design and implement cloud-based solutions using Azure and Google Cloud platforms, automate data pipelines to facilitate efficient data flow and processing, develop and manage data pipelines using technologies like PySpark and Databricks, and ensure the scalability and reliability of data processing workflows.

Key Responsibilities:

  • Design and implement cloud-based solutions using Azure and Google Cloud platforms.
  • Automate data pipelines to facilitate efficient data flow and processing.
  • Develop and manage data pipelines using technologies like PySpark and Databricks.
  • Ensure the scalability and reliability of data processing workflows.
  • Work with Large Language Models (LLMs) such as GPT and OpenAI models to enhance applications with natural language processing (NLP) capabilities.
  • Design and implement prompt engineering strategies to optimize model performance in business applications.
  • Train, fine-tune, and deploy AI models, analyzing their performance based on real-world results.
  • Optimize models using feedback mechanisms to improve efficiency.
  • Utilize strong communication skills to convey complex technical concepts to non-technical stakeholders.

Requirements:

  • Bachelor or Master degree.
  • +3 years of hands-on experience in Python, Pyspark, Databricks, and cloud platforms like Azure and Google Cloud.
  • Experience in designing and implementing cloud-based solutions and automating data pipelines.
  • Experience in working with Large Language Models (LLMs) such as GPT, OpenAI models, or enhancing solutions with natural language processing (NLP) capabilities.
  • Proven ability in metadata management and schema mapping.
  • Cloud certifications (Azure, Google Cloud, or similar) are a plus.
  • Fluent in English.

  • Cloud-Based Data Architect

    3 days ago

    Madurai, Tamil Nadu, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Job Role: Data ArchitectOverviewA data architect with 4+ years of experience is required to design and develop cloud-based data architectures. The ideal candidate should have expertise in building scalable real-time and batch processing workflows using Azure Databricks, PySpark, and Apache Spark.Key Responsibilities:Design and maintain cloud-based data...

  • Cloud Data Engineering Lead

    23 hours ago

    Madurai, Tamil Nadu, India beBeeEngineering Full time ₹ 15,00,000 - ₹ 17,50,000

    Job Title: Cloud Data Engineering Lead\The role involves overseeing the design, development and configuration of cloud-based data systems to drive business growth.\This position requires a technical leader with expertise in cloud data warehousing, data modeling and ETL processes. The ideal candidate will have at least 5 years of experience in designing and...

  • Cloud Data Engineer

    4 days ago

    Madurai, Tamil Nadu, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Cloud Data EngineerThe role of a Cloud Data Engineer is to design, build, and maintain large-scale data processing systems in the cloud.

  • Cloud Data Engineer

    20 hours ago

    Madurai, Tamil Nadu, India beBeeDataEngineering Full time ₹ 90,00,000 - ₹ 1,20,00,000

    Job Title: Cloud Data EngineerAbout the RoleWe are seeking a skilled data engineer to build and maintain scalable data pipelines that empower business decision-making through advanced analytics. This is an ideal role for those seeking career advancement in the field of data engineering.Key Responsibilities:Collaborate with data science teams to implement...

  • Cloud Data Engineer Position

    3 days ago

    Madurai, Tamil Nadu, India beBeeData Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    Job Title:Big Data SpecialistKey Responsibilities:This role involves designing and implementing scalable data pipelines, ensuring high-quality data processing, and integrating governance metrics into data workflows.The ideal candidate will have hands-on experience with data engineering, strong expertise in Azure Databricks and data storage solutions, and...

  • Cloud Data Engineer

    2 days ago

    Madurai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Job TitleOur organization seeks a highly skilled Data Engineer to work on a range of complex projects.", "About the RoleWe are seeking an experienced professional to build and maintain data pipelines that clean, transform, and aggregate data from diverse sources.The ideal candidate will have extensive experience with Python, SQL, and data...

  • Expert Data Engineer

    23 hours ago

    Madurai, Tamil Nadu, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Expert Data Engineer – Cloud ComputingProtecting businesses and organizations from cyber threats requires a robust approach to data engineering. Our team offers various services, including cloud security, web and mobile security testing, and DevSecOps.

  • Data Engineer

    23 hours ago

    Madurai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Data Engineer - Cloud Computing ExpertWe are seeking a skilled Data Engineer to lead the design and development of large-scale data systems. The ideal candidate will have 3-7 years of experience in designing, building, and maintaining efficient data pipelines using cloud services such as BigQuery, Cloud Storage, and Dataflow.Key...

  • Data Engineering Specialist

    4 days ago

    Madurai, Tamil Nadu, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Data Engineering SpecialistDesign, build, and maintain large-scale data pipelines using Spark and SQL. This role involves managing big data flows, collaborating with cross-functional teams, and driving business growth through data insights.About the Role:Create scalable data architectures using cloud-based platforms (AWS, Azure, GCP, Databricks).Analyze and...

  • Senior Cloud Engineer

    2 days ago

    Madurai, Tamil Nadu, India beBeeCloudMigration Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Cloud Data Migration ExpertWe are seeking a seasoned Cloud Data Migration Expert to lead our cloud migration projects. This role requires a highly skilled professional with extensive experience in designing, developing, and implementing large-scale data pipelines.The ideal candidate will have a strong background in migrating on-premise data systems to the...