High-Performance Data Engineer

13 hours ago

Surat, Gujarat, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

Job Overview

We are seeking a highly skilled data engineer to design, build and optimize scalable data pipelines and lakehouse architectures on Microsoft Azure. The ideal candidate will have expertise in Azure Data Services, strong proficiency in SQL and advanced Python skills.

Key Responsibilities

  • Design and develop scalable data pipelines using Azure Data Factory and Azure Synapse Analytics.
  • Build and optimize lakehouse architectures on Azure using Delta Lake.
  • Work closely with stakeholders to understand their requirements and provide thought leadership to translate them into technical scripts.
  • Implement data ingestion, transformation and orchestration workflows from diverse sources (APIs, databases, cloud storage).
  • Ensure data quality, consistency and security across the data lifecycle.
  • Leverage Azure services such as Data Lake Storage Gen2, Event Hubs, Azure Functions and Key Vault.
  • Implement Infrastructure as Code (IaC) using Terraform or Bicep for automated provisioning and configuration.
  • Optimize cloud resource usage for performance and cost-efficiency.
  • Design and implement star schema and other data modeling techniques to support analytical workloads.
  • Collaborate with analysts and data scientists to deliver advanced analytics solutions.
  • Conduct data quality assessments and contribute to data governance initiatives.
  • Participate in design reviews, code reviews and cross-functional planning sessions.

Required Skills and Qualifications

  • Expert-level experience with Azure Data Services: Azure Data Factory, Azure Databricks, Azure Synapse, Azure Data Lake Storage.
  • Strong proficiency in SQL for complex transformations and performance tuning.
  • Advanced Python skills for data pipeline development and orchestration.
  • Experience with Terraform or similar IaC tools for Azure.
  • Familiarity with CI/CD pipelines and DevOps practices.
  • Experience with containerization (Docker, Kubernetes) is a plus.
  • Strong understanding of data governance, security (RBAC, VNETs, Managed Identities), and compliance in Azure.
  • Experience with batch and streaming data processing using tools like Structured Streaming or Event Hubs.

Preferred Qualifications

  • Microsoft Certified: Azure Data Engineer Associate or equivalent.
  • Experience with Delta Live Tables, Unity Catalog or MLflow is a plus.
  • Familiarity with GCP or AWS is a bonus.

  • High-Performance Data Pipeline Specialist

    2 days ago

    Surat, Gujarat, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Senior Data EngineerJob Description:We are looking for a skilled Big Data Engineer to join our team. As a key member of the Professional Services department, you will design, build, and maintain high-performance data pipelines that process massive amounts of data.Key Responsibilities:Design and implement scalable batch processing systems using...

  • High-Performing Redshift Engineer Wanted

    2 days ago

    Surat, Gujarat, India beBeeRedshift Full time ₹ 18,00,000 - ₹ 24,49,000

    Job Title: Senior AWS Redshift EngineerJob Description:We are seeking an experienced Senior Redshift Engineer to join our team and support clients in architecting, optimizing, and scaling AWS Redshift environments.Key Responsibilities include:Leading architecture review and validation for multiple AWS Redshift clustersValidating sizing assumptions and...

  • High-Performance Frontend Developer

    2 days ago

    Surat, Gujarat, India beBeeFrontend Full time ₹ 10,00,000 - ₹ 30,00,000

    Senior Frontend Engineer (React & Next.js)The ideal candidate will have a strong background in React 18 and Next.js 14, with experience building high-performance, real-time web applications.We are seeking a highly skilled engineer to design, develop, and optimize interactive applications with strict performance budgets, modern server-first patterns, and...

  • High Performance Optimization Specialist

    12 hours ago

    Surat, Gujarat, India beBeePerformance Full time ₹ 40,00,000 - ₹ 43,00,000

    About Us:We are a global digital solutions company known for our innovative approach and friendly culture.Our team guides clients in unlocking the value of their data and applications to solve digital challenges, achieving outcomes that benefit both business and society.Key Services Include:Digital TransformationEnterprise AIData & AnalyticsProduct...

  • High-Performance Web Application Developer

    2 days ago

    Surat, Gujarat, India beBeeSoftware Full time ₹ 15,00,000 - ₹ 20,00,000

    Job TitleWe are seeking a skilled software engineer to create high-performance web applications.Experience with PHP and its role in building robust web applications.Proficiency in API development & integration, ensuring seamless communication between systems.Solid understanding of HTML, CSS, and responsive web design principles.Experience with JavaScript,...

  • Senior Data Engineer

    2 days ago

    Surat, Gujarat, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Transforming Data into InsightsAbout This RoleWe are seeking an experienced data engineer to drive the development and maintenance of efficient data pipelines. The ideal candidate will possess a strong background in extract, transform, and load (ETL) processes, data engineering, and experience working with cloud-based data platforms.Data Pipeline...

  • Azure Data Engineer Position

    12 hours ago

    Surat, Gujarat, India beBeeDataEngineering Full time ₹ 9,00,000 - ₹ 12,00,000

    Data Engineering SpecialistWe are seeking a highly skilled Data Engineering Specialist to join our team. The ideal candidate will have extensive experience in designing, implementing, and maintaining large-scale data processing systems on Azure.Key ResponsibilitiesDevelop scalable data pipelines using Azure Data Factory, Apache Kafka, and other relevant...

  • Chief Data Engineer

    2 days ago

    Surat, Gujarat, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job OpportunityWe are seeking an experienced Data Architect to lead our team's efforts in designing and implementing scalable, secure, and efficient data solutions.The successful candidate will be responsible for architecting data lakes, developing data pipelines, and implementing data warehousing solutions using Databricks. They will collaborate with data...

  • Senior Data Engineer

    2 minutes ago

    Surat, Gujarat, India HealthyMe Ai Full time

    About the RoleWe are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data. You will report to the Head of AI and Engineering and be responsible for designing, building, and operating the backbone of our AI-powered applications. This is a critical role where you will create scalable pipelines that...

  • High-Performance Database Solutions Architect

    12 hours ago

    Surat, Gujarat, India beBeeDatabase Full time ₹ 1,00,00,000 - ₹ 1,50,00,000

    **Job Title: Senior Database DeveloperWe are seeking a skilled data developer with expertise in Microsoft-based database engineering technologies. The ideal candidate will have heavy emphasis on database development and data warehousing in a Microsoft technology environment.Transact-SQL Development (7+ years)Data Warehousing (7+ years) – Azure Synapse...