Senior Data Engineering Expert

2 days ago

Alwar, Rajasthan, India beBeeData Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

About the Opportunity

We're seeking a Data Engineering Specialist with expertise in Azure to craft scalable data solutions and support analytics initiatives.

Key Responsibilities

  • Design, build, and maintain efficient data pipelines using Azure Data Factory and Synapse Analytics.
  • Create and optimize lakehouse architectures on Azure using Delta Lake.
  • Collaborate with stakeholders to understand their needs and provide technical guidance.
  • Implement data ingestion, transformation, and orchestration workflows from various sources (APIs, databases, cloud storage).
  • Ensure data quality, consistency, and security throughout the data lifecycle.
  • Leverage Azure services such as Data Lake Storage Gen2, Event Hubs, Functions, and Key Vault.
  • Use Infrastructure as Code (IaC) tools like Terraform or Bicep for automated provisioning and configuration.
  • Optimize cloud resource usage for performance and cost-efficiency.
  • Develop star schema and other data modeling techniques to support analytical workloads.
  • Work with analysts and data scientists to deliver advanced analytics solutions.
  • Conduct data quality assessments and contribute to data governance initiatives.
  • Participate in design reviews, code reviews, and cross-functional planning sessions.

Required Technical Skills

  • Expert-level experience with Azure Data Services: Data Factory, Databricks, Synapse, and Data Lake Storage.
  • Strong proficiency in SQL for complex transformations and performance tuning.
  • Advanced Python skills for data pipeline development and orchestration.
  • Experience with IaC tools like Terraform or similar tools for Azure.
  • Familiarity with CI/CD pipelines and DevOps practices.
  • Experience with containerization (Docker, Kubernetes) is a plus.
  • Strong understanding of data governance, security (RBAC, VNETs, Managed Identities), and compliance in Azure.
  • Experience with batch and streaming data processing using tools like Structured Streaming or Event Hubs.

Soft Skills & Mindset

  • Growth mindset with a passion for continuous learning and innovation.
  • Strong collaboration skills across engineering, analytics, and business teams.
  • Robust client management skills.
  • Structured problem-solving approach with a focus on scalability and maintainability.
  • Resilient under pressure with a solution-oriented attitude.
  • Excellent communication and documentation skills.

Preferred Qualifications

  • Microsoft Certified: Azure Data Engineer Associate or equivalent.
  • Experience with Delta Live Tables, Unity Catalog, or MLflow is a plus.
  • Familiarity with GCP or AWS is a bonus.

  • Senior Data Expert

    6 days ago

    Alwar, Rajasthan, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Senior Data ExpertAt our organization, we seek a highly skilled Senior Data Expert to drive data-driven decision-making across the enterprise.Role DescriptionThis full-time remote role involves performing advanced data analysis, creating insightful data visualizations, and developing sophisticated data science models that foster business...

  • Senior Data Architect

    5 days ago

    Alwar, Rajasthan, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Key Role: Senior Data EngineerWe are seeking an expert in Telemetry, Big Data, and backend engineering to help implement a large-scale application for a prominent retailer.5+ years of experience as a Data Engineer with expertise in Python, Pyspark, and SQL;Hands-on coding experience in Python/PySpark with strong Big Data experience and a preference for...

  • Expert Data Engineer Wanted

    1 week ago

    Alwar, Rajasthan, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Data Engineering ExpertWe are seeking an experienced Data Engineer to join our team. You will design, build, and optimize end-to-end data solutions using Microsoft's data platforms, including Microsoft Fabric, Azure Synapse Analytics, Databricks, and Power BI.Your work will involve implementing contemporary data architecture patterns, creating robust data...

  • Senior Data Analyst and Visualization Expert

    2 days ago

    Alwar, Rajasthan, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Overview:As a senior Data Analyst and visualization expert, we are looking for an experienced professional to develop high-quality datasets and visualizations for Large Language Model training. This role involves building scalable data pipelines, designing advanced visualizations, replicating dashboards from existing images, conducting insight evaluation,...

  • Expert Clinical Data Engineer

    3 days ago

    Alwar, Rajasthan, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    We are seeking a highly skilled Data Engineering expert to design, build and operate scalable systems that process clinical encounter data.Key responsibilities include designing and operating real-time data pipelines, integrating with electronic health records (EHR) systems using standards such as FHIR and HL7, and developing reliable systems to ingest,...

  • Senior Data Engineering Expert

    3 days ago

    Alwar, Rajasthan, India beBeeDataEngineer Full time ₹ 7,50,000 - ₹ 15,00,000

    Data Engineer - Transformative InsightsAs a key member of our global engineering team, you will play a pivotal role in driving business outcomes through data-driven decision making. A highly collaborative environment, we are seeking an experienced Data Engineer to lead the development and implementation of innovative data pipelines using PySpark.Expertise...

  • Senior Data Systems Engineer

    3 days ago

    Alwar, Rajasthan, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Unlock Data PotentialThis is a high-level data engineer position that involves building and maintaining large-scale data systems. We are looking for experts in cloud-based data platforms, specifically Azure Data Factory (ADF), Azure Databricks (ADB), PySpark, and SQL.Key ResponsibilitiesDevelop scalable data pipelines using ADF and ADB...

  • Expert Cloud Data Pipeline Architect

    3 days ago

    Alwar, Rajasthan, India beBeeCloudEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job DescriptionAre you a seasoned data expert looking to build and deploy scalable data pipelines on the cloud?We're seeking an experienced Senior AWS Data Engineer to lead our data engineering efforts, design and develop end-to-end data pipelines, and implement data processing and transformation workflows using Apache Spark and SQL.You will collaborate with...

  • Data Engineer

    3 days ago

    Alwar, Rajasthan, India Insight Global Full time

    100% Remote Data Engineer Required Skills & Experience5+ years of experience as a Data EngineerExpertise in Python, Pyspark and SQLHands-on Python/PySpark coding experienceStrong Big Data experience, GCP preferredTelemetry experienceStreaming experience with analytics and data processingBusiness analytics experience and working directly with business...

  • Senior Data Solutions Expert

    3 days ago

    Alwar, Rajasthan, India beBeeDataEngineer Full time US$ 15,00,000 - US$ 20,00,000

    Job Title: Data Solutions ArchitectRole Overview:We seek a skilled Senior Data Engineer to design and optimize data solutions that drive our analytics, reporting, and business intelligence initiatives.Key Responsibilities:Develop robust ETL pipelines using Snowflake, Matillion, and Python for scalable data processing.Create and refine data models to support...