Senior Data Engineer

5 days ago

Gandhinagar, Gujarat, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

About Our Data Engineer Position

We are looking for a skilled data engineer to join our team and contribute to designing, developing, and managing data pipelines and transformation frameworks that enable analytics, reporting, and business intelligence capabilities across the enterprise.

You will be working closely with data architects, platform engineers, and DevOps teams to build scalable, resilient, and efficient data engineering solutions using modern tools and best practices.

The ideal candidate will have hands-on experience in the Microsoft Azure data ecosystem and strong skills in SQL, Python, and Spark for data manipulation and transformation.

Key Responsibilities:

  • Design and build scalable ETL/ELT pipelines using Azure Data Factory (ADF), Azure Databricks (Spark), and Azure Synapse Analytics.
  • Develop and optimize PySpark/Spark SQL jobs for large-scale batch and streaming data transformations.
  • Ingest data from various sources including Apache Kafka, REST APIs, and RDBMS, ensuring real-time or near-real-time availability.
  • Implement data modeling strategies (star schema, snowflake schema) for analytics consumption layers in Synapse or ADLS.
  • Collaborate with DevOps teams to automate deployment using CI/CD pipelines (Azure DevOps, GitHub Actions, etc.).
  • Monitor, troubleshoot, and optimize data workflows for performance, cost-efficiency, and reliability.
  • Follow coding standards, participate in peer reviews, and maintain version-controlled code in Git repositories.
  • Support data quality checks, logging, alerting, and observability mechanisms for production workloads.
  • Participate in sprint ceremonies and contribute to task estimation and delivery planning.

Required Skills and Qualifications:

  • 5+ years of experience in data engineering roles.
  • Hands-on experience with:
    • Azure Data Factory (ADF) – building pipelines, triggers, linked services.
    • Azure Databricks – building and managing Spark jobs in PySpark.
    • Azure Synapse Analytics – data warehousing, SQL queries, workspace orchestration.
    • Apollo Event Hub – consuming and processing real-time data streams.
  • Strong in SQL, Python, and Spark for data manipulation and transformation.
  • Exposure to CI/CD practices (Azure DevOps, Git workflows, build/release pipelines).
  • Understanding of data lake architecture and modern data warehousing principles.

Benefits:

  • Possibility of career growth and development.
  • Frequent feedback and guidance from experienced professionals.
  • Opportunities for professional certifications and training.

Others:

  • Multicultural environment with diverse perspectives.
  • Achievable work-life balance.

  • Senior Data Engineer

    2 weeks ago

    Gandhinagar, Gujarat, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job TitleA senior data engineer is required to develop and optimize ETL/ELT pipelines using Azure Data Factory (ADF), Databricks, and Synapse Analytics.This role involves designing and implementing scalable data architectures following Medallion Architecture and best practices.The ideal candidate will have experience in Azure Data Engineering with Data...

  • Senior Data Engineer Position

    6 days ago

    Gandhinagar, Gujarat, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 25,00,000

    Job Description:As a senior data engineer, you will be responsible for designing and developing large-scale data pipelines using Azure Data Factory and Databricks. This role involves collaborating with cross-functional teams to identify business requirements and develop data-driven solutions.The ideal candidate will have a strong understanding of data...

  • Senior Data Engineer

    4 days ago

    Gandhinagar, Gujarat, India beBeeDataEngineering Full time ₹ 26,81,351 - ₹ 31,35,817

    Our Ideal CandidateWe are seeking an accomplished Data Engineering Leader to spearhead the development of our self-service data platform. The ideal candidate will have a strong background in designing scalable data solutions, leveraging technologies such as Databricks, SQL, Python, Spark, and Delta Lake on Azure.Key Responsibilities:Design and implement data...

  • Senior Data Engineering Specialist

    6 days ago

    Gandhinagar, Gujarat, India beBeeSenior Full time ₹ 20,00,000 - ₹ 30,00,000

    We are seeking an experienced Senior ETL Developer to join our organization. The ideal candidate will have a proven track record of designing, developing, and deploying scalable data pipelines and ETL processes using Databricks.Key Responsibilities:Design and develop efficient ETL processes and data pipelines that meet business requirementsOptimize Spark...

  • Lead Data Engineering Specialist

    1 week ago

    Gandhinagar, Gujarat, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Opportunity: Senior Data EngineerWe are seeking an experienced Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing and implementing large-scale data systems.Main Responsibilities:Design and implement scalable data pipelines using Azure and AWS Databricks.Develop and maintain high-quality data processing...

  • Lead Data Engineering Specialist

    6 days ago

    Gandhinagar, Gujarat, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior Data Engineer Job DescriptionWe are seeking a highly skilled Senior Data Engineer to lead our data engineering efforts. The ideal candidate will have expertise in cloud platforms, ETL processes, data warehousing, and big data technologies.Job RequirementsTo design, deploy, and maintain large-scale data platforms with high efficiency and scalability.To...

  • Senior Data Engineer Position

    5 days ago

    Gandhinagar, Gujarat, India beBeeEngineer Full time US$ 1,80,000 - US$ 2,50,000

    About Our Team:We are a dynamic team of professionals dedicated to developing cutting-edge data solutions. We work closely with cross-functional teams across the globe, leveraging our expertise in data modeling, pipelines, and analysis to drive business growth.The purpose of our Commercial Data team is to design, develop, and optimize innovative data...

  • Senior Data Engineer

    2 weeks ago

    Gandhinagar, Gujarat, India The Glove Full time

    Job DescriptionAbout the Company:We are a leading organization in the tech industry, committed to delivering innovative solutions that drive business transformation. Our team is passionate about leveraging cutting-edge technologies to solve complex challenges and create value for our clients. We foster a collaborative and inclusive work environment that...

  • Senior Data Engineering Specialist

    4 days ago

    Gandhinagar, Gujarat, India beBeeBackendEngineer Full time ₹ 18,00,000 - ₹ 25,00,000

    As a Senior Backend Data & Integration Engineer, you will be responsible for designing and implementing crawling/fetch pipelines using API-first approach with playwright/requests. You will also work on parsing/normalization of job postings & CVs, deduplication/delta logic, embeddings/similarity search, integrations with HR4YOU, SerpAPI, BA job board,...

  • Senior Test Engineer

    6 days ago

    Gandhinagar, Gujarat, India Molecular Connections Full time

    Company Description Molecular Connections (MC) is a leading provider of Big Data and Data Science Solutions, using AI-powered models to drive digital transformation for customers. With a focus on innovation, MC collaborates with pharma and STEM industries to offer end-to-end software development and data insights. The company prides itself on empowering...