Data Engineering Expert

1 day ago

Tirupati, Andhra Pradesh, India beBeeEngineering Full time ₹ 15,00,000 - ₹ 20,00,000
Job Title: Data Engineer - Azure Platform

Location: Bangalore - Hybrid

About the Role:

We are seeking a skilled Data Engineer with hands-on experience in the Microsoft Azure data ecosystem. The ideal candidate will play a critical role in designing, developing, and managing data pipelines and transformation frameworks that enable analytics, reporting, and business intelligence capabilities across the enterprise.

You will be working closely with data architects, platform engineers, and DevOps teams to build scalable, resilient, and efficient data engineering solutions using modern Azure tools and best practices.

Key Responsibilities:

  • Design and build scalable ETL/ELT pipelines using Azure Data Factory (ADF), Azure Databricks (Spark), and Azure Synapse Analytics.
  • Develop and optimize PySpark/Spark SQL jobs for large-scale batch and streaming data transformations.
  • Ingest data from various sources including Apache Kafka, REST APIs, and RDBMS, ensuring real-time or near-real-time availability.
  • Implement data modeling strategies (star schema, snowflake schema) for analytics consumption layers in Synapse or ADLS.
  • Collaborate with DevOps teams to automate deployment using CI/CD pipelines (Azure DevOps, GitHub Actions, etc.).
  • Monitor, troubleshoot, and optimize data workflows for performance, cost-efficiency, and reliability.
  • Follow coding standards, participate in peer reviews, and maintain version-controlled code in Git repositories.
  • Support data quality checks, logging, alerting, and observability mechanisms for production workloads.
  • Participate in sprint ceremonies and contribute to task estimation and delivery planning.

Must-Have Skills:

  • 5+ years of experience in data engineering roles.
  • Hands-on experience with:
  • Azure Data Factory (ADF) – building pipelines, triggers, linked services.
  • Azure Databricks – building and managing Spark jobs in PySpark.
  • Azure Synapse Analytics – data warehousing, SQL queries, workspace orchestration.
  • Apollo kafka – consuming and processing real-time data streams.
  • Strong in SQL, Python, and Spark for data manipulation and transformation.
  • Exposure to CI/CD practices (Azure DevOps, Git workflows, build/release pipelines).
  • Understanding of data lake architecture and modern data warehousing principles.

Nice-to-Have Skills:

  • Experience with Delta Lake, Event Hub, or Azure Stream Analytics.
  • Familiarity with infrastructure-as-code tools like Terraform or ARM templates.
  • Exposure to Data Governance, Data Quality frameworks, or metadata management.
  • Understanding of networking, security, and access control in Azure data services.

Preferred Certifications:

  • Microsoft Certified: Azure Data Engineer Associate
  • Databricks Certified Associate Developer for Apache Spark
  • Azure Fundamentals (AZ-900) – optional but helpful

  • Senior Data Expert

    1 day ago

    Tirupati, Andhra Pradesh, India beBeeAnalyticsEngineer Full time US$ 1,18,800 - US$ 1,54,500

    We are seeking a seasoned data expert to join our team as a Senior Analytics Engineer. The ideal candidate will have a strong analytical mindset and technical skills to deliver high-quality integrated data assets that support business decisions.Key Responsibilities:Gather and transform large datasets into well-built integrated data assets using SQL, AWS Glue...

  • Senior Data Engineering Leader

    3 days ago

    Tirupati, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 3,00,00,000

    About us:We are seeking an experienced Data Engineer to lead our data platform team. The successful candidate will have a strong track record of designing and implementing robust, production-grade data platforms.The ideal candidate will have 8-12 years of experience in data engineering, with expert-level proficiency in programming, automation, and...

  • Data Engineering Expert

    6 days ago

    Tirupati, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    About PositionAs a member of our elite team, you will play a pivotal role in solving complex problems in the healthcare data and analytics sector. We seek an accomplished software engineer who can write, understand, and test intricate code. You will collaborate with your team to design creative solutions for data-intensive applications.Role: Data...

  • Data Engineering Expertise

    1 week ago

    Tirupati, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Data Engineering ExpertiseAbout the RoleWe are seeking a highly skilled Data Engineering Expert to join our organization. As a key member of our team, you will be responsible for designing and implementing modern data warehouse solutions using Snowflake and Azure Data Factory.Developing scalable and efficient data pipelines in...

  • Data Engineering Professional

    9 hours ago

    Tirupati, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Data Engineering Professional\Job DescriptionWe are seeking a highly skilled Data Engineer to join our team and lead the development of large-scale data systems. The ideal candidate will have extensive experience in architecting and building scalable data pipelines, as well as expertise in lakehouse architectures and stream processing.\Required...

  • Data Expert

    1 week ago

    Tirupati, Andhra Pradesh, India beBeeDatabase Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    About the RoleWe are seeking a highly experienced Data Expert to oversee database performance, availability and security across multiple platforms.This individual will play a key role in designing scalable data architectures, ensuring high uptime and supporting development teams with optimised queries and resilient data pipelines.Data Management &...

  • Expert Data Pipeline Developer

    6 hours ago

    Tirupati, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 21,90,000 - ₹ 25,19,000

    Unlock Your Potential as a Data ExpertThis is an exciting opportunity for a skilled professional to join our operational intelligence platform, which leverages AI/ML-based analytics to provide actionable insights to network, cloud, and application operators.We empower operations teams to meet their KPIs through seamless collaboration, search-driven...

  • Data Engineering Specialist

    2 days ago

    Tirupati, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 18,00,000 - ₹ 24,00,000

    Senior Data Engineer RoleThe ideal candidate will possess a deep understanding of building and maintaining large-scale data processing systems, utilizing Python, PySpark, SQL, and Bash scripting. They will have expertise in designing ETL processes to ensure high-quality data from structured and unstructured sources.A strong professional with experience in...

  • Senior Data Expert

    1 week ago

    Tirupati, Andhra Pradesh, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Overview">We are seeking a seasoned data expert to lead our organization's data science efforts.Key Responsibilities:">">Develop and deploy machine learning models that drive business value.">Collaborate with cross-functional teams to integrate data science into product development.">Design and implement scalable data pipelines that support business...

  • Data engineer

    2 weeks ago

    Tirupati, Andhra Pradesh, India Firstsource Full time

    Key Skills and Responsibilities:We are seeking a Senior Data Engineer with a strong background in cloud-native data engineering, primarily on Microsoft Azure, and familiarity with AWS and GCP. The ideal candidate will have deep expertise in building scalable data pipelines, implementing enterprise-grade data governance, security, and AI-powered engineering...