Senior Data Engineering Specialist

4 days ago

Kurnool, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 25,00,000 - ₹ 35,00,000

Job Opportunity

We are seeking a skilled data engineer to fill this critical role. The ideal candidate will have hands-on experience in designing, developing, and managing data pipelines and transformation frameworks.

The successful candidate will work closely with data architects, platform engineers, and DevOps teams to build scalable, resilient, and efficient data engineering solutions using modern tools and best practices.

Main Responsibilities:

  • Data Pipeline Design and Development: Design and build scalable ETL/ELT pipelines using Azure Data Factory (ADF), Azure Databricks (Spark), and Azure Synapse Analytics.
  • Large-Scale Batch and Streaming Data Transformations: Develop and optimize PySpark/Spark SQL jobs for large-scale batch and streaming data transformations.
  • Real-Time or Near-Real-Time Data Ingestion: Ingest data from various sources including Apache Kafka, REST APIs, and RDBMS, ensuring real-time or near-real-time availability.
  • Data Modeling Strategies: Implement data modeling strategies (star schema, snowflake schema) for analytics consumption layers in Synapse or ADLS.
  • Collaboration and Automation: Collaborate with DevOps teams to automate deployment using CI/CD pipelines (Azure DevOps, GitHub Actions, etc.).
  • Monitoring and Troubleshooting: Monitor, troubleshoot, and optimize data workflows for performance, cost-efficiency, and reliability.
  • Version-Controlled Code and Peer Reviews: Follow coding standards, participate in peer reviews, and maintain version-controlled code in Git repositories.
  • Support for Production Workloads: Support data quality checks, logging, alerting, and observability mechanisms for production workloads.

Required Skills:

5+ years of experience in data engineering roles. Hands-on experience with: Azure Data Factory (ADF), Azure Databricks, Azure Synapse Analytics, Apache Kafka, SQL, Python, Spark, CI/CD practices.

Desirable Skills:

Experience with Delta Lake, Event Hub, Terraform, ARM templates, Data Governance, Data Quality frameworks, metadata management, networking, security, access control in Azure data services.

],

  • Data Engineering Specialist

    2 days ago

    Kurnool, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title:Data Engineering SpecialistJob Summary:We are seeking a skilled Data Engineering Specialist to design, develop, and maintain large-scale data pipelines using Google Cloud Platform (GCP) tools.Responsibilities:Developing high-volume data acquisition pipelines for structured and unstructured dataCreating complex datasets based on business...

  • Data Engineering Specialist

    2 weeks ago

    Kurnool, Andhra Pradesh, India beBeeIngestion Full time US$ 1,00,000 - US$ 1,20,000

    Job Title: Data Engineering SpecialistWe require a skilled specialist with expertise in big data processing, cloud computing and data integration to work on data ingestion processes.This role involves the design, development, testing and deployment of data pipelines, automation tools and infrastructure management solutions for scalable and efficient data...

  • Senior Data Engineer Role

    1 week ago

    Kurnool, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 10,00,000 - ₹ 19,00,000

    Senior Data EngineerWe are seeking a seasoned data engineer to lead our team in delivering high-quality data solutions. This is an exciting opportunity for a senior professional with expertise in data engineering and technical leadership.Key responsibilities will include:Designing, developing, and maintaining large-scale data pipelinesCollaborating with...

  • Senior Data Engineering Specialist

    6 days ago

    Kurnool, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title:Data Engineer L3Company Overview:We are a leading global retailer with warehouse club operations in multiple countries.Job Responsibilities:Develop and implement large-scale data platforms: Lead the design and deployment of scalable, reliable, and secure data infrastructure for enterprises.Promote innovation and adoption of new technologies:...

  • Senior Data Integration Specialist

    4 days ago

    Kurnool, Andhra Pradesh, India beBeeDataIntegration Full time ₹ 12,07,200 - ₹ 21,45,900

    Senior Data Integration SpecialistJob Description:We are seeking a highly skilled Senior Data Integration Specialist to join our team.The ideal candidate will have experience in designing and implementing data pipelines, integrating external systems and interfaces, and working with large datasets.Development of crawling/fetch pipelines (API-first;...

  • Senior Data Engineering Expert

    7 days ago

    Kurnool, Andhra Pradesh, India beBeeData Full time US$ 1,50,000 - US$ 2,00,000

    Job Title: Senior Big Data EngineerWe are seeking a highly skilled and experienced Senior Big Data Engineer to join our team. This is an exciting opportunity for a talented professional to lead data engineering teams across geographies and time zones.Manage cross-team collaboration with architects, product managers, and operations.Design and implement...

  • Senior Data Platform Specialist

    1 week ago

    Kurnool, Andhra Pradesh, India beBeeData Full time ₹ 18,00,000 - ₹ 24,00,000

    Job Title:We are seeking a skilled Data Platform Specialist to join our team.Key Responsibilities:Design & Architecture:Develop and maintain large-scale data warehouses for analytics and reporting.Architect and maintain cloud-based data lakes on AWS infrastructure, leveraging open-source technologies.Collaboration & Delivery:Work closely with product,...

  • Senior Data Engineering Manager

    2 weeks ago

    Kurnool, Andhra Pradesh, India beBeeData Full time ₹ 7,50,000 - ₹ 15,00,000

    Job Title: Senior Data Engineering ManagerLocation: Kurnool, IndiaExperience Level: Advanced (6+ years)Employment Type: Full-timeJob Summary:We are seeking a highly skilled and experienced Senior Data Engineering Manager to drive our data scraping initiatives. The ideal candidate will have a minimum of 6 years of hands-on experience in IT scraping, with at...

  • Senior Data Engineer

    5 days ago

    Kurnool, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 17,56,000

    Job TitleAs a senior data engineer, you will play a pivotal role in empowering our clients with data-driven insights and innovative digital solutions.Our team is comprised of top minds in the industry who are passionate about delivering cutting-edge solutions that solve real-world challenges. We value collaboration, client focus, innovation, and integrity in...

  • Senior Data Transformation Specialist

    5 days ago

    Kurnool, Andhra Pradesh, India beBeeDataTransformation Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Senior Data Transformation Specialist">As a seasoned Senior Data Transformation Specialist, you will play a pivotal role in leading the design, implementation, and maintenance of ETL processes. This includes working closely with cross-functional teams to identify data transformation requirements, develop and execute efficient data pipelines, and...