Senior Data Engineer

2 days ago

Allahabad, Uttar Pradesh, India beBeeData Full time ₹ 16,00,000 - ₹ 24,40,000

About Us:

We are a leading retail and e-commerce organization serving millions of guests daily through a vast network of physical stores and a cutting-edge digital platform.

Our company works on large-scale, high-availability systems that handle complex supply chain operations, order management, and personalized customer experiences at massive scale.


Key Responsibilities:

Key Roles and Responsibilities:
  • Design, develop, and automate scalable data workflows using Python and Pandas for large dataset processing.
  • Implement and manage data ingestion and transformation processes using Hive SQL for data warehousing.
  • Configure, monitor, and optimize Elasticsearch clusters for indexing, searching, and analytics performance.
  • Build and maintain RESTful APIs using Flask to facilitate secure data exchange.
  • Collaborate with Data Scientists, Analysts, and Engineering teams to support data-driven applications and reporting tools.
  • Ensure high standards of data quality, reliability, and integrity throughout the pipeline.
  • Monitor performance, debug issues, and tune queries for maximum efficiency.
  • Document data flows, pipeline architecture, and automation logic clearly.


Requirements:

  • 5-16 years of Experience
  • Proficient in Python, with hands-on experience using Pandas for large dataset processing.
  • Solid knowledge of ETL frameworks and pipeline automation strategies.
  • Experience with Elasticsearch: indexing, querying, and optimizing for performance.
  • Strong command of Hive SQL and working with distributed data systems.
  • Experience building APIs using Flask or similar Python frameworks.
  • Understanding of data modeling, schema design, and workflow orchestration.
  • Strong debugging, analytical, and communication skills.


Benefits:

This role offers an opportunity to work on a variety of challenging projects and collaborate with a team of experienced professionals. We offer a competitive salary and benefits package.


What We Offer:

A supportive and dynamic work environment with opportunities for growth and development.

  • Data Engineer

    2 days ago

    Allahabad, Uttar Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior Data ArchitectWe are seeking an experienced Senior Data Architect to lead the development of our data engineering solutions. The ideal candidate will have a strong background in designing and implementing scalable, secure, and efficient data integration systems.

  • Senior Data Engineering Lead

    21 hours ago

    Allahabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    About the RoleWe are seeking a seasoned professional to lead our data engineering efforts. As a Senior Data Engineer, you will play a critical role in designing, building, and operating scalable data pipelines that support our AI-powered applications.This is a key position where you will create robust pipelines that process clinical encounter data, retrieve...

  • Senior Data Engineer

    3 days ago

    Allahabad, Uttar Pradesh, India beBeeData Full time US$ 1,60,000 - US$ 1,90,000

    Role Summary:We are seeking an experienced Senior Data Architect to join our team.This senior-level position will be responsible for designing, implementing, and optimizing a robust data warehousing platform for the pharmaceutical industry.The ideal candidate will have expertise in data architecture and management, with a strong background in data modeling,...

  • Lead Data Engineering Specialist

    7 days ago

    Allahabad, Uttar Pradesh, India beBeeData Full time ₹ 18,00,000 - ₹ 25,00,000

    Job OpportunityWe are seeking an experienced Senior Data Engineer to lead our data engineering efforts. As a Senior Data Engineer, you will be responsible for designing and building robust data pipelines for ingestion, transformation, and analytics using the best of modern data engineering tools and practices on Google Cloud (GCP).The ideal candidate will...

  • Senior Data Engineer

    2 days ago

    Allahabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 18,00,000

    Job OpportunityAptimized seeks a Data Engineering & Business Intelligence professional to support enterprise data initiatives. This role combines hands-on data engineering and ETL development with business intelligence and reporting delivery, ensuring timely and accurate insights for stakeholders.The ideal candidate will be technically proficient in SQL,...

  • Unlock Innovation as a Senior Data Engineer for Analytics

    12 hours ago

    Allahabad, Uttar Pradesh, India beBeeDataEngineer Full time US$ 1,75,000 - US$ 2,12,500

    Senior Data Engineer for Analytics">Truckmentum is seeking a seasoned data engineer to join our team and help us drive innovation in the trucking industry. Our goal is to revolutionize decision-making with cutting-edge software and data infrastructure.">You will be responsible for designing and building scalable data pipelines, high-performance backend...

  • Data Engineering Professional

    3 days ago

    Allahabad, Uttar Pradesh, India beBeeDatabricks Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Senior Databricks Data Engineer">We are seeking a highly skilled Data Engineering Professional to join our dynamic team. The ideal candidate will be well-versed in PySpark, CI/CD pipelines, and Terraform for infrastructure as code.Key Responsibilities:Design, develop, and maintain scalable and high-performance data pipelines using Databricks and...

  • Cloud Data Engineering Lead

    3 days ago

    Allahabad, Uttar Pradesh, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Senior AWS Data Engineer Job DescriptionWe are seeking a highly skilled Senior AWS Data Engineer to join our team.The ideal candidate will have extensive experience in designing, developing, and deploying end-to-end data pipelines on AWS cloud infrastructure using services such as Amazon S3, AWS Glue, AWS Lambda, Amazon Redshift, etc.Design and Develop Data...

  • Senior Cloud Data Engineer

    7 hours ago

    Allahabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 10,00,000 - ₹ 15,00,000

    Cloud Data Engineering RoleOur organization is seeking an experienced Cloud Data Engineer to develop and maintain robust data pipelines using cloud services such as GCP, AWS, or Azure.Key Responsibilities:Design and Develop Scalable Data PipelinesImplement Data Ingestion, Transformation, and Storage SolutionsEnsure Data Quality, Integrity, and...

  • Senior Data Extraction Specialist

    4 days ago

    Allahabad, Uttar Pradesh, India beBeeData Full time ₹ 9,00,000 - ₹ 12,00,000

    Senior Data Extraction SpecialistWe are seeking a highly skilled and experienced data extraction specialist to join our organization. As a senior developer, you will be responsible for designing and implementing a strategic data system that requires extraction and structuring from various online sources involving dynamic content.About the ProjectThe...