Senior Data Engineer

3 days ago

Allahabad, Uttar Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

We are seeking a highly skilled professional with 4+ years of experience in Data Engineering, with strong expertise in Python, Scala, Spark (PySpark & Scala Spark), and Azure Cloud technologies.

  • Key Responsibilities
  • Design, develop, and maintain scalable ETL pipelines for batch data ingestion and egress using Azure Data Factory, Databricks, and Spark.
  • Implement data transformation workflows using PySpark and Scala Spark for high-performance data processing.
  • Work extensively with Azure Cloud services including Azure Data Lake, Azure Data Factory, Azure Databricks, Azure SQL Database, and related services.
  • Troubleshoot, debug, and resolve job failures by identifying root causes.
  • Optimize data processing jobs for performance and cost efficiency.
  • Collaborate with business and technical teams to gather requirements and translate them into effective data solutions.
  • Develop reusable and efficient data engineering solutions following best practices.
  • Maintain detailed documentation for solutions, processes, and troubleshooting guides.
Technical Skills Required
  • Strong programming skills in Python and Scala.
  • Hands-on experience with Spark (PySpark & Scala Spark).
  • Proficiency in SQL for data querying and transformation.
  • Good knowledge of Azure Cloud, Azure Data Factory (ADF), and Azure Databricks.
  • Strong understanding of ETL pipeline design and implementation.

Our ideal candidate will possess excellent problem-solving skills, the ability to work under pressure, and a passion for delivering high-quality solutions. If you have a strong background in Data Engineering and are eager to take on new challenges, we encourage you to apply.

  • Data Engineer

    24 hours ago

    Allahabad, Uttar Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior Data ArchitectWe are seeking an experienced Senior Data Architect to lead the development of our data engineering solutions. The ideal candidate will have a strong background in designing and implementing scalable, secure, and efficient data integration systems.

  • Senior Data Engineering Lead

    7 hours ago

    Allahabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    About the RoleWe are seeking a seasoned professional to lead our data engineering efforts. As a Senior Data Engineer, you will play a critical role in designing, building, and operating scalable data pipelines that support our AI-powered applications.This is a key position where you will create robust pipelines that process clinical encounter data, retrieve...

  • Senior Data Engineer

    2 days ago

    Allahabad, Uttar Pradesh, India beBeeData Full time US$ 1,60,000 - US$ 1,90,000

    Role Summary:We are seeking an experienced Senior Data Architect to join our team.This senior-level position will be responsible for designing, implementing, and optimizing a robust data warehousing platform for the pharmaceutical industry.The ideal candidate will have expertise in data architecture and management, with a strong background in data modeling,...

  • Lead Data Engineering Specialist

    6 days ago

    Allahabad, Uttar Pradesh, India beBeeData Full time ₹ 18,00,000 - ₹ 25,00,000

    Job OpportunityWe are seeking an experienced Senior Data Engineer to lead our data engineering efforts. As a Senior Data Engineer, you will be responsible for designing and building robust data pipelines for ingestion, transformation, and analytics using the best of modern data engineering tools and practices on Google Cloud (GCP).The ideal candidate will...

  • Senior Data Engineer

    24 hours ago

    Allahabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 18,00,000

    Job OpportunityAptimized seeks a Data Engineering & Business Intelligence professional to support enterprise data initiatives. This role combines hands-on data engineering and ETL development with business intelligence and reporting delivery, ensuring timely and accurate insights for stakeholders.The ideal candidate will be technically proficient in SQL,...

  • Data Engineering Professional

    3 days ago

    Allahabad, Uttar Pradesh, India beBeeDatabricks Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Senior Databricks Data Engineer">We are seeking a highly skilled Data Engineering Professional to join our dynamic team. The ideal candidate will be well-versed in PySpark, CI/CD pipelines, and Terraform for infrastructure as code.Key Responsibilities:Design, develop, and maintain scalable and high-performance data pipelines using Databricks and...

  • Cloud Data Engineering Lead

    2 days ago

    Allahabad, Uttar Pradesh, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Senior AWS Data Engineer Job DescriptionWe are seeking a highly skilled Senior AWS Data Engineer to join our team.The ideal candidate will have extensive experience in designing, developing, and deploying end-to-end data pipelines on AWS cloud infrastructure using services such as Amazon S3, AWS Glue, AWS Lambda, Amazon Redshift, etc.Design and Develop Data...

  • Senior Data Extraction Specialist

    3 days ago

    Allahabad, Uttar Pradesh, India beBeeData Full time ₹ 9,00,000 - ₹ 12,00,000

    Senior Data Extraction SpecialistWe are seeking a highly skilled and experienced data extraction specialist to join our organization. As a senior developer, you will be responsible for designing and implementing a strategic data system that requires extraction and structuring from various online sources involving dynamic content.About the ProjectThe...

  • Senior Engineering Specialist

    2 days ago

    Allahabad, Uttar Pradesh, India beBeeSoftware Full time ₹ 75,00,000 - ₹ 1,25,00,000

    Job Title: Data EngineerTransformative Opportunities for a Senior Software EngineerNationsBenefits is pioneering innovative healthcare solutions that drive growth, improve outcomes, and deliver value to members. Our comprehensive suite of benefits addresses social determinants of health, ultimately enhancing member health outcomes and satisfaction.As a key...

  • Senior Data Architect Position

    2 days ago

    Allahabad, Uttar Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Lead Data ArchitectThis critical role requires a highly experienced and motivated individual to design, build, deploy, and maintain large-scale data processing systems.Minimum 6 years of experience as a Senior Data Engineer or in a similar position.Expertise in data pipeline, ETL, and workflow management tools such as Databricks and Azure Data...