Senior Technical Lead for Large-Scale Data Systems

3 days ago

Bareilly, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000
Job Overview

We are seeking an experienced Principal Data Engineer to lead our team of senior engineers in designing and implementing data-intensive applications.

The ideal candidate will have a strong technical background in data engineering, including experience with cloud-native technologies, Databricks, dbt, Airflow, Docker, Kubernetes, and Spark.

Key Responsibilities:

  • Lead a team of 4-5 senior engineers in designing and implementing data-intensive applications.
  • Propose and review architecture for large-scale data systems.
  • Solve complex data modeling and workflow management issues.
  • Interact directly with clients to gather requirements and build holistic roadmaps.

Requirements:

  • 10+ years of experience in software development and data structures/algorithms with a focus on backend and data engineering.
  • 8+ years of hands-on experience in Python, JVM, and Shell Scripting with production experience.
  • 5+ years of proven experience in building cloud-native data-intensive applications with Amazon Web Services experience.
  • Experience in Databricks and dbt is required.
  • Highly proficient in architecting and implementing workflow management systems with Airflow.
  • Familiarity with containerization and orchestration technologies like Docker and Kubernetes.
  • Hands-on experience in building and maintaining Spark applications.
  • Fundamental understanding of Parquet, Delta Lake, and other OTF file formats.
  • Proficiency in Infrastructure as Code (IaC) tools like Terraform, CDK, or CloudFormation.
  • Experience with observability systems like Datadog or Prometheus/Grafana.
  • Strong experience in building CI/CD processes with GitHub Actions, ArgoCD, or Jenkins.
  • Experience with unit testing and test automation frameworks.

Soft Skills:

  • Comfortable providing and receiving constructive feedback.
  • Ability to code and provide good quality readable business documentation.
  • Focus on business value vs engineering interest.
  • Pro-active and service-oriented towards internal customers.

What We Are Looking For:

This position requires a strong technical background in data engineering with leadership experience. The ideal candidate will have a proven track record of delivering high-quality features and leading teams to success.

  • Large Scale Data Processing Systems Engineer

    1 day ago

    Bareilly, Uttar Pradesh, India beBeeData Full time ₹ 16,00,000 - ₹ 22,00,000

    Technical Lead for Large-Scale Data Processing SystemsJob Description:As a Technical Lead, you will oversee the development and maintenance of large-scale data processing systems using Big Query and TensorFlow. You will work with cross-functional teams to design and implement monitoring and logging systems using SQL.About the Role:Design and develop scalable...

  • Building Large-Scale Data Processing Systems

    24 hours ago

    Bareilly, Uttar Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 22,00,000

    Cloud Data EngineerWe are seeking a skilled Cloud Data Engineer to join our organization.As a Cloud Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Google Cloud Platform (GCP).Your key responsibilities will include:Designing and implementing data pipelines using GCP services such as...

  • Large Scale Enterprise Automation Expert

    1 day ago

    Bareilly, Uttar Pradesh, India beBeeRPA Full time ₹ 1,50,00,000 - ₹ 2,01,00,000

    Enterprise RPA Solution ArchitectWe seek an innovative solution architect to lead the design and deployment of large-scale enterprise RPA solutions.This role requires not just a developer but a strategic technologist who can architect end-to-end automation frameworks, integrate advanced cloud capabilities, and drive transformational efficiency gains.Key...

  • Senior Data Systems Developer

    2 weeks ago

    Bareilly, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 7,20,000 - ₹ 10,80,000

    Data Engineering RoleAs a seasoned data engineering professional, you will design and develop scalable data systems using industry-leading technologies.We seek an exceptional candidate with at least 5-8 years of experience in data engineering, strong proficiency in Python, PySpark, SQL, and Palantir Foundry.Responsibilities:Design Data Systems: Collaborate...

  • Senior Technical Lead

    1 day ago

    Bareilly, Uttar Pradesh, India beBeeTechnical Full time ₹ 16,80,000 - ₹ 2,24,20,000

    Senior Technical Lead PositionWe are seeking a seasoned Senior Technical Lead to spearhead our engineering team's efforts in building scalable, high-performance systems.

  • Senior Backend Technology Lead

    5 days ago

    Bareilly, Uttar Pradesh, India beBeeProjectManager Full time ₹ 12,00,000 - ₹ 20,00,000

    Job Description:We are seeking a skilled Technical Project Manager/Senior Java Developer to join our team.Responsibilities include facilitating requirement gathering sessions, translating business requirements into actionable technical tasks, and working on Apache Spark-based batch jobs and large-scale data processing pipelines.Additionally, the ideal...

  • Senior Data Scientist

    3 weeks ago

    Bareilly, Uttar Pradesh, India ThreatModeler Software, Inc Full time

    About the CompanyThreatModeler Software, Inc. is an industry leader in automated threat modeling, helping enterprises proactively secure their systems by identifying, quantifying, and mitigating cybersecurity threats during the design phase. We're expanding our AI capabilities to accelerate threat detection, model generation, and decision intelligence —...

  • Large Scale Cloud Migration Specialist

    5 days ago

    Bareilly, Uttar Pradesh, India beBeeCloudMigration Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Cloud Migration Engineer PositionWe are seeking a highly skilled Cloud Migration Engineer to join our team. This role requires expertise in designing, developing, and implementing complex data pipelines for migrating data from on-premise sources to cloud platforms.The ideal candidate will have a strong background in migrating on-premise data systems to the...

  • Lead AI Data Modeler

    1 week ago

    Bareilly, Uttar Pradesh, India beBeeDataScience Full time ₹ 80,00,000 - ₹ 1,50,00,000

    About Our OpportunityWe are seeking an experienced Data Scientist to lead the design, development, and deployment of AI-driven solutions using the Azure ecosystem. This role involves leveraging expertise in Machine Learning, Generative AI, and Large Language Models (LLMs) to drive business growth.Key Responsibilities:Design and develop end-to-end ML...

  • Chief Data Architect

    7 days ago

    Bareilly, Uttar Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 20,10,000

    We are seeking a highly skilled Senior Data Engineer to join our growing team of consultants.The ideal candidate will be responsible for designing, constructing, and optimizing large-scale data processing systems that enable advanced analytics and business intelligence.Key ResponsibilitiesData Engineering ExpertiseDesign, develop, and maintain scalable and...