Data Engineering Lead

1 day ago

Agra, Uttar Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 18,00,000
Senior Data Architect

We are seeking an experienced Senior Data Architect to lead our team's data engineering efforts. The ideal candidate will have a strong background in designing and implementing large-scale data pipelines, with expertise in building and automating deployments, as well as working with modern DevOps/configuration management tools.

Main Responsibilities:

  • Lead the development and maintenance of Continuous Integration/Continuous Deployment (CI/CD) pipelines using GitHub Actions or equivalent tools.
  • Configure and maintain GitHub branch protection rules and workflows to ensure smooth code integration and deployment.
  • Design and optimize Spark jobs in Databricks for large-scale data processing, ensuring high performance and reliability.
  • Automate Databricks deployments using Databricks Asset Bundles (DABs) or similar frameworks.
  • Develop robust data pipelines using Python and SQL, focusing on data quality and consistency.
  • Implement unit testing, validation, and quality checks for data workflows, ensuring reliability and accuracy.
  • Manage multi-environment deployments (Dev, Stage, Prod), ensuring seamless integration and scalability.
  • Create and maintain configuration files (YAML, JSON) for workflows, pipelines, and automation, ensuring clarity and efficiency.
  • Troubleshoot and resolve configuration or syntax issues in YAML and related files, minimizing downtime.
  • Migrate legacy reports into modern, self-serve dashboards (Snowflake, Tableau, Power BI), providing actionable insights.

The successful candidate will partner with cross-functional teams to understand needs and deliver data models, insights, and reporting they can trust, driving business growth and success.

  • Data Engineering Team Lead

    18 hours ago

    Agra, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Data Engineering Team LeadAbout the RoleThis role is focused on leading a team of data engineers to drive business growth through innovative data solutions.Responsibilities:Lead a team of data engineers to design, develop, and implement data engineering solutions.Collaborate with cross-functional teams to understand business requirements and...

  • Data Engineering Lead

    2 days ago

    Agra, Uttar Pradesh, India beBeeData Full time ₹ 40,00,000 - ₹ 50,00,000

    About Our TeamWe are a dynamic and innovative team focused on building and improving our Data Warehouse offerings. As a Principal Data Engineer, you will be responsible for leading a team of Senior Engineers and working closely with clients to gather requirements.In this role, you will have the opportunity to propose architecture, solve complex data modeling...

  • Lead Data Engineer

    18 hours ago

    Agra, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Key Responsibilities:Data Engineering Role: Lead the development, implementation, and maintenance of large-scale data pipelines and infrastructure.ETL Processes: Design, develop, and optimize ETL processes to ensure efficient data flow and transformation.Data Lake Management: Develop and maintain data lake solutions using Azure Data Lake for efficient...

  • Data Engineering Lead

    3 days ago

    Agra, Uttar Pradesh, India beBeeFabric Full time ₹ 18,00,000 - ₹ 27,00,000

    Job TitleWe are seeking an Architect to lead the design and implementation of next-generation analytics platforms in the Microsoft ecosystem.This is a remote role where you will define architecture, guide implementation, and enable data teams to deliver insights faster and with enterprise-grade governance.Key Responsibilities:Design and implement scalable...

  • Leading Data Engineering Expert

    3 days ago

    Agra, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    We're seeking a highly skilled Data Engineer to join our team in developing and delivering cutting-edge intelligence infrastructure.About the RoleThis position involves designing, building, and maintaining sophisticated ETL pipelines using DBT, SSIS, Informatica, or Talend. You'll also design high-performance database structures and queries for analytics,...

  • Data Engineering Lead with 8+ Years of Experience

    5 days ago

    Agra, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,20,00,000 - ₹ 2,25,00,000

    Senior Data Engineer OpportunityWe are seeking a seasoned Senior Data Engineer to lead our data engineering initiatives. The ideal candidate will have strong experience in designing, developing, and maintaining large-scale data pipelines using PySpark.

  • Data Engineer Position

    18 hours ago

    Agra, Uttar Pradesh, India beBeeSenior Full time ₹ 12,80,000 - ₹ 19,36,000

    A leading data engineer opportunity is available in the field of Senior data engineer.This role involves working with Airflow, utilizing its potential to streamline data processing and analytics tasks. Proficiency in Python programming is a must, along with expertise in Snowflake for efficient data storage and management.Located in Pune, Bengaluru, or...

  • Data Engineering Expert

    18 hours ago

    Agra, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 13,71,500 - ₹ 21,35,900

    Seeking a Data Engineering Expert to lead the development and implementation of scalable data solutions.Required Skills and Qualifications:Bachelor's or Master's degree in Computer Science, Information Systems, Data Science, or related field.6+ years of experience in data analysis, engineering, or solution design in Compliance, Risk, or Financial Services...

  • Data Engineering Specialist

    22 hours ago

    Agra, Uttar Pradesh, India beBeeEngineering Full time ₹ 17,75,000 - ₹ 23,57,000

    About Our Opportunity:We are seeking an experienced Data Engineer to join our team in Hyderabad. As a key member of our organization, you will be responsible for designing and implementing scalable data solutions to support our business functions.Position Summary:This is a challenging role that requires expertise in cloud computing platforms, technologies,...

  • Lead Data Architect

    5 days ago

    Agra, Uttar Pradesh, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    About usWe are a global leader in insurance, operating in 54 countries and territories. Our commercial and personal property and casualty insurance products cater to diverse groups of clients. We have an extensive product and service offering, broad distribution capabilities, exceptional financial strength, and local operations worldwide.Our company is...