Advanced Data Engineering Lead

2 days ago

Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000
Senior Data Engineer Position

We are seeking a seasoned Senior Data Engineer to lead our data science and analytics team. This individual will be responsible for designing, developing, and maintaining our data infrastructure, ensuring data integrity, and supporting various data-driven projects.

Key Responsibilities:
  • Design and develop scalable, high-performance data pipelines and ETL/ELT frameworks aligned with modern data engineering best practices.
  • Architect complex data integration workflows that bring together structured, semi-structured, and unstructured data from both cloud and on-premise sources.
  • Build robust real-time, batch, and on-demand pipelines with built-in observability—monitoring, alerting, and automated error handling.
  • Partner with analysts, data scientists, and business leaders to define and deliver reliable data models, quality frameworks, and SLAs that power key business insights.
  • Ensure optimal pipeline performance and throughput, with clearly defined SLAs and proactive alerting for data delivery or quality issues.
  • Collaborate with platform, DevOps, and architecture teams to build secure, reusable, and CI/CD-enabled data workflows that align with enterprise architecture standards.
  • Establish and enforce the best practices in source control, code reviews, testing automation, and continuous delivery for all data engineering components.
  • Lead root cause analysis (RCA) and preventive maintenance for critical data failures, ensuring minimal business impact and continuous service improvement.
  • Guide the team in establishing standards for data modeling, transformation logic, and governance, ensuring long-term maintainability and scalability.
  • Design and execute comprehensive testing strategies—unit, integration, and system testing—ensuring high data reliability and pipeline resilience.
  • Monitor and fine-tune data pipeline and query performance, optimizing for reliability, scalability, and cost-efficiency.
  • Create and maintain detailed technical documentation, including data architecture diagrams, process flows, and integration specifications for internal and external stakeholders.
  • Facilitate and lead discussions with business and operational teams to understand data requirements, prioritize initiatives, and drive data strategy forward.
Requirements:
  • 7 to 10 years of hands-on experience in data engineering roles with a proven record of building scalable and secure data platforms.
  • Over 5 years of experience in scripting languages such as Python for data processing, automation, and ETL development.
  • 4+ years of experience with Snowflake, including performance tuning, security model design, and advanced SQL development.
  • 5+ years of experience with data integration tools such as Azure Data Factory, Fivetran, or Matillion.
  • 5+ years of experience in writing complex, highly optimized SQL queries on large datasets.
  • Proven experience integrating and managing APIs, JSON, XML, and webhooks for data acquisition.
  • Hands-on experience with cloud platforms (Azure/AWS) and orchestration tools like Apache Airflow or equivalent.
  • Experience with CI/CD pipelines, automated testing, and code versioning tools (e.g., Git).
  • Familiarity with dbt or similar transformation tools and best practices for modular transformation development.
  • Exposure to data visualization tools like Power BI for supporting downstream analytics is a plus.
  • Strong interpersonal and communication skills with the ability to lead discussions with technical and business stakeholders.
Education:
  • Bachelor's or Master's degree in Computer Science/Information technology or related field.
  • Equivalent academic and work experience can be considered.

  • Data Engineer

    3 days ago

    Pune, Maharashtra, India Data Axle Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    About Data Axle:Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging proprietary...

  • Lead Data Engineer

    6 days ago

    Pune, Maharashtra, India Arting Digital Private Limited Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Posting title: Lead Data Engineer (Databricks)Experience: 7+ YearsLocation: Pune/ AhmedabadWork mode: HybridPrimary skills: Databricks, Data Modelling/ Data Lakehouse, Gen AI, SQL, Python/Scala, Azure Data Factory (ADF)/AWS Glue, Docker, Team LeadQualification: Any Technical DegreeRoles & Responsibilities:Lead the design, development, and optimization of...

  • Lead Data Engineer

    4 days ago

    Pune, Maharashtra, India Arting Digital Full time ₹ 1,04,000 - ₹ 13,08,780 per year

    Posting title :Lead Data Engineer (Databricks)Experience :7+ YearsLocation :Pune/ AhmedabadWork mode :HybridPrimary skills :Databricks, Data Modelling/ Data Lakehouse, Gen AI, SQL, Python/Scala, Azure Data Factory (ADF)/AWS Glue, Docker, Team LeadQualification :Any Technical DegreeRoles & ResponsibilitiesLead the design, development, and optimization of data...

  • Advanced Data Modeling Lead

    5 days ago

    Pune, Maharashtra, India beBeeDataScientist Full time ₹ 25,00,000 - ₹ 35,00,000

    Job Overview:We are seeking an experienced Senior Data Scientist to lead advanced data-driven initiatives, perform in-depth exploratory data analysis, and develop highly scalable machine learning models.Key Responsibilities:Develop and implement cutting-edge ML models.Drive end-to-end data science projects from inception to deployment.Apply deep learning...

  • Lead Data Engineering Specialist

    2 weeks ago

    Pune, Maharashtra, India beBeeData Full time ₹ 10,00,000 - ₹ 15,00,000

    Job Title: Lead Data Scraping EngineerWe are seeking an experienced data scraping professional to drive the success of our team.The ideal candidate will have a minimum of 4 years of hands-on experience in IT scraping, with at least 2 years leading a team of 5+ developers.This role requires deep technical knowledge in advanced scraping techniques, reverse...

  • Advanced Data Platform Engineer

    1 week ago

    Pune, Maharashtra, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Data Architect for Advanced Analytics Platforms">This role is focused on designing, developing and maintaining large-scale data platforms to support advanced analytics initiatives. The ideal candidate will have experience with big data technologies such as Hadoop, Spark, and Kafka, and be proficient in programming languages like Python, Java, and Scala.The...

  • Advanced Data Engineer for Pharmaceutical Analytics

    1 day ago

    Pune, Maharashtra, India beBeeDataEngineer Full time US$ 90,000 - US$ 1,20,000

    We are seeking a talented and self-driven professional to join our data-driven organization and play an active role in transforming our business with cutting-edge analytics.As a senior engineer, you will be part of the commercial data solutions team, providing technical expertise in developing analytical data products to enable data science and analytics use...

  • Lead Data Engineer

    1 week ago

    Pune, Maharashtra, India Diggi Growth Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Experience Level: 8+ years (with 3+ in Snowflake)HYBRID MODELRole Overview:We are looking for an experienced Snowflake Team Lead to oversee both development and production support operations within our managed services model. This is a dual-role leadership position requiring strong technical capabilities in Snowflake as well as expertise in managing ongoing...

  • Azure Data Engineer

    6 days ago

    Pune, Maharashtra, India Capgemini Engineering Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    At Capgemini Engineering, the world leader in engineering services, we bring together a global team of engineers, scientists, and architects to help the world's most innovative companies unleash their potential. From autonomous cars to life-saving robots, our digital and software technology experts think outside the box as they provide unique R&D and...

  • Data Engineer

    1 week ago

    Pune, Maharashtra, India Jash Data Sciences Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    Do you love solving real-world data problems with the latest and best techniques? And having fun while solving them in a team Then come join our high-energy team of passionate data people. Jash Data Sciences is the right place for you.We are a cutting-edge Data Sciences and Data Engineering startup based in Pune, India.We believe in continuous learning and...