Data Engineering Lead

2 months ago

bangalore, India ofi Full time

Data Engineering Lead

At ofi, we are on a mission to leverage data to drive innovation and business transformation. We are looking for a Data Engineering Lead to spearhead our data engineering team and contribute to our mission of delivering data-driven solutions. As a Data Engineering Lead, you will be responsible for managing the data engineering team and overseeing the design and implementation of our data infrastructure. You will work closely with data scientists, analysts, and other stakeholders to ensure the seamless flow and integrity of data across the organization.


Key Responsibilities:

Data Infrastructure Management:

  • Design and Build Data Architecture: Construct robust data pipelines in the Snowflake environment (hosted in MS Azure) to support scalable data ingestion, transformation, and delivery.
  • Data Collection and Integration: Develop systems to collect data from various sources (including SAP ERP, Salesforce, other IT systems as well as OT systems) using real-time or batch ingestion technologies, ensuring it is accurately integrated into the Snowflake platform.
  • Data Transformation: Implement processes to normalize, aggregate, and transform data into a format suitable for analysis and reporting.
  • Performance Optimization: Optimize data retrieval and query performance within Snowflake, ensuring efficient operation of data pipelines.
  • Collaboration with Stakeholders: Work closely with business leaders to understand company objectives and align data engineering strategies accordingly.
  • Governance and Security: Partner with legal and cyber security teams to maintain high standards of data governance and security, ensuring compliance with relevant regulations.
  • Innovation and Improvement: Stay abreast of the latest technology innovations in data engineering and apply them to improve existing systems and processes.
  • Team Leadership: Lead and mentor a team of data engineers, fostering a culture of technical excellence and continuous learning.


Data Quality Assurance:

  • Collaborate with subject matter experts to establish data quality rules, standards, and thresholds for the data domains.
  • Develop and implement data quality metrics /standards, processes, and tools to monitor and improve the quality and accuracy of data across systems and platforms.
  • Implement data validation and cleansing routines to identify and rectify data errors, duplicates, outliers, and missing values, leveraging data quality tools such as Informatica.
  • Conduct data profiling and analysis to identify data quality issues, inconsistencies, and anomalies and work with relevant teams to address them.
  • Implement data lineage and metadata management solutions to track the origin, transformations, and usage of data across the organization.


Requirements

  • Bachelor’s or master’s degree in Computer Science, Data Analytics, Data Science, Information Technology, etc.
  • Proven 6+ years of experience in data engineering, with 2+ years as the Data Engineering Lead.
  • Knowledge of SAP ERP (S4HANA and ECC) including its integration with Snowflake.
  • Functional understanding of customer experience, manufacturing, supply chain, and financial concepts
  • Proficiency in data pipeline tools and technologies, particularly within the Snowflake ecosystem.
  • Extensive experience with SQL databases and multiple programming languages.
  • Experience in working with data quality tools such as Informatica.

  • Data engineer

    4 weeks ago

    Bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost...

  • Data Engineer

    4 weeks ago

    Bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and...

  • Data Engineer

    18 hours ago

    bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and...

  • Data Engineer

    2 hours ago

    bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. - Lead the architecture, design, and delivery of enterprise grade microservices. - Deliver assigned projects within budgeted time, cost and...

  • Data Engineer

    7 days ago

    bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data EngineerLocation: Yemalur, BangaloreYour Key Responsibilities:Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders.Lead the architecture, design, and delivery of enterprise grade microservices.Deliver assigned projects within budgeted time, cost and agreed...

  • Data Engineer

    4 weeks ago

    bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders.Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and agreed...

  • Data Engineer

    1 month ago

    bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and...

  • Data Engineer

    1 month ago

    bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders.Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and agreed...

  • Data engineer

    1 week ago

    Bangalore City, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and agreed...

  • Data Engineering Lead

    2 weeks ago

    Bangalore, India TekPillar Full time

    Job Title: Data Engineering LeadAbout the Role:We are seeking a seasoned Data Engineering Lead to join our team at TekPillar. As a Data Engineering Lead, you will be responsible for leading large-scale data engineering initiatives and driving the development of our data infrastructure.Your Key Responsibilities:Lead the design, development, and deployment of...

  • Data Engineering Lead

    4 days ago

    bangalore, India ofi Full time

    Data Engineering Lead At ofi, we are on a mission to leverage data to drive innovation and business transformation. We are looking for a Data Engineering Lead to spearhead our data engineering team and contribute to our mission of delivering data-driven solutions. As a Data Engineering Lead, you will be responsible for managing the data engineering team and...

  • Data engineering lead

    3 weeks ago

    Bangalore, India Ofi Full time

    Data Engineering Lead At ofi , we are on a mission to leverage data to drive innovation and business transformation. We are looking for a Data Engineering Lead to spearhead our data engineering team and contribute to our mission of delivering data-driven solutions. As a Data Engineering Lead, you will be responsible for managing the data engineering...

  • Data Engineering Lead

    3 weeks ago

    Bangalore, India ofi Full time

    Data Engineering Lead At ofi , we are on a mission to leverage data to drive innovation and business transformation. We are looking for a Data Engineering Lead to spearhead our data engineering team and contribute to our mission of delivering data-driven solutions. As a Data Engineering Lead, you will be responsible for managing the data engineering team...

  • Data Engineering Lead

    2 months ago

    bangalore, India ofi Full time

    Data Engineering Lead At ofi , we are on a mission to leverage data to drive innovation and business transformation. We are looking for a Data Engineering Lead to spearhead our data engineering team and contribute to our mission of delivering data-driven solutions. As a Data Engineering Lead, you will be responsible for managing the data engineering team...

  • Data Engineering Lead

    7 days ago

    bangalore, India ofi Full time

    Data Engineering LeadAt ofi, we are on a mission to leverage data to drive innovation and business transformation. We are looking for a Data Engineering Lead to spearhead our data engineering team and contribute to our mission of delivering data-driven solutions. As a Data Engineering Lead, you will be responsible for managing the data engineering team and...

  • Solution Engineer

    1 month ago

    Bangalore, Karnataka, India HEVO DATA Full time

    Overview :. We're seeking a talented Solutions Engineer with strong background in Data Domain to join our growing Sales team. You'll work one-on-one with the sales team to help discover our customers' business and technical needs and demonstrate how Hevo's platform can solve their real-time data replication needs. In this role, you will have...

  • Data Engineering Lead

    3 weeks ago

    bangalore, India ofi Full time

    Data Engineering LeadAt ofi, we are on a mission to leverage data to drive innovation and business transformation. We are looking for a Data Engineering Lead to spearhead our data engineering team and contribute to our mission of delivering data-driven solutions. As a Data Engineering Lead, you will be responsible for managing the data engineering team and...

  • Lead Data Engineer

    1 month ago

    Bangalore, Karnataka, India Sentienz Full time

    Job Description : As a Lead Data Engineer, you will play a pivotal role in driving our data-driven initiatives. You will be responsible for designing, developing, and maintaining robust data engineering solutions that support our analytics and decision-making processes.Responsibilities :- Lead and mentor a team of data engineers, providing technical guidance...

  • Data Engineering Lead

    4 weeks ago

    Bangalore, India e-Hireo Full time

    Lead Data EngineerWe are seeking a highly skilled Lead Data Engineer to join our team at e-Hireo. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data platforms that support our business operations.Key Responsibilities:Design and implement data pipelines using AWS services such as...

  • Lead Data Engineer

    3 days ago

    Bangalore, India Papa Johns Global Capability Center Full time

    The Lead Data Analytics Engineer will develop and implement the strategies for the data layer for Papa John’s analytics stack, top to bottom. He/she will work closely with multiple disciplines from data engineering to data analytics and visualization across all stages of data maturity for the purpose of delivering robust Business Intelligence solutions....