Data Engineering Lead

2 months ago

Bengaluru, India ofi Full time

Data Engineering Lead

At ofi , we are on a mission to leverage data to drive innovation and business transformation. We are looking for a Data Engineering Lead to spearhead our data engineering team and contribute to our mission of delivering data-driven solutions. As a Data Engineering Lead, you will be responsible for managing the data engineering team and overseeing the design and implementation of our data infrastructure. You will work closely with data scientists, analysts, and other stakeholders to ensure the seamless flow and integrity of data across the organization.


Key Responsibilities:

Data Infrastructure Management:

  • Design and Build Data Architecture: Construct robust data pipelines in the Snowflake environment (hosted in MS Azure) to support scalable data ingestion, transformation, and delivery.
  • Data Collection and Integration: Develop systems to collect data from various sources (including SAP ERP, Salesforce, other IT systems as well as OT systems) using real-time or batch ingestion technologies, ensuring it is accurately integrated into the Snowflake platform.
  • Data Transformation: Implement processes to normalize, aggregate, and transform data into a format suitable for analysis and reporting.
  • Performance Optimization: Optimize data retrieval and query performance within Snowflake, ensuring efficient operation of data pipelines.
  • Collaboration with Stakeholders: Work closely with business leaders to understand company objectives and align data engineering strategies accordingly.
  • Governance and Security: Partner with legal and cyber security teams to maintain high standards of data governance and security, ensuring compliance with relevant regulations.
  • Innovation and Improvement: Stay abreast of the latest technology innovations in data engineering and apply them to improve existing systems and processes.
  • Team Leadership: Lead and mentor a team of data engineers, fostering a culture of technical excellence and continuous learning.


Data Quality Assurance:

  • Collaborate with subject matter experts to establish data quality rules, standards, and thresholds for the data domains.
  • Develop and implement data quality metrics /standards, processes, and tools to monitor and improve the quality and accuracy of data across systems and platforms.
  • Implement data validation and cleansing routines to identify and rectify data errors, duplicates, outliers, and missing values, leveraging data quality tools such as Informatica.
  • Conduct data profiling and analysis to identify data quality issues, inconsistencies, and anomalies and work with relevant teams to address them.
  • Implement data lineage and metadata management solutions to track the origin, transformations, and usage of data across the organization.


Requirements

  • Bachelor’s or master’s degree in Computer Science, Data Analytics, Data Science, Information Technology, etc.
  • Proven 6+ years of experience in data engineering, with 2+ years as the Data Engineering Lead.
  • Knowledge of SAP ERP (S4HANA and ECC) including its integration with Snowflake.
  • Functional understanding of customer experience, manufacturing, supply chain, and financial concepts
  • Proficiency in data pipeline tools and technologies, particularly within the Snowflake ecosystem.
  • Extensive experience with SQL databases and multiple programming languages.
  • Experience in working with data quality tools such as Informatica.

  • Data Engineer Lead

    6 hours ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Data Engineer LeadData Engineers within NTT DATA Services drive the creation of innovative data solutions that benefit our clients. As a Data Engineer Lead, you will be responsible for leading diverse data engineering activities on the Azure Data platform, including the development and delivery of data pipelines connecting various enterprise data sources,...

  • Data Engineer Lead

    3 weeks ago

    Bengaluru, Karnataka, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data EngineerLocation: Yemalur, BangaloreKey Responsibilities:Lead our engineering team to successfully build and deploy cutting-edge analytics products for consumption by different stakeholders.Lead the architecture, design, and delivery of enterprise-grade microservices.Deliver assigned projects within budgeted time, cost, and agreed...

  • Data Engineer

    4 weeks ago

    Bengaluru, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders.Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and agreed...

  • Data Engineer

    4 weeks ago

    Bengaluru, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders.Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and agreed...

  • Data Engineer

    2 days ago

    Bengaluru, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data EngineerLocation: Yemalur, BangaloreYour Key Responsibilities:Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders.Lead the architecture, design, and delivery of enterprise grade microservices.Deliver assigned projects within budgeted time, cost and agreed...

  • Data Engineer

    3 days ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job DescriptionData Engineer - Diverse Data Engineering Activities on Azure Data PlatformMain Responsibilities:Design and develop big data processing notebooks using Azure DatabricksLead the data identification, data analysis efforts for data sources and work directly with data owner teamsDevelop data requirements for new data sourcesDesign and development...

  • Software Engineering Lead

    3 days ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job OverviewReq ID: 296759NTT DATA is seeking a talented Software Engineering Lead to join our team in India. As a Java Developer - Digital Engineering Lead Engineer, you will be responsible for leading the development of enterprise cloud solutions using Azure, AWS, and GCP.Key Responsibilities:Lead the development of enterprise cloud solutions using Java,...

  • Senior Data Engineer

    3 days ago

    Bengaluru, Karnataka, India Altair Engineering Full time

    Transforming Business with Data-Driven InsightsAt Altair Engineering, we're looking for a talented Senior Data Engineer to join our team. As a key member of our data analytics group, you will be responsible for designing and implementing scalable data pipelines, ensuring the accuracy and reliability of our data.Key Responsibilities:Design and implement data...

  • Lead Data Scientist

    3 weeks ago

    Bengaluru, Karnataka, India Altair Engineering Full time

    Transforming the Future with Data ScienceAt Altair Engineering, we're seeking a talented Data Science Expert to join our team. As a key member of our data analytics team, you'll play a crucial role in driving business growth and innovation through data-driven insights.Key Responsibilities:Design and develop data pipelines to collect, store, and analyze large...

  • Data Visualization Engineer

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Title: Data Visualization EngineerJob Summary:Data Visualization Engineer - NTT DATAData visualization engineers utilize expertise in information visualization and design to create and deploy new platforms and services for visualization initiatives. Visualization specialists build interactive and complex data visualizations and analysis tools. They are...

  • Senior Lead Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Title: Senior Lead EngineerJob Summary:NTT DATA Services is seeking a Senior Lead Engineer to join our team in Remote, India. As a Senior Lead Engineer, you will be responsible for developing custom business logic in APEX, writing test classes, creating Lightning Web Components, Visualforce Pages, and Triggers.Key Responsibilities:Develop custom business...

  • Data Engineer

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at NTT DATA Services. As a Data Engineer, you will be responsible for designing and developing data pipelines utilizing Cloud technologies Azure/AWS/GCP.Key ResponsibilitiesDesign and develop data pipelines using Cloud technologies Azure/AWS/GCPLead a team of Data Engineers and act...

  • Digital Engineering Lead

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Title: Digital Engineering Lead EngineerAbout the Role:We are seeking a highly skilled Digital Engineering Lead Engineer to join our team in Bengaluru, India. As a key member of our team, you will be responsible for designing and implementing data storage solutions, managing and developing data processing, and optimizing data solutions using Azure.Key...

  • Digital Engineering Lead

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Title: Digital Engineering Lead EngineerAbout the Role:We are seeking a highly skilled Digital Engineering Lead Engineer to join our team in Bengaluru, India. As a key member of our team, you will be responsible for designing and implementing data storage solutions, managing and developing data processing, and optimizing data solutions on Azure.Key...

  • Lead Data Scientist

    5 months ago

    Bengaluru, India Altair Engineering Full time

    Transforming the Future with the Convergence of Simulation and Data Lead Data Scientist Do you like a challenge, are you a complex thinker who likes to solve problems? If so, then you might be the new Altairian we are searching for. At Altair, your curiosity matters. We pride ourselves on a business culture that enables open, creative thinking, and...

  • Digital Engineering Lead Engineer

    3 days ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job DescriptionReq ID: 299336 NTT DATA is seeking a talented Digital Engineering Lead Engineer to join our team in Bangalore, Karnātaka, India. This role is part of our JavaScript and Web Platform engineering practice, where you will be surrounded by top-notch engineers and have plenty of interesting challenges.Key Responsibilities:Write code, create unit...

  • Data Engineer

    2 weeks ago

    Bengaluru, India NTT DATA Services Full time

    Req ID: 301314 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Job Duties: As a data engineer you will...

  • Digital Engineering Lead

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Title: Digital Engineering LeadAbout the Role:We are seeking a highly skilled Digital Engineering Lead to join our team in Bangalore, India. As a key member of our engineering team, you will be responsible for leading the development of cloud-based solutions using Java, Spring Boot, and Azure.Key Responsibilities:Maintain high standards of software...

  • Digital Engineering Lead

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Title: Digital Engineering LeadJob Summary:We are seeking a highly skilled Digital Engineering Lead to join our team in Bangalore, India. The successful candidate will be responsible for maintaining high standards of software quality, facilitating the scaled agile development process, and designing, developing, and unit testing applications in accordance...

  • Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Title: Data EngineerJob Summary:We are seeking a highly skilled Data Engineer to join our team at NTT DATA. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems and pipelines using Azure data factory and Azure databricks.Key Responsibilities:Design and develop innovative data pipelines using Azure...