Data Engineering Lead

3 months ago

Varanasi, India ofi Full time

Data Engineering Lead

At ofi, we are on a mission to leverage data to drive innovation and business transformation. We are looking for a Data Engineering Lead to spearhead our data engineering team and contribute to our mission of delivering data-driven solutions. As a Data Engineering Lead, you will be responsible for managing the data engineering team and overseeing the design and implementation of our data infrastructure. You will work closely with data scientists, analysts, and other stakeholders to ensure the seamless flow and integrity of data across the organization.


Key Responsibilities:

Data Infrastructure Management:

  • Design and Build Data Architecture: Construct robust data pipelines in the Snowflake environment (hosted in MS Azure) to support scalable data ingestion, transformation, and delivery.
  • Data Collection and Integration: Develop systems to collect data from various sources (including SAP ERP, Salesforce, other IT systems as well as OT systems) using real-time or batch ingestion technologies, ensuring it is accurately integrated into the Snowflake platform.
  • Data Transformation: Implement processes to normalize, aggregate, and transform data into a format suitable for analysis and reporting.
  • Performance Optimization: Optimize data retrieval and query performance within Snowflake, ensuring efficient operation of data pipelines.
  • Collaboration with Stakeholders: Work closely with business leaders to understand company objectives and align data engineering strategies accordingly.
  • Governance and Security: Partner with legal and cyber security teams to maintain high standards of data governance and security, ensuring compliance with relevant regulations.
  • Innovation and Improvement: Stay abreast of the latest technology innovations in data engineering and apply them to improve existing systems and processes.
  • Team Leadership: Lead and mentor a team of data engineers, fostering a culture of technical excellence and continuous learning.


Data Quality Assurance:

  • Collaborate with subject matter experts to establish data quality rules, standards, and thresholds for the data domains.
  • Develop and implement data quality metrics /standards, processes, and tools to monitor and improve the quality and accuracy of data across systems and platforms.
  • Implement data validation and cleansing routines to identify and rectify data errors, duplicates, outliers, and missing values, leveraging data quality tools such as Informatica.
  • Conduct data profiling and analysis to identify data quality issues, inconsistencies, and anomalies and work with relevant teams to address them.
  • Implement data lineage and metadata management solutions to track the origin, transformations, and usage of data across the organization.


Requirements

  • Bachelor’s or master’s degree in Computer Science, Data Analytics, Data Science, Information Technology, etc.
  • Proven 6+ years of experience in data engineering, with 2+ years as the Data Engineering Lead.
  • Knowledge of SAP ERP (S4HANA and ECC) including its integration with Snowflake.
  • Functional understanding of customer experience, manufacturing, supply chain, and financial concepts
  • Proficiency in data pipeline tools and technologies, particularly within the Snowflake ecosystem.
  • Extensive experience with SQL databases and multiple programming languages.
  • Experience in working with data quality tools such as Informatica.

  • Data Engineer

    2 weeks ago

    Varanasi, India Bajaj Finserv Full time

    We have an Urgent role for Lead Azure Data Engineer in Pune MHImmediate Joiners Preferredit’s an Onsite roleNotes : a) strong tech solution presentation, b) strong Azure, C) Presales experience there are two positions,12+ years requiredSkills: Azure Data Analytics - Synapse, ADF, One Lake (SQL and Python)

  • Data Engineer

    5 months ago

    Varanasi, India BayOne Solutions Full time

    Work from office- 3 days/WeekLocation: Bangalore/GurgaonJob Description: Min 5 years of experience in modern data engineering/data warehousing/data lakes technologies on cloud platforms like Azure, AWS, GCP, Data Bricks etc. Azure experience is preferred over other cloud platforms. 5 years of proven experience with SQL, schema design and dimensional data...

  • Big Data Engineer

    2 days ago

    Varanasi, India Hexaware Technologies Full time

    Experience : 4-6yrs Work location : Bangalore/Pune/Chennai/Coimbatore/MumbaiNotice Period : Immediate - 30 daysPrimary - Snowflake, Advance SQL, ETL ConceptsSecondary - dbt (Data Build Tool), Prefect/Airflow or a similar orchestration toolJob Description:We are on the looking for a Data Engineer with a solid foundation in Snowflake and a proficient...

  • Data Engineer

    2 days ago

    Varanasi, India Askgp Full time

    Contract job Below are the skill details and required min 7-12 yrs experience candidates and location bangalore1 . Role : Data Engineer( Remote)2 . Required Technical Skill Set: Minimum 5 years of PySpark Development experience, especially in Spark SQL and Complex Transformations• Minimum 3 years of Python development experience• ...

  • Structural Engineer

    2 days ago

    Varanasi, India Isgec Heavy Engineering Ltd. Full time

    Main Responsibilities:Proposal Phase:+Understanding Tender specification requirements related to steel structural design, make comments, clarifications, deviations.Quantity estimation, optimizationLoad data in proposal stageDesign Module, Lifting plans, In-place analysis, Transportation AnalysisAnalysis for proof load testDesign of lifting lug and pad...

  • Lead Software Test automation Engineer

    2 months ago

    Varanasi, India Vertex Inc. Full time

    Job DescriptionAs a Lead Software Engineer on the Productivity Engineering team, you will be responsible for the development of DevOps and test automation including environment creation of products and services, end-to-end solutions test automation that exercises critical customer paths, as well as services and workflows to run within pipelines. What is the...

  • Senior Project Coordinator

    7 days ago

    Varanasi, Uttar Pradesh, India Yield Engineering Systems Full time

    Transform Industries with UsAt Yield Engineering Systems, we're a leading manufacturer of cutting-edge, cost-effective capital equipment that revolutionizes materials and surfaces at the nanoscale.We're a preferred provider of wet and dry process technology, serving startups to the Fortune 50, and helping them develop products that transform lives.As a...

  • Data Scientist

    2 months ago

    varanasi, India Tata Consultancy Services Full time

    Dear Candidate, TCS is hiring for Data Scientist Experience: 4 to 6 yeard Location: PAN INDIA Required Technical Skill Set : Data Science, Python, Gen AI Desired Competencies: Real time industry experience working in Data Science ecosystem, Machine Learning development. Experience working on development of end-end AI application at an enterprise level, as...

  • Senior Data Scientist

    1 month ago

    Varanasi, India Sigmoid Full time

    About the Company: Sigmoid Analytics is a leading Data solutions company backed by Sequoia Capital. We offer best in- end-to-end data value chain spanning across Data Science, Data Engineering and Data Ops. With data and technology at the core of our solutions, we are solving some of the toughest problems out there. Our culture is modelled around expertise...

  • Data Science Manager

    2 weeks ago

    Varanasi, India Indegene Full time

    We are a technology-led healthcare solutions provider. We are driven by our purpose to enable healthcare organizations be future ready. We offer accelerated, global growth opportunities for talent that’s bold, industrious and nimble. With Indegene, you gain a unique career experience that celebrates entrepreneurship, and is guided by passion, innovation,...

  • Senior/Lead Analog Design Engineer – Signal Chain

    2 weeks ago

    Varanasi, India Texas Instruments Full time

    About the group/ teamThis requirement is open for Analog Signal Chain (ASC) -Interface (INT) group at Texas Instruments India. Our charter is to develop products for Automotive and Industrial systems. These data interfaces touch our everyday lives, and the innovation and reliability we bring to these products truly make the world a safer place!!Job...

  • Senior Financial Data Specialist

    4 weeks ago

    Varanasi, Uttar Pradesh, India Fluidata Analytics Full time

    Job Title: Senior Financial Data SpecialistAbout Fluidata Analytics:We are a modern data and analytics consultancy firm providing end-to-end data engineering and analytics solutions to clients using cutting-edge data technology and methodologies.Job Summary:We are seeking a Senior Financial Data Specialist to join our team. The ideal candidate will have...

  • InterSystems IRIS Engineer/Lead

    4 months ago

    Varanasi, India Ascendion Full time

    Key responsibilities include:Demonstrates strong programming expertise, with the ability to execute a wide range of programming activities with minimal supervision.Design and implement data integrations using InterSystems IRIS between HIE partners and internal On-prem/Cloud systems.Debug and fix defects in InterSystems IRIS related any inhouse solutions...

  • Project Lead

    1 month ago

    varanasi, India Savanna HR Full time

    Position SummaryThe Project Lead (PL) will lead the implementation of the project at the district level and be responsible for the focused implementation of the NIPUN program in the intervention schools to deliver significant gains in Student Learning Outcomes and Classroom Practices in the intervention 100+ school portfolio through a team of 6-10 Program...

  • Senior Data Analyst

    2 weeks ago

    Varanasi, Uttar Pradesh, India AKS ProTalent Full time

    We are looking for a highly analytical and strategic Business Intelligence Specialist to provide data-driven insights and support to our project team. The successful candidate will work closely with stakeholders to identify business needs and develop data-driven solutions.Responsibilities:Evaluate business processes, identify areas for improvement, and...

  • Senior Staff Software Engineer

    1 month ago

    Varanasi, Uttar Pradesh, India Coinbase Full time

    About CoinbaseCoinbase is a leading financial technology company that enables individuals and institutions to buy, sell, and store digital assets. Our mission is to increase economic freedom around the world, and we're committed to building a trusted and secure platform for our users.Job DescriptionWe're seeking a highly skilled Senior Staff Software...

  • Innova ESI | Data Engineer | varanasi

    10 hours ago

    varanasi, India Innova ESI Full time

    Data Ingestion & Transformation:Design, build, and manage data pipelines to extract data from multiple sources (e.g., Dynamics, Verint, AWS) into Microsoft Fabric’s Bronze layer. Ensure data is properly ingested and transformed for downstream processing.· Data Modeling:Implement data models in the Silver and Gold layers to support business intelligence,...

  • Python Azure Full Stack Technical Lead

    5 days ago

    varanasi, India Tata Infotech Full time

    Greeting from TCS!!Role: Python Azure Full Stack Technical LeadRequired Technical Skill Set: Python, Django, Azure Data FactoryDesired Experience: 7 – 10 yearsLocation: Mumbai, Hyderabad, BangaloreMust-Have:Python Backend developmentExpertise in Python, REST API development (Flask), NoSQL DB,Experience in Django framework.Azure Cloud Engineer who can...

  • GEM Regional Director

    5 days ago

    varanasi, India Mars Full time

    At Mars Snacking, we see digital and data as an increasing multiplier of value across not just Mars Wrigley, but also the Health and Wellness and Retail global business units of Mars Snacking.The GEM Regional Director of Data & AI stewardship and delivery is part of the Chief Data Office (CDO) Organization within Mars Snacking, with dotted line reporting to...

  • University of the People | Director of Data Intelligence and Analytics | varanasi

    1 day ago

    varanasi, India University of the People Full time

    Vandey provides outsourced instructional services to institutions of higher education and is seeking a candidate to work for Vandey to serve in a full-time role as a Director of Data Intelligence and Analytics with the University of the People.INTRODUCTION:University of the People (UoPeople) is the first non-profit, tuition-free, American, accredited, 100%...