Data Engineering Lead

2 months ago

Varanasi, India ofi Full time

Data Engineering Lead

At ofi, we are on a mission to leverage data to drive innovation and business transformation. We are looking for a Data Engineering Lead to spearhead our data engineering team and contribute to our mission of delivering data-driven solutions. As a Data Engineering Lead, you will be responsible for managing the data engineering team and overseeing the design and implementation of our data infrastructure. You will work closely with data scientists, analysts, and other stakeholders to ensure the seamless flow and integrity of data across the organization.


Key Responsibilities:

Data Infrastructure Management:

  • Design and Build Data Architecture: Construct robust data pipelines in the Snowflake environment (hosted in MS Azure) to support scalable data ingestion, transformation, and delivery.
  • Data Collection and Integration: Develop systems to collect data from various sources (including SAP ERP, Salesforce, other IT systems as well as OT systems) using real-time or batch ingestion technologies, ensuring it is accurately integrated into the Snowflake platform.
  • Data Transformation: Implement processes to normalize, aggregate, and transform data into a format suitable for analysis and reporting.
  • Performance Optimization: Optimize data retrieval and query performance within Snowflake, ensuring efficient operation of data pipelines.
  • Collaboration with Stakeholders: Work closely with business leaders to understand company objectives and align data engineering strategies accordingly.
  • Governance and Security: Partner with legal and cyber security teams to maintain high standards of data governance and security, ensuring compliance with relevant regulations.
  • Innovation and Improvement: Stay abreast of the latest technology innovations in data engineering and apply them to improve existing systems and processes.
  • Team Leadership: Lead and mentor a team of data engineers, fostering a culture of technical excellence and continuous learning.


Data Quality Assurance:

  • Collaborate with subject matter experts to establish data quality rules, standards, and thresholds for the data domains.
  • Develop and implement data quality metrics /standards, processes, and tools to monitor and improve the quality and accuracy of data across systems and platforms.
  • Implement data validation and cleansing routines to identify and rectify data errors, duplicates, outliers, and missing values, leveraging data quality tools such as Informatica.
  • Conduct data profiling and analysis to identify data quality issues, inconsistencies, and anomalies and work with relevant teams to address them.
  • Implement data lineage and metadata management solutions to track the origin, transformations, and usage of data across the organization.


Requirements

  • Bachelor’s or master’s degree in Computer Science, Data Analytics, Data Science, Information Technology, etc.
  • Proven 6+ years of experience in data engineering, with 2+ years as the Data Engineering Lead.
  • Knowledge of SAP ERP (S4HANA and ECC) including its integration with Snowflake.
  • Functional understanding of customer experience, manufacturing, supply chain, and financial concepts
  • Proficiency in data pipeline tools and technologies, particularly within the Snowflake ecosystem.
  • Extensive experience with SQL databases and multiple programming languages.
  • Experience in working with data quality tools such as Informatica.

  • Data Engineer

    4 months ago

    Varanasi, India BayOne Solutions Full time

    Work from office- 3 days/WeekLocation: Bangalore/GurgaonJob Description: Min 5 years of experience in modern data engineering/data warehousing/data lakes technologies on cloud platforms like Azure, AWS, GCP, Data Bricks etc. Azure experience is preferred over other cloud platforms. 5 years of proven experience with SQL, schema design and dimensional data...

  • Lead Software Test automation Engineer

    2 months ago

    Varanasi, India Vertex Inc. Full time

    Job DescriptionAs a Lead Software Engineer on the Productivity Engineering team, you will be responsible for the development of DevOps and test automation including environment creation of products and services, end-to-end solutions test automation that exercises critical customer paths, as well as services and workflows to run within pipelines. What is the...

  • Product Development Lead

    2 weeks ago

    Varanasi, Uttar Pradesh, India Responsive Full time

    Product Manager - AI FocusAs a key member of our AI-focused team, you will lead product development, collaborating closely with our AI and NLP team to execute on strategic roadmap initiatives that drive customer success.Your ability to create champions from early adopters in the AI space will be crucial in shaping our culture. If you have a builder mentality...

  • Lead/Adv Lead Engineer- Production Technologies C&SC

    3 months ago

    Varanasi, India GE Full time

    Job Posting Title:- Lead Engineer - Production Technologies C&SCJob Description SummaryThe Lead Engineer is an individual contributor 'hardware owning' engineer reporting to an Engineering Manager within the Aerospace Engineering Division's Production Technologies team. As a hardware owner you will own all engineering functions related to the production of...

  • Data Scientist

    1 month ago

    varanasi, India Tata Consultancy Services Full time

    Dear Candidate, TCS is hiring for Data Scientist Experience: 4 to 6 yeard Location: PAN INDIA Required Technical Skill Set : Data Science, Python, Gen AI Desired Competencies: Real time industry experience working in Data Science ecosystem, Machine Learning development. Experience working on development of end-end AI application at an enterprise level, as...

  • Senior Data Scientist

    3 weeks ago

    Varanasi, India Sigmoid Full time

    About the Company: Sigmoid Analytics is a leading Data solutions company backed by Sequoia Capital. We offer best in- end-to-end data value chain spanning across Data Science, Data Engineering and Data Ops. With data and technology at the core of our solutions, we are solving some of the toughest problems out there. Our culture is modelled around expertise...

  • SR. Data Engineer

    2 weeks ago

    Varanasi, India Nielsen Full time

    Role : Software Engineer - Bigdata ( Scala or Python, Spark, SQL, AWS )Location Type: Hybrid (Mumbai/Bangalore/Gurgaon)At Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey.By joining our team of nearly 14,000 associates, you will become part of a community that will help you tosucceed. We champion you...

  • Senior Financial Data Specialist

    2 weeks ago

    Varanasi, Uttar Pradesh, India Fluidata Analytics Full time

    Job Title: Senior Financial Data SpecialistAbout Fluidata Analytics:We are a modern data and analytics consultancy firm providing end-to-end data engineering and analytics solutions to clients using cutting-edge data technology and methodologies.Job Summary:We are seeking a Senior Financial Data Specialist to join our team. The ideal candidate will have...

  • Lead Software Engineer

    1 month ago

    varanasi, India UST Full time

    We are looking for Appian developer with RPA exposure Location: Anywhere in India Notice period: Immediate to 30 days Please apply here Requirements: 4+ years as an Appian developer with RPA exposure. PBM/Rx Domain/Payer Industry Experience Expert-level understanding of Appian platform and architecture Excellence collaborating cross-functionally to...

  • InterSystems IRIS Engineer/Lead

    3 months ago

    Varanasi, India Ascendion Full time

    Key responsibilities include:Demonstrates strong programming expertise, with the ability to execute a wide range of programming activities with minimal supervision.Design and implement data integrations using InterSystems IRIS between HIE partners and internal On-prem/Cloud systems.Debug and fix defects in InterSystems IRIS related any inhouse solutions...

  • Project Lead

    2 weeks ago

    varanasi, India Savanna HR Full time

    Position SummaryThe Project Lead (PL) will lead the implementation of the project at the district level and be responsible for the focused implementation of the NIPUN program in the intervention schools to deliver significant gains in Student Learning Outcomes and Classroom Practices in the intervention 100+ school portfolio through a team of 6-10 Program...

  • Data Manager-BI

    1 month ago

    Varanasi, India Assembly Global Full time

    Data Manager, BI - Data ConsultancyExp: 4- 7 YrsNP: Immediate to 60 daysLocation: BangaloreWork Mode: HybridSkills: SQL, Visualization tool exp (Tableau, Power BI, Looker), Description We are Assembly – and we’re not like the rest. We’re the modern alternative agency, bringing together industry-leading data, talent, and tech to Find the Change That...

  • Data Specialist

    1 month ago

    varanasi, India Sambodhi Research and Communications Pvt. Ltd. Full time

    Company DescriptionSambodhi Research & Communications is a leading organization that creates high-impact knowledge to promote accountability in the public domain. We provide project management, monitoring & evaluation, and research solutions to various stakeholders including governments, aid agencies, and philanthropic foundations. With a focus on innovative...

  • Senior Staff Software Engineer

    2 weeks ago

    Varanasi, Uttar Pradesh, India Coinbase Full time

    About CoinbaseCoinbase is a leading financial technology company that enables individuals and institutions to buy, sell, and store digital assets. Our mission is to increase economic freedom around the world, and we're committed to building a trusted and secure platform for our users.Job DescriptionWe're seeking a highly skilled Senior Staff Software...

  • Salesforce Technical Lead

    4 weeks ago

    Varanasi, India CloudFulcrum Full time

    About CloudFulcrum:CloudFulcrum is an innovative Salesforce DevOps transformation company, dedicated to providing top-notch Salesforce solutions and services. We specialize in creating custom solutions and enhancing internal CRM applications to ensure the highest level of efficiency and client satisfaction.Job Overview:At CloudFulcrum, we are seeking a...

  • Packaging Engineer

    2 months ago

    varanasi, India Deluxe Full time

    Summary Package QC Engineer will be responsible for Packaging various assets with appropriate metadata to various portals as per client specifications and is expected to have a keen eye for detail. The Packaging QC Engineer role requires applicants to have a strong set of ethics, and the ability to work under rigid deadlines and occasional erratic schedules....

  • Lead - Product

    1 week ago

    Varanasi, India Bajaj Markets Full time

    DUTIES AND RESPONSIBILITIES: Lead in delivering the Multi-Partner ecosystem strategy of the company by being a key member of the Lending Partnerships teamManage & grow business P&L and constantly work towards increasing business profitability by working closely with the Business Head.Manage the Product Journey’s, Business P&L’s, Capability Enhancements...

  • Instrumentation and Control Engineer

    3 weeks ago

    Varanasi, India NOVARGI Full time

    NOVARGI Indian branch, an Indian established company belonging to the International Group NOVARGI, is currently seeking an I&C Engineer to join our Indian team based in PUNE.NOVARGI Group, as a highly specialized Process Package and Plant Contractor for the Energy Sector, we contribute to better tomorrow with our process and engineering solutions. The...

  • Azure DevOps Engineer

    1 week ago

    varanasi, India YALLO Retail | Strategy & Talent Unified Full time

    Location: RemoteJob type: 6 months contract (extendable)Job Summary:As an Azure DevOps Engineer, you will be responsible for designing, implementing, and managing CI/CD pipelines, as well as maintaining our Azure environments. A strong background in Azure Data Factory and Azure Databricks is essential to support our data engineering efforts and drive data...

  • Quality Assurance Engineer

    3 weeks ago

    Varanasi, India Sol-Millennium Medical Group Full time

    Purpose of the positionThe Quality Assurance Engineer (QA Engineer) provides hands-on support of the Company's Quality Management System, in particular the complaint and CAPA management in our overall efforts to improve on our quality management system, be a strong advocate for our customers to resolve quality issues and achieve pre-market approvals. The QA...