Data Engineering Lead

7 days ago

Mumbai, Maharashtra, India IDfy Full time
About IDfy

IDfy is a cutting-edge Integrated Identity Platform that offers a comprehensive suite of products and solutions for KYC, KYB, Background Verifications, Risk Assessment, and Digital Onboarding. Our mission is to establish trust while delivering a seamless experience for our clients, their employees, customers, and partners.

With over 12+ years of experience and 2 million verifications per day, we are pioneers in the industry. Our clients include HDFC Bank, Induslnd Bank, Zomato, Amazon, PhonePe, Paytm, HUL, and many others.

We have successfully raised $27M from Elev8 Venture Partners, KB Investments & Tenacity Ventures.

Module Lead - Data Fabric

As a Module Lead in the Data Fabric pod, you will play a crucial role in driving the development of innovative data solutions at IDfy. You will work on the Data Fabric platform, which provides Data as a Service (DaaS) and Insight as a Service (IaaS) for people at IDfy and our customers.

You will oversee the design, development, and implementation of software components that power our data platform. Your leadership and technical expertise will be instrumental in ensuring that our data solutions meet the highest quality, efficiency, and scalability standards.

The Data Fabric platform is the backbone for our Insights, Analytics & Invoicing needs at IDfy, serving a whopping 150TB reads/month, and close to 700M rows are ingested via the platform.

If you are a Data Engineering expert with a deep understanding of data engineering technologies and experience leading a team, we encourage you to apply for this exciting opportunity at IDfy.

Experience: 6 - 8 Years.

We work fully onsite on all days of the week from our office in Andheri East, Mumbai.

Kindly apply and share your resume if this opportunity suits you.

Responsibilities
  1. Design and implement data ingestion pipelines based on the ELT (Extract, Load & Transform) model, at scale.
  2. Own defining Data Models, Transformation Logic & Data Flow in your current role.
  3. Have hands-on experience with Logstash, Apache BEAM & Dataflow, Apache Airflow, ClickHouse, Grafana, InfluxDB/VictoriaMetrics, BigQuery.
  4. Understand Product Development Methodologies; we follow Agile methodology.
  5. Have a strong understanding with hands-on experience of data warehouses; a minimum of 4 years of experience in any data warehousing stack is a must.
  6. Have a knack for understanding data & can derive insights from it.
  7. Have experience with any TimeSeries DB (we use InfluxDB & VictoriaMetrics) and Alerting / Anomaly Detection Frameworks.
  8. Have experience with Visualization Tools: Metabase/ PowerBI/Tableau.
  9. Have experience in developing software in the Cloud such as GCP / AWS.
  10. Have a passion for exploring new technologies and express yourself through technical blogs.
What Your Day Will Look Like...
  1. Architecting & implementing Data Pipelines & Frameworks to provide a better developer experience for our dev teams.
  2. Helping other PODs in IDfy define their data landscape and onboarding them onto our platform.
  3. Manage the platform and its scale. Optimize the infrastructure for cost as we scale.
  4. Provide guidance and support to your team members, helping them to develop their skills and grow professionally.
  5. Track project progress, identify risks, and develop contingency plans to ensure that projects pass the IDfy quality gates and are delivered on time and within budget.
  6. Keep abreast of the latest trends and technologies in Data Engineering, GenAI, and Data Science.
What's it like working at IDfy?

We build products that detect and prevent fraud. At IDfy, you will apply your skills to stay one step ahead of fraudsters. You will be mind-mapping fraudsters' modus operandi, predicting the evolution of fraud techniques, and designing solutions to prevent new & emerging fraud.

At IDfy, you will work on the entire end-to-end solution rather than a small cog of a giant wheel.

Thanks to our problem-centric approach, one in which we find the right technology to solve a problem rather than the other way around, you will always be working on the latest technologies.

We work hard and party hard. There are weekly sessions on emerging technologies. Work weeks are usually capped off with board games, poker, karaoke, and other fun activities.

  • Lead Project Engineer

    1 week ago

    Mumbai, Maharashtra, India NTT DATA Full time

    Job Title: Lead Project EngineerJob Summary:NTT DATA is seeking a highly skilled Lead Project Engineer to join our team. As a Lead Project Engineer, you will be responsible for managing network refreshes, greenfield deployments, and transitioning customers to our global network environment.Key Responsibilities:Manage network refreshes, including routers,...

  • Lead Project Engineer

    6 days ago

    Mumbai, Maharashtra, India NTT DATA Full time

    Job Title: Lead Project EngineerAbout the Role:We are seeking a highly skilled and experienced Lead Project Engineer to join our team at NTT DATA. As a Lead Project Engineer, you will be responsible for managing complex network infrastructure projects, ensuring timely delivery, and exceeding customer expectations.Key Responsibilities:Manage network...

  • Lead Network Engineer

    1 week ago

    Mumbai, Maharashtra, India NTT DATA Full time

    About the RoleWe are seeking a highly skilled and experienced Lead Network Engineer to join our team at NTT DATA. As a key member of our network operations team, you will be responsible for designing, implementing, and managing complex network infrastructure to support our global clients.Key ResponsibilitiesDesign and implement network architecture to meet...

  • Data Engineering Lead

    1 week ago

    Mumbai, Maharashtra, India Saaki Argus & Averil Consulting Full time

    About the RoleWe are seeking a highly skilled Sr Data Engineer to lead the design, build, and evolution of our in-house data platforms. As a key member of our team, you will be responsible for leading the construction of datasets requested by various stakeholders, building and maintaining data pipelines, and collaborating with our data analysts, data...

  • Data Engineering Lead

    2 days ago

    Mumbai, Maharashtra, India Saaki Argus & Averil Consulting Full time

    A Senior Data Engineer at Saaki Argus & Averil Consulting leads the design, build, and evolution of our in-house data platforms. They oversee the construction of datasets requested by various stakeholders, building and maintaining resulting data pipelines. Collaboration with data analysts, data scientists, and business application development teams is key in...

  • Lead Data Engineer

    1 week ago

    Mumbai, Maharashtra, India CPP Investments Full time

    Job Title: Lead, Data EngineerAt CPP Investments, we are seeking a highly skilled Lead, Data Engineer to join our team. As a key member of our Data Engineering team, you will be responsible for designing and implementing large-scale data processing systems using Amazon Web Services (AWS) cloud technology.Key Responsibilities:Design and develop data pipelines...

  • Data Engineering Lead

    7 days ago

    Mumbai, Maharashtra, India Straive Full time

    Senior Data EngineerAt Straive, we're seeking a highly skilled Senior Data Engineer to lead the design, build, and evolution of our in-house data platforms. As a key member of our team, you'll be responsible for constructing datasets requested by various stakeholders, building and maintaining data pipelines, and collaborating closely with data analysts, data...

  • Data Engineer Lead

    7 days ago

    Mumbai, Maharashtra, India Ingredion Incorporated (Corporate) Full time

    Job Summary:Ingredion Incorporated (Corporate) is seeking a highly skilled Data Engineer Lead to join our team. As a key member of our Digital Technology Solutions organization, you will play a crucial role in designing, developing, and maintaining the infrastructure and systems required for data storage, processing, and analysis.Key Responsibilities:Design...

  • Data Engineer Lead

    1 week ago

    Mumbai, Maharashtra, India Ingredion Incorporated (Corporate) Full time

    Job Summary:We are seeking a highly skilled Data Engineer Lead to join our Digital Technology Solutions organization at Ingredion Incorporated (Corporate). As a key member of our team, you will be responsible for designing, developing, and maintaining the infrastructure and systems required for data storage, processing, and analysis.Key...

  • Data Engineering Lead

    1 week ago

    Mumbai, Maharashtra, India IDfy Full time

    About IDfyIDfy is a cutting-edge Integrated Identity Platform that offers a comprehensive suite of products and solutions for KYC, KYB, Background Verifications, Risk Assessment, and Digital Onboarding. Our mission is to establish trust while delivering a seamless experience for our clients, their employees, customers, and partners.With over 12+ years of...

  • Data Engineering Lead

    6 days ago

    Mumbai, Maharashtra, India IDfy Full time

    About IDfyIDfy is a cutting-edge Integrated Identity Platform that offers a wide range of products and solutions for KYC, KYB, Background Verifications, Risk Assessment, and Digital Onboarding. Our mission is to establish trust while delivering a seamless experience for our clients, their employees, customers, and partners.We pride ourselves on combining...

  • Cloud Data Engineering Lead

    3 days ago

    Mumbai, Maharashtra, India SumCircle Technologies Limited Full time

    Data Engineering Lead - Cloud MigrationAbout the RoleWe are seeking a highly skilled Data Engineer to lead our cloud migration project. The ideal candidate will have a strong background in creating robust data ingestion pipelines and a deep understanding of ETL processes, particularly within the Google Cloud Platform ecosystem.Key ResponsibilitiesDevelop and...

  • Data Engineering and Analytics Lead

    2 days ago

    Mumbai, Maharashtra, India Collinson Full time

    Key ResponsibilitiesWe are seeking a highly skilled Data Engineering and Analytics Lead to join our team at Collinson. As a key member of our data team, you will be responsible for designing, developing, and maintaining low-code enabled data pipelines for collecting, transforming, and loading data into various data stores and building insightful reports.Key...

  • Data Engineer

    2 days ago

    Mumbai, Maharashtra, India Collinson Full time

    Job SummaryWe are seeking a highly skilled Data Engineer to lead our cloud data platform transformation. As a key member of our Data Engineering team, you will be responsible for designing, developing, and maintaining large-scale data pipelines on AWS.Key ResponsibilitiesDesign and implement data pipelines for collecting, transforming, and loading data into...

  • Data Engineering Lead

    2 days ago

    Mumbai, Maharashtra, India CPP Investments Full time

    CPP Investments is a global investment organization that seeks a talented Data Engineering Lead to join its team. As a key member of the Data Engineering team, you will be responsible for designing and implementing large-scale data processing systems using Amazon Web Services (AWS) to support the organization's business requirements.Key...

  • Lead Data Engineer

    6 days ago

    Mumbai, Maharashtra, India CPP Investments Full time

    Make a Lasting Impact at CPP InvestmentsCPP Investments is a global investment organization that seeks talented individuals to join its team. As a Lead, Data Engineer, you will play a crucial role in shaping the organization's data strategy and building robust data systems.Key ResponsibilitiesDesign and develop large-scale data processing systems using...

  • AWS Data Engineering Lead

    3 days ago

    Mumbai, Maharashtra, India SumCircle Technologies Limited Full time

    AWS Data Engineering LeadWe are seeking a highly skilled and motivated AWS Data Engineer to join our dynamic data engineering team at SumCircle Technologies Limited.The ideal candidate will have over 5+ years of experience in AWS Data Engineering and a strong proficiency in Python programming language.Key Responsibilities: Design, develop, and maintain...

  • Data Center Operations Engineer

    6 days ago

    Mumbai, Maharashtra, India Amazon Data Services India Private Limited Full time

    About the RoleAmazon Data Services India Private Limited is seeking a highly skilled Data Center Engineering Operations Engineer to join our team in India. As a key member of our Data Center management team, you will be responsible for ensuring the smooth operation of our data centers, providing technical expertise, and collaborating with cross-functional...

  • Network Operations Shift Lead

    1 week ago

    Mumbai, Maharashtra, India NTT DATA Full time

    Job Title: Network Operations Shift LeadJob Summary:NTT DATA is seeking a highly skilled Network Operations Shift Lead to join our team. As a Shift Lead, you will be responsible for leading a team of experts who handle network/security support, problem management, and network performance management. You will also be responsible for managing on-going incident...

  • Data Engineering Lead

    1 week ago

    Mumbai, Maharashtra, India IDfy Full time

    About IDfyIDfy is a cutting-edge Integrated Identity Platform that offers a wide range of products and solutions for KYC, KYB, Background Verifications, Risk Assessment, and Digital Onboarding. Our mission is to establish trust while delivering a seamless experience for our clients, their employees, customers, and partners.With over 12+ years of experience...