Senior Data Engineer

2 months ago

mumbai, India IDFC FIRST Bank Full time

Role/ Job Title:  Senior Data Engineer

Function/Department: Data & Analytics

Job Purpose:

The data engineer will be working with our data scientists who are building solutions using generative AI in the domain of text, audio and images and tabular data. They will be responsible for working with large volumes of structured and unstructured data in its storage, retrieval and augmentation with our GenAI solutions which use the said data. 

Primary Responsibilities:

Build data engineering pipeline focused on unstructured data pipelines. Conduct requirements gathering and project scoping sessions with subject matter experts, business users, and executive stakeholders to discover and define business data needs in GenAI. Design, build, and optimize the data architecture and extract, transform, and load (ETL) pipelines to make them accessible for Data Scientists and the products built by them. Work on end-to-end data lifecycle from Data Ingestion, Data Transformation and Data Consumption layer. Versed with API and its usability. Drive the highest standards in data reliability, data integrity, and data governance, enabling accurate, consistent, and trustworthy data sets. A suitable candidate will also demonstrate experience with big data infrastructure inclusive of MapReduce, Hive, HDFS, YARN, HBase, MongoDB, DynamoDB, etc. Creating Technical Design Documentation of the projects/pipelines Good skills in technical debugging of the code in case of issues. Also, working with git for code versioning 

Secondary Responsibilities:

Experience with machine learning and predictive analytics. Experience in the banking or financial services industry. Proficiency in data storytelling and presentation techniques. 

Managerial & Leadership Responsibilities:

Experience with machine learning and predictive analytics. Experience in the banking or financial services industry. Proficient in cloud services (using any one major cloud like AWS, GCP , Azure) 

Key Success Metrics:

Deliver & effectively track all the deliverables.

Education Qualification:

Graduation: Bachelor of Science ( / Bachelor of Technology ( / Bachelor of Computer Applications (BCA)

Post-Graduation: Master of Science ( /Master of Technology ( / Master of Computer Applications (MCA)

Experience: 5-10 years 

  • Senior Data Engineer

    3 weeks ago

    Navi Mumbai, India timesjobs Full time

    JOB DETAILSHighly proficient working with Scala/Java or PythonComfort working with large data sets and high-velocity data streamsHighly experience at data storage and processing (e.g. Kafka, Flink, Spark)Good relational and NoSQL database working knowledgeAn interest in healthcare and medical sectorsTechnical degree with 5 plus years backend data-heavy...

  • Senior Data Engineer

    3 weeks ago

    Navi Mumbai, Maharashtra, India timesjobs Full time

    JOB DETAILSHighly proficient working with Scala/Java or PythonComfort working with large data sets and high-velocity data streamsHighly experience at data storage and processing (e.g. Kafka, Flink, Spark)Good relational and NoSQL database working knowledgeAn interest in healthcare and medical sectorsTechnical degree with 5 plus years backend data-heavy...

  • Senior SQL Data Engineer

    1 month ago

    Mumbai, India CimpressVista Full time

    Job Title:Senior Data EngineerCompany:CimpressExperience:5+ yearsLocation:MumbaiJob Type:Full-timeJob Description:Cimpress is seeking a highly skilled and motivated Senior Data Engineer to join our dynamic team. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining scalable data pipelines to support our growing...

  • Senior SQL Data Engineer

    1 month ago

    mumbai, India CimpressVista Full time

    Job Title: Senior Data Engineer Company: Cimpress Experience: 5+ years Location: Mumbai Job Type: Full-time Job Description: Cimpress is seeking a highly skilled and motivated Senior Data Engineer to join our dynamic team. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining scalable data pipelines to support...

  • Senior Data Engineer

    5 days ago

    Mumbai, India PEOPLEOCITY LLP Full time

    JobSummary:Asa Senior Data Engineer you will be responsible for creatingeffective technological solutions for work with big data. They arealso responsible for managing a team of specialists in their fieldand related IT professions. In addition their roles include qualitycontrol of the workperformed.PositionSenior Data Engineer 5to...

  • Senior Data Engineer

    11 hours ago

    mumbai, India PEOPLEOCITY LLP Full time

    JobSummary: Asa Senior Data Engineer you will be responsible for creatingeffective technological solutions for work with big data. They arealso responsible for managing a team of specialists in their fieldand related IT professions. In addition their roles include qualitycontrol of the workperformed.Position Senior Data Engineer 5to...

  • Senior Data Engineering

    6 days ago

    mumbai, India Hirextra -World's First Staffing Aggregator Full time

    Role: Senior. Data EngineeringLocation : Mumbai / Bangalore / TrivandrumExperiences : 3 - 6 YearsJob Description:Requirements:➔ Have at least 3 years of experience in the Google Cloud Platform (especially Big Query )➔ Experience with Java, Python and Google Cloud SDK & API Scripting.➔ Experience with GCP Migration activities will be an added...

  • Senior Data Engineer

    1 month ago

    Mumbai, India GPI Full time

    OverviewWe are looking for a Senior data engineer to take on the responsibility of designing data pipelines and enabling Azure cloud services, perform hands-on development, and maintaining data pipelines and build/deploy Azure services.The Senior Data Engineer will oversee GPI's data integration work, including developing robust data models, developing data...

  • Senior SQL Data Engineer

    1 month ago

    Mumbai, India CimpressVista Full time

    .Job Title: Senior Data EngineerCompany: CimpressExperience: 5+ yearsLocation: MumbaiJob Type: Full-timeJob Description:Cimpress is seeking a highly skilled and motivated Senior Data Engineer to join our dynamic team. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining scalable data pipelines to support our growing...

  • Senior Data Engineer

    2 months ago

    Mumbai, India GPI Full time

    OverviewWe are looking for a Senior data engineer to take on the responsibility of designing data pipelines and enabling Azure cloud services, perform hands-on development, and maintaining data pipelines and build/deploy Azure services. The Senior Data Engineer will oversee GPI's data integration work, including developing robust data models, developing...

  • Senior Data Engineer

    2 months ago

    mumbai, India GPI Full time

    Overview We are looking for a Senior data engineer to take on the responsibility of designing data pipelines and enabling Azure cloud services, perform hands-on development, and maintaining data pipelines and build/deploy Azure services. The Senior Data Engineer will oversee GPI's data integration work, including developing robust data models, developing...

  • Senior Data Engineering

    6 days ago

    mumbai, India Hirextra -World's First Staffing Aggregator Full time

    Role: Senior. Data Engineering Location : Mumbai / Bangalore / Trivandrum Experiences : 3 - 6 Years Job Description: Requirements: ➔ Have at least 3 years of experience in the Google Cloud Platform (especially Big Query ) ➔ Experience with Java, Python and Google Cloud SDK & API Scripting. ➔ Experience with GCP Migration activities will be an added...

  • Senior Data Engineering

    6 days ago

    Mumbai, India Hirextra -World's First Staffing Aggregator Full time

    Role: Senior. Data EngineeringLocation : Mumbai / Bangalore / TrivandrumExperiences : 3 - 6 Years Job Description:Requirements: ➔ Have at least 3 years of experience in the Google Cloud Platform (especially Big Query )➔ Experience with Java, Python and Google Cloud SDK & API Scripting.➔ Experience with GCP Migration activities will be an added...

  • Senior Data Engineering

    6 days ago

    Mumbai, India Hirextra -World's First Staffing Aggregator Full time

    Role: Senior. Data EngineeringLocation : Mumbai / Bangalore / TrivandrumExperiences : 3 - 6 Years Job Description:Requirements: ➔ Have at least 3 years of experience in the Google Cloud Platform (especially Big Query )➔ Experience with Java, Python and Google Cloud SDK & API Scripting.➔ Experience with GCP Migration activities will be an added...

  • Senior Data Engineer

    2 weeks ago

    mumbai city (andheri), India Cornerstone OnDemand Full time

    We're looking for a Senior Data Engineer This role is Office Based Senior Data Engineer, Finance We are seeking a talented Senior Data Engineer offshore in India. Reporting to the Sr. Manager, IT Analytics, the individual will be pivotal in supporting the Finance & Services functions. The ideal candidate possesses strong domain...

  • Senior Associate Specialist

    3 days ago

    Mumbai, India NTT DATA Full time

    Job Description NTT is a leading global IT solutions and services organisation that brings together people, data and things to create a better and more sustainable future.In today’s ‘iNTTerconnected’ world, connections matter more now than ever. By bringing together talented people, world-class technology partners and emerging innovators, we help our...

  • Aptus Data Labs

    5 days ago

    mumbai, India Aptus Data Labs Full time

    Job Description Data Labs is a Bangalore based an innovative Data Engineering and Advanced Analytics company offering analytical solutions and consulting services Role : Azure Sr ConsultantExperience : 10 - 16 YearsLocation : Mumbai/Hyderabad/Bangalore (Onsite)Skill : Azure Cloud, Databricks, Data Quality, Data Governance & Modelling, ETL (Azure data...

  • Senior Full Stack Engineer

    1 day ago

    Mumbai, India Equity Data Science (EDS) Full time

    About the Role: We are looking for a Senior Developer to join our team and deliver a streamlined user experience. Proven experience as a Senior Developer having an edge on front end development. We want a team member who strives to develop a first-class codebase using best practices. You will be solving complex technical problems in the financial industry...

  • Senior Data Engineer

    4 weeks ago

    mumbai, India Ventura Full time

    Ventura is an omnichannel trading and investment platform with a network of branches, sub-brokers and Digital Channels. Founded in 1994, the company is entering the next phase of growth by pivoting to a digital-first approach and strengthening its direct-to-consumer franchise. The company has carved out a separate fintech vertical tasked with digital...

  • Senior Associate Specialist

    5 days ago

    mumbai, India NTT DATA Full time

    Job Description NTT is a leading global IT solutions and services organisation that brings together people, data and things to create a better and more sustainable future. In today’s ‘iNTTerconnected’ world, connections matter more now than ever. By bringing together talented people, world-class technology partners and emerging innovators, we help...