See more Collapse

Senior Data Engineer

2 months ago

Mumbai, India IDFC FIRST Bank Full time

Role/ Job Title:  Senior Data Engineer

Function/Department: Data & Analytics

Job Purpose:

The data engineer will be working with our data scientists who are building solutions using generative AI in the domain of text, audio and images and tabular data. They will be responsible for working with large volumes of structured and unstructured data in its storage, retrieval and augmentation with our GenAI solutions which use the said data. 

Primary Responsibilities:

Build data engineering pipeline focused on unstructured data pipelines. Conduct requirements gathering and project scoping sessions with subject matter experts, business users, and executive stakeholders to discover and define business data needs in GenAI. Design, build, and optimize the data architecture and extract, transform, and load (ETL) pipelines to make them accessible for Data Scientists and the products built by them. Work on end-to-end data lifecycle from Data Ingestion, Data Transformation and Data Consumption layer. Versed with API and its usability. Drive the highest standards in data reliability, data integrity, and data governance, enabling accurate, consistent, and trustworthy data sets. A suitable candidate will also demonstrate experience with big data infrastructure inclusive of MapReduce, Hive, HDFS, YARN, HBase, MongoDB, DynamoDB, etc. Creating Technical Design Documentation of the projects/pipelines Good skills in technical debugging of the code in case of issues. Also, working with git for code versioning 

Secondary Responsibilities:

Experience with machine learning and predictive analytics. Experience in the banking or financial services industry. Proficiency in data storytelling and presentation techniques. 

Managerial & Leadership Responsibilities:

Experience with machine learning and predictive analytics. Experience in the banking or financial services industry. Proficient in cloud services (using any one major cloud like AWS, GCP , Azure) 

Key Success Metrics:

Deliver & effectively track all the deliverables.

Education Qualification:

Graduation: Bachelor of Science ( / Bachelor of Technology ( / Bachelor of Computer Applications (BCA)

Post-Graduation: Master of Science ( /Master of Technology ( / Master of Computer Applications (MCA)

Experience: 5-10 years 

We have other current jobs related to this field that you can find below

  • Senior Data Engineer

    2 months ago

    Navi Mumbai, Maharashtra, India timesjobs Full time

    JOB DETAILSHighly proficient working with Scala/Java or PythonComfort working with large data sets and high-velocity data streamsHighly experience at data storage and processing (e.g. Kafka, Flink, Spark)Good relational and NoSQL database working knowledgeAn interest in healthcare and medical sectorsTechnical degree with 5 plus years backend data-heavy...

  • Senior Data Engineer

    2 months ago

    Navi Mumbai, India timesjobs Full time

    JOB DETAILSHighly proficient working with Scala/Java or PythonComfort working with large data sets and high-velocity data streamsHighly experience at data storage and processing (e.g. Kafka, Flink, Spark)Good relational and NoSQL database working knowledgeAn interest in healthcare and medical sectorsTechnical degree with 5 plus years backend data-heavy...

  • Senior Data Engineer

    3 weeks ago

    Navi Mumbai, Maharashtra, India timesjobs Full time

    JOB DETAILSHighly proficient working with Scala/Java or PythonComfort working with large data sets and high-velocity data streamsHighly experience at data storage and processing (e.g. Kafka, Flink, Spark)Good relational and NoSQL database working knowledgeAn interest in healthcare and medical sectorsTechnical degree with 5 plus years backend data-heavy...

  • Senior SQL Data Engineer

    2 months ago

    Mumbai, India CimpressVista Full time

    Job Title:Senior Data EngineerCompany:CimpressExperience:5+ yearsLocation:MumbaiJob Type:Full-timeJob Description:Cimpress is seeking a highly skilled and motivated Senior Data Engineer to join our dynamic team. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining scalable data pipelines to support our growing...

  • Senior Data Engineer

    5 days ago

    Mumbai, Maharashtra, India PEOPLEOCITY LLP Full time

    Job Summary:As a Senior Data Engineer, you will be in charge of developing effective technological solutions for handling large amounts of data. Additionally, you will oversee a team of experts in the field and other IT professionals, ensuring quality control of their work.Position:Senior Data Engineer (5 to 7 Years)Technical Skills:- Programming Languages:...

  • Data Engineer/Senior Data Engineer

    5 days ago

    Mumbai, Maharashtra, India consultant Full time

    Openings for the role of Data Engineer/Senior Data EngineerRequirements:Over 5 years of experience as a Data EngineerProficiency in Python, PySpark, and SQL databasesFamiliarity with Azure, Databricks, and Google Cloud Platform (GCP)Expertise in software development lifecycle and best practicesExperience with ETL processes, data pipelines, and data...

  • Senior Engineer

    1 day ago

    Mumbai, India NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...

  • Senior SQL Data Engineer

    3 weeks ago

    mumbai, India CimpressVista Full time

    Job Title: Senior Data Engineer Company: Cimpress Experience: 5+ years Location: Mumbai Job Type: Full-time Job Description: Cimpress is seeking a highly skilled and motivated Senior Data Engineer to join our dynamic team. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining scalable data pipelines to support...

  • Senior SQL Data Engineer

    2 months ago

    mumbai, India CimpressVista Full time

    Job Title: Senior Data Engineer Company: Cimpress Experience: 5+ years Location: Mumbai Job Type: Full-time Job Description: Cimpress is seeking a highly skilled and motivated Senior Data Engineer to join our dynamic team. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining scalable data pipelines to support...

  • Senior SQL Data Engineer

    5 days ago

    Mumbai, Maharashtra, India CimpressVista Full time

    Job Title: Senior Data Engineer Company: Cimpress Experience: 5+ years Location: Mumbai Job Type: Full-time Job Description: Cimpress is seeking a highly skilled and motivated Senior Data Engineer to join our dynamic team. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining scalable data pipelines to support...

  • Senior Data Engineer

    4 weeks ago

    mumbai, India PEOPLEOCITY LLP Full time

    JobSummary: Asa Senior Data Engineer you will be responsible for creatingeffective technological solutions for work with big data. They arealso responsible for managing a team of specialists in their fieldand related IT professions. In addition their roles include qualitycontrol of the workperformed.Position Senior Data Engineer 5to...

  • Senior Data Engineer

    4 weeks ago

    Mumbai, India PEOPLEOCITY LLP Full time

    JobSummary:Asa Senior Data Engineer you will be responsible for creatingeffective technological solutions for work with big data. They arealso responsible for managing a team of specialists in their fieldand related IT professions. In addition their roles include qualitycontrol of the workperformed.PositionSenior Data Engineer 5to...

  • Senior Data Engineering

    3 weeks ago

    mumbai, India Hirextra -World's First Staffing Aggregator Full time

    Role: Senior. Data EngineeringLocation : Mumbai / Bangalore / TrivandrumExperiences : 3 - 6 YearsJob Description:Requirements:➔ Have at least 3 years of experience in the Google Cloud Platform (especially Big Query )➔ Experience with Java, Python and Google Cloud SDK & API Scripting.➔ Experience with GCP Migration activities will be an added...

  • Senior Data Engineering

    5 days ago

    Mumbai, Maharashtra, India Hirextra -World's First Staffing Aggregator Full time

    Role: SeniorData Engineering Location :Mumbai / Bangalore / Trivandrum Experiences : - 6 Years Job Description: Requirements: ➔ Have at least 3 years of experience in the Google Cloud Platform (especially Big Query ) ➔ Experience with Java, Python and Google Cloud SDK & API Scripting. ➔ Experience with GCP Migration activities will be an added...

  • Senior Data Engineering

    4 weeks ago

    mumbai, India Hirextra -World's First Staffing Aggregator Full time

    Role: Senior. Data EngineeringLocation : Mumbai / Bangalore / TrivandrumExperiences : 3 - 6 YearsJob Description:Requirements:➔ Have at least 3 years of experience in the Google Cloud Platform (especially Big Query )➔ Experience with Java, Python and Google Cloud SDK & API Scripting.➔ Experience with GCP Migration activities will be an added...

  • Senior Engineer

    5 days ago

    Mumbai, Maharashtra, India NTT DATA Full time

    Job Description NTT is a leading global IT solutions and services organisation that brings together people, data and things to create a better and more sustainable future. In today's 'iNTTerconnected' world, connections matter more now than ever. By bringing together talented people, world-class technology partners and emerging innovators, we help our...

  • Senior Data Engineer

    2 months ago

    Mumbai, India GPI Full time

    OverviewWe are looking for a Senior data engineer to take on the responsibility of designing data pipelines and enabling Azure cloud services, perform hands-on development, and maintaining data pipelines and build/deploy Azure services.The Senior Data Engineer will oversee GPI's data integration work, including developing robust data models, developing data...

  • Senior Data Engineer

    7 days ago

    Mumbai, India Pure Billion Technologies Full time

    Job Description: As a Senior Data Engineer, you will play a crucial role in designing, developing, and maintaining our data infrastructure. You will be responsible for creating data pipelines, ensuring data quality, and optimizing data storage solutions. This role requires an expert in Python programming, with a focus on using Airflow for pipeline...

  • Senior Data Engineer

    6 days ago

    mumbai, India Pure Billion Technologies Full time

    Job Description: As a Senior Data Engineer, you will play a crucial role in designing, developing, and maintaining our data infrastructure. You will be responsible for creating data pipelines, ensuring data quality, and optimizing data storage solutions. This role requires an expert in Python programming, with a focus on using Airflow for pipeline...

  • Senior Data Engineer

    5 days ago

    Mumbai, Maharashtra, India Pure Billion Technologies Full time

    Job Description: As a Senior Data Engineer, you will play a crucial role in designing, developing, and maintaining our data infrastructure. You will be responsible for creating data pipelines, ensuring data quality, and optimizing data storage solutions. This role requires an expert in Python programming, with a focus on using Airflow for pipeline...