Data Engineer

3 weeks ago


Mumbai, India Puma Energy Full time
Main Purpose:

Collaborate with data scientists and business stakeholders to design, develop, and maintain efficient data pipelines feeding into the organization's data lake.Ensure the data lake contains accurate, up-to-date, and high-quality data, enabling data scientists to develop insightful analytics and business stakeholders to make well-informed decisions.Utilize expertise in data engineering and cloud technologies to contribute to the overall success of the organization by providing the necessary data infrastructure and fostering a data-driven culture.Demonstrate a strong architectural sense in defining data models, leveraging the Poly-base concept to optimize data storage and access.Facilitate seamless data integration and management across the organization, ensuring a robust and scalable data architecture.Take responsibility for defining and designing the data catalogue, effectively modelling all data within the organization, to enable efficient data discovery, access, and management for various stakeholdersKnowledge Skills and Abilities, Key Responsibilities:

KEY RESPONSIBILITIESDesign, develop, optimize, and maintain data architecture and pipelines that adhere to ETL principles and business goals.Develop complex queries and solutions using Scala, .NET, Python/PySpark languages.Implement and maintain data solutions on Azure Data Factory, Azure Data Lake, and DatabricksCreate data products for analytics and data scientist team members to improve their productivity.Advise, consult, mentor, and coach other data and analytic professionals on data standards and practices.Foster a culture of sharing, re-use, design for scale stability, and operational efficiency of data and analytical solutions.Lead the evaluation, implementation, and deployment of emerging tools and processes for analytic data engineering in order to improve our productivity as a team.Develop and deliver communication and education plans on analytic data engineering capabilities, standards, and processes.Partner with business analysts and solutions architects to develop technical architectures for strategic enterprise projects and initiatives.Collaborate with other team members and effectively influence, direct, and monitor project work.Develop strong understanding of the business and support decision making.REQUIREMENTSExperience:10 years of overall experience & at least 5 years of relevant experience5 years of experience working with Azure data factory & data bricksSkills

:Bachelor's degree required; Computer Science Engineering.5+ years of experience working in data engineering or architecture role.Expertise in SQL and data analysis and experience with at least one programming language (Scala and .NET preferred).Experience developing and maintaining data warehouses in big data solutions.Experience with, Azure Data Lake, Azure Data Factory, and Databricks) in the data and analytics space is a mustDatabase development experience using Hadoop or Big Query and experience with a variety of relational, NoSQL, and cloud data lake technologies.Worked with BI tools such as Tableau, Power BI, Looker, Shiny.Conceptual knowledge of data and analytics, such as dimensional modelling, ETL, reporting tools, data governance, data warehousing, and structured and unstructured data.Big Data Development experience using Hive, Impala, Spark, and familiarity with Kafka.Exposure to machine learning, data science, computer vision, artificial intelligence, statistics, and/or applied mathematics.Languages:Fluency in verbal and written English mandatory.Fluency is Spanish & French is useful.

Key Relationships and Department Overview:

KEY RELATIONSHIPSInternal:

CEO & COO of Africa, managers across various departments, Senior Management, Head of Departments in other regional hubs of Puma EnergyExternal:

External Consultants
  • Data Engineer

    2 days ago


    mumbai, India SparkNet Innovations Full time

    Company DescriptionSparkNet is a trusted partner for businesses seeking to unlock the potential of data science and AI. They specialize in delivering end-to-end solutions that drive innovation, optimize operations, and fuel growth across diverse industries. With expertise in data engineering, AI consulting, and advanced data science, SparkNet transforms...

  • Data Engineer

    6 days ago


    Mumbai, India Newfold Digital Full time

    Data EngineerJOB DESCRIPTIONNewfold Digital is looking for a seasoned Data Engineer. This role will participate in all aspects of the development lifecycle, from scoping and requirements to solutioning, implementation and support. The ideal candidate would have extensive experience developing and supporting a DW service comprised of multiple Data Warehouses...

  • Data Engineer

    3 days ago


    Mumbai, India SparkNet Innovations Full time

    Company Description SparkNet is a trusted partner for businesses seeking to unlock the potential of data science and AI. They specialize in delivering end-to-end solutions that drive innovation, optimize operations, and fuel growth across diverse industries. With expertise in data engineering, AI consulting, and advanced data science, SparkNet transforms...

  • Data Engineer

    3 days ago


    Mumbai, India SparkNet Innovations Full time

    Company Description SparkNet is a trusted partner for businesses seeking to unlock the potential of data science and AI. They specialize in delivering end-to-end solutions that drive innovation, optimize operations, and fuel growth across diverse industries. With expertise in data engineering, AI consulting, and advanced data science, SparkNet transforms...

  • Data Engineer

    2 days ago


    mumbai, India SparkNet Innovations Full time

    Company Description SparkNet is a trusted partner for businesses seeking to unlock the potential of data science and AI. They specialize in delivering end-to-end solutions that drive innovation, optimize operations, and fuel growth across diverse industries. With expertise in data engineering, AI consulting, and advanced data science, SparkNet transforms...

  • Data Engineer

    3 weeks ago


    Mumbai, India Antal International Full time

    Job DescriptionData Engineer Job Responsibilities:· Develops and maintains scalable data pipelines and builds out new API integrations to support continuing increases in data volume and complexity.· Collaborates with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility and fostering...

  • Data Engineer

    3 weeks ago


    Mumbai, India Searce Technologies Inc Full time

    about the roleData Engineer identifies the business problem and translates these to data services and engineering outcomes. You will deliver data solutions that empower better decision making and flexibility of your solution that scales to respond to broader business questions.key responsibilitiesAs a Data Engineer, you are a full-stack data engineer that...

  • Data Engineer

    1 month ago


    mumbai, India Antal International Full time

    Job Description Data Engineer Job Responsibilities: · Develops and maintains scalable data pipelines and builds out new API integrations to support continuing increases in data volume and complexity. · Collaborates with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility and...

  • Data Engineer

    1 month ago


    Mumbai, India Searce Technologies Inc Full time

    about the role Data Engineer identifies the business problem and translates these to data services and engineering outcomes. You will deliver data solutions that empower better decision making and flexibility of your solution that scales to respond to broader business questions. key responsibilities As a Data Engineer, you are a full-stack...

  • Data Engineer

    1 week ago


    mumbai, India Newfold Digital Full time

    Data Engineer JOB DESCRIPTION Newfold Digital is looking for a seasoned Data Engineer. This role will participate in all aspects of the development lifecycle, from scoping and requirements to solutioning, implementation and support. The ideal candidate would have extensive experience developing and supporting a DW service comprised of multiple Data...

  • Data Engineer

    1 week ago


    Mumbai, India Newfold Digital Full time

    Data Engineer JOB DESCRIPTION Newfold Digital is looking for a seasoned Data Engineer. This role will participate in all aspects of the development lifecycle, from scoping and requirements to solutioning, implementation and support. The ideal candidate would have extensive experience developing and supporting a DW service comprised of multiple Data...

  • Data Engineer

    1 month ago


    mumbai, India Searce Technologies Inc Full time

    about the role Data Engineer identifies the business problem and translates these to data services and engineering outcomes. You will deliver data solutions that empower better decision making and flexibility of your solution that scales to respond to broader business questions. key responsibilities As a Data Engineer, you are a...

  • Data Engineer

    4 weeks ago


    mumbai, India Anicalls (Pty) Ltd Full time

    Candidate should have: Clear, concise communication abilities - writing, verbal, presentation - to all levels of technical and non-technical audiences with the ability to collaborate Strong experience in CICD technologies including Python, SQL, Airflow, and Git in a cloud setting Understanding of ELK stack is a plus for logging and reporting purposes...

  • Data Engineer

    1 month ago


    Mumbai, India Puma Energy Full time

    Main Purpose: Collaborate with data scientists and business stakeholders to design, develop, and maintain efficient data pipelines feeding into the organization's data lake. Ensure the data lake contains accurate, up-to-date, and high-quality data, enabling data scientists to develop insightful analytics and business stakeholders to make well-informed...

  • Data Engineer

    4 weeks ago


    mumbai, India Puma Energy Full time

    Main Purpose: Collaborate with data scientists and business stakeholders to design, develop, and maintain efficient data pipelines feeding into the organization's data lake.Ensure the data lake contains accurate, up-to-date, and high-quality data, enabling data scientists to develop insightful analytics and business stakeholders to make...

  • Data Engineer

    2 weeks ago


    mumbai, India Virtusa Full time

    Data Engineer - CREQ187220 Description 6-8 years of relevant work experience showing growth as a Data Engineer.Hands On programming experienceImplementation Experience on Kafka, Kinesis, Spark, AWS Glue, AWS LakeFormation.Experience of performance optimization in Batch and Real time processing applicationsExpertise in Data Governance and Data Security...

  • Data Engineer

    2 weeks ago


    Mumbai, India Virtusa Full time

    Data Engineer - CREQ187220 Description 6-8 years of relevant work experience showing growth as a Data Engineer. Hands On programming experience Implementation Experience on Kafka, Kinesis, Spark, AWS Glue, AWS LakeFormation. Experience of performance optimization in Batch and Real time processing applications Expertise in Data Governance and Data Security...

  • Data Engineer

    2 weeks ago


    navi mumbai, India Manufacturing MNC Full time

    Location-Navi Mumbai- PreferredBangaloreRequirement-Looking for Data Engineer with SAP experience3-5 years of ExperienceBachelors or master's in technology or engineeringStrong knowledge on Data Engineering aspectsImplementing methods to improve data reliability and quality.Combining raw information from different sources to create consistent and...

  • Data Engineer

    3 weeks ago


    Mumbai, India The Nielsen Company Full time

    At Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help you to succeed. We champion you because when you succeed, we do too. Embark on a new initiative, explore a fresh approach, and take license to think big,...

  • Data Engineer

    4 weeks ago


    Navi Mumbai, India Manufacturing MNC Full time

    Location-Navi Mumbai- PreferredBangaloreRequirement-Looking for Data Engineer withSAPexperience3-5 years of ExperienceBachelors or master's in technology or engineeringStrong knowledge on Data Engineering aspectsImplementing methods to improve data reliability and quality.Combining raw information from different sources to create consistent and...