Senior Data Engineer

1 week ago

Mumbai, Maharashtra, India GPI Full time
Overview

We are looking for a Senior data engineer to take on the responsibility of designing data pipelines and enabling Azure cloud services, perform hands-on development, and maintaining data pipelines and build/deploy Azure services.
The Senior Data Engineer will oversee GPI's data integration work, including developing robust data models, developing data warehouse & data lakes, and writing code scripts for data integration and analysis. The candidate needs to ensure that automated streams of daily data updates and data management can be successfully implemented, alongside our designated Azure services enablement.
This role will work closely and collaboratively with members of our established Data teams, Product team, and Software Engineering teams to define requirements, mine and analyse data, integrate data from a variety of sources, and deploy high-quality data pipelines in support of the analytics needs of GPI.
We value people being engaged and caring about customers, caring about the code they write and the contribution they make to GPI. People with a broad ability to apply themselves to a multitude of problems and challenges, who can work across teams do great things here at GPI.
We're open-minded when it comes to hiring and we care more about culture fit and techie. If you care enough to find elegant solutions to difficult technical problems, we'd love to hear from you.

Responsibilities and Duties
  • Design, implement, test, deploy, and maintain stable, secure, and scalable data engineering solutions and pipelines in support of data and analytics projects, including integrating new sources of data into our central data warehouse/data lake, and moving data out to applications and affiliates.
  • Responsible in delivering the design and implementation of data lakes and data warehouses for our Azure architecture.
  • Responsible in designing and delivering data models required to migrate GPIs manual data collection (from different data teams) and overall data management to an online workflow on our new Azure architecture.
  • Responsible in ensuring all requirements are meticulously captured from different Data teams, and Software engineers during the process of designing the Azure stack, data models and overall architecture.
  • Responsible in maintaining and providing continuous support to the data teams, and other technical teams in ensuring the overall Azure architecture implementation is optimised for the needs of the business.
  • Responsible in developing and maintaining all ETL/ELT pipelines on our Azure platform for the different technical teams.
  • Able to begin this position as a single contributor and ensure that the overall architecture transformation is realised in the first year.
  • Build reports and data visualizations, using data from the data warehouse and other sources.
  • Be able to build, lead and manage a data engineering team in GPI.
Key Subject Matter / Technical Skills:
  • At least 6+ years of experience in designing Microsoft Azure architecture/services
    as well as Data Warehousing & Data Lakes modelling, and database systems.
  • Extensive experiences in Kubernetes and Containerisation technologies & development
  • Has previous experiences working on SaaS products as Sr Data Engineer/Data Engineer
  • Extensive experience in designing Azure Synapse Analytics solutions and providing strong integration with other Azure cloud architecture services.
  • Build and deliver data pipelines that ingests data (structured and unstructured) from multiple data sources into target data lake and data warehouse.
  • Experienced in integrating a wide variety of web-scraped data into Azure platform.
  • Extensive experience in Python development and scripting
  • Able to develop and optimise queries in SQL and NoSQL
  • Strong experience in the concepts of Extract, Transform, and Load (ETL) / (ELT)
  • Experience in creating large scale data pipelines using Azure Data Factory for data teams and enabling automation for daily data manipulation and data updates.
  • Strong experience with Azure: ADLS, Databricks, Stream Analytics, SQL DW, Cosmos DB, Cassandra, Azure Functions, Serverless Architecture, ARM Templates
  • Experience working with varied forms of data infrastructure inclusive of Hadoop, Spark, and column-oriented databases.
  • Have previously worked on real data challenges and handled huge volume, velocity, and variety of data.
  • Familiarity with APIs (REST, SOAP, and GraphQL)
  • Experience with CI/CD workflows (e.g., Azure DevOps) and Git best practices
  • Experienced in Microsoft Dot Net framework development.
  • Familiar with working with Agile projects
  • Excellent analytical & problem-solving skills, willingness to take ownership and resolve.
About us At GPI, our vision and goal is to support the biopharma industry and payers in achieving a sustainable balance between the pricing of medicines and patient access through the use of data-driven, evidenced-based strategies, analytics and technology innovation. Our progressive thinking and creative approach to market access is what sets us apart.
We are a dynamic, growing organisation with a diverse group of motivated employees, all working together in an environment that fosters creativity and innovation. Our company values drive the way we do business and helps us attract the best talent world-wide.
I'm proud of the team at GPI and the valuable work we deliver for our clients.
Preeti Patel
GPI Chief Executive Officer

  • Senior Data Engineer

    2 months ago

    Navi Mumbai, Maharashtra, India timesjobs Full time

    JOB DETAILSHighly proficient working with Scala/Java or PythonComfort working with large data sets and high-velocity data streamsHighly experience at data storage and processing (e.g. Kafka, Flink, Spark)Good relational and NoSQL database working knowledgeAn interest in healthcare and medical sectorsTechnical degree with 5 plus years backend data-heavy...

  • Senior Data Engineer

    3 weeks ago

    Navi Mumbai, Maharashtra, India timesjobs Full time

    JOB DETAILSHighly proficient working with Scala/Java or PythonComfort working with large data sets and high-velocity data streamsHighly experience at data storage and processing (e.g. Kafka, Flink, Spark)Good relational and NoSQL database working knowledgeAn interest in healthcare and medical sectorsTechnical degree with 5 plus years backend data-heavy...

  • Senior Data Engineer

    1 week ago

    Mumbai, Maharashtra, India PEOPLEOCITY LLP Full time

    Job Summary:As a Senior Data Engineer, you will be in charge of developing effective technological solutions for handling large amounts of data. Additionally, you will oversee a team of experts in the field and other IT professionals, ensuring quality control of their work.Position:Senior Data Engineer (5 to 7 Years)Technical Skills:- Programming Languages:...

  • Data Engineer/Senior Data Engineer

    1 week ago

    Mumbai, Maharashtra, India consultant Full time

    Openings for the role of Data Engineer/Senior Data EngineerRequirements:Over 5 years of experience as a Data EngineerProficiency in Python, PySpark, and SQL databasesFamiliarity with Azure, Databricks, and Google Cloud Platform (GCP)Expertise in software development lifecycle and best practicesExperience with ETL processes, data pipelines, and data...

  • Senior SQL Data Engineer

    1 week ago

    Mumbai, Maharashtra, India CimpressVista Full time

    Job Title: Senior Data Engineer Company: Cimpress Experience: 5+ years Location: Mumbai Job Type: Full-time Job Description: Cimpress is seeking a highly skilled and motivated Senior Data Engineer to join our dynamic team. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining scalable data pipelines to support...

  • Senior Data Engineering

    1 week ago

    Mumbai, Maharashtra, India Hirextra -World's First Staffing Aggregator Full time

    Role: SeniorData Engineering Location :Mumbai / Bangalore / Trivandrum Experiences : - 6 Years Job Description: Requirements: ➔ Have at least 3 years of experience in the Google Cloud Platform (especially Big Query ) ➔ Experience with Java, Python and Google Cloud SDK & API Scripting. ➔ Experience with GCP Migration activities will be an added...

  • Senior Engineer

    1 week ago

    Mumbai, Maharashtra, India NTT DATA Full time

    Job Description NTT is a leading global IT solutions and services organisation that brings together people, data and things to create a better and more sustainable future. In today's 'iNTTerconnected' world, connections matter more now than ever. By bringing together talented people, world-class technology partners and emerging innovators, we help our...

  • Senior Data Engineer

    1 week ago

    Mumbai, Maharashtra, India Pure Billion Technologies Full time

    Job Description: As a Senior Data Engineer, you will play a crucial role in designing, developing, and maintaining our data infrastructure. You will be responsible for creating data pipelines, ensuring data quality, and optimizing data storage solutions. This role requires an expert in Python programming, with a focus on using Airflow for pipeline...

  • Senior Data Engineer

    1 week ago

    Mumbai, Maharashtra, India GPI Full time

    OverviewWe are looking for a Senior data engineer to take on the responsibility of designing data pipelines and enabling Azure cloud services, perform hands-on development, and maintaining data pipelines and build/deploy Azure services.The Senior Data Engineer will oversee GPI's data integration work, including developing robust data models, developing data...

  • Senior Data Engineer

    1 week ago

    Mumbai, Maharashtra, India IT Resource Hunter Full time

    We are seeking an experienced Senior Data Engineer to join our team and build robust end-to-end data integration solutions within an Azure cloud environment. The ideal candidate will have a strong background in data engineering, business intelligence, and a variety of digital technology projectsKey Responsibilities:Build end-to-end data integration solutions...

  • Senior Data Engineer

    1 week ago

    Mumbai, Maharashtra, India The Nielsen Company Full time

    At Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help you to succeed. We champion you because when you succeed, we do too. Embark on a new initiative, explore a fresh approach, and take license to think big,...

  • Senior Data Engineer

    1 week ago

    Mumbai, Maharashtra, India Nielsen Full time

    At Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help you to succeed. We champion you because when you succeed, we do too. Embark on a new initiative, explore a fresh approach, and take license to think big,...

  • Senior Full Stack engineer

    1 week ago

    Mumbai, Maharashtra, India Equity Data Science (EDS) Full time

    About the Role:We are looking for a Senior Developer to join our team and deliver a streamlined user experience. Proven experience as a Senior Developer having an edge on front end development. We want a team member who strives to develop a first-class codebase using best practices. You will be solving complex technical problems in the financial industry and...

  • Senior Data Engineer

    1 week ago

    Mumbai, Maharashtra, India Cyber Sphere LLC Full time

    Senior Data EngineerOnsite : Mumbai/ChennaiAbout the Role : This role is more focused on Pyspark with Cloud developer.About the Responsibilities : This position provides direct input to project plans, schedules, and follows software methodologies and best practices in the development of crossfunctional software products under a microservices styled...

  • Senior Manager

    1 week ago

    Mumbai, Maharashtra, India NTT DATA Full time

    Job DescriptionNTT is a leading global IT solutions and services organisation that brings together people, data and things to create a better and more sustainable future.In today's 'iNTTerconnected' world, connections matter more now than ever. By bringing together talented people, world-class technology partners and emerging innovators, we help our clients...

  • Senior Data Engineer

    2 months ago

    Mumbai, Maharashtra, India Cornerstone OnDemand Full time

    We are seeking a Senior DataEngineer with expertise in Looker and Google Cloud Platform (GCP) to join ourinnovative team. With at least 10 years of overall experience in dataengineering, including a minimum of 5 years working with Looker and GCP, theideal candidate will lead the design, development, and maintenance of LookMLmodels and dashboards. This role...

  • Senior Data Engineer

    3 weeks ago

    Mumbai, Maharashtra, India Cornerstone OnDemand Full time

    We are seeking a Senior DataEngineer with expertise in Looker and Google Cloud Platform (GCP) to join ourinnovative team. With at least 10 years of overall experience in dataengineering, including a minimum of 5 years working with Looker and GCP, theideal candidate will lead the design, development, and maintenance of LookMLmodels and dashboards. This role...

  • Senior Data Engineer/Architect

    1 week ago

    Mumbai, Maharashtra, India Unitrestech Solutions Pvt Ltd Full time

    We are in search of a highly skilled Senior Data Engineer/Architect with a minimum of 10 years of solid experience in data engineering, especially within the financial sector.The perfect candidate will possess extensive expertise in working with Google Cloud Platform (GCP) technologies, specifically BigQuery, and demonstrate a successful history of leading...

  • Senior Manager

    1 week ago

    Mumbai, Maharashtra, India NTT DATA Full time

    Job Description NTT is a leading global IT solutions and services organisation that brings together people, data and things to create a better and more sustainable future. In today's 'iNTTerconnected' world, connections matter more now than ever. By bringing together talented people, world-class technology partners and emerging innovators, we help our...

  • Senior Azure Data Engineer

    1 week ago

    Mumbai, Maharashtra, India Firstcareercentre Full time

    Job Brief SummarySenior Azure Data EngineeringTotal Experience :5 Years If candidate is good can take 4+ yrs as wellLocation : Mumbai Must have 4 Years of Experience on Python Must have 4 yrs relevant experience on Apache Spark OR PySpark Must have 5 yrs of experience in SQL (Must be proficient in writing Advanced complex queries ) Good to have Airflow...