Data Engineer M2C

4 weeks ago

Pune, Maharashtra, India Worldline Full time

About the Opportunity

At Worldline, we're shaping the future of payments technology. Our innovative solutions address the persistent challenges of the payment world, enabling sustainable economic growth and reinforcing trust and security in our societies.

Day-to-Day Responsibilities

We're seeking a highly skilled Data Engineer to join our Data Management team on a transformative Move to Cloud (M2C) project. The ideal candidate will have a strong background in creating robust data ingestion pipelines and a deep understanding of ETL processes, particularly within the Google Cloud Platform ecosystem and using tools such as dbt Labs over BigQuery.

  • Develop and maintain scalable and reliable data pipelines using PySpark and SQL to support the migration from Oracle's on-premises data warehouse (structured data source) and unstructured data sources to BigQuery.
  • Design and implement bulletproof data ingestion and integration processes that ensure data quality and consistency.
  • Use the dbt tool to create and manage ETL processes that transform and load data efficiently from/into BigQuery.
  • Ensure the resilience and efficiency of data transformation jobs that can handle large volumes of data within a cloud-based architecture.
  • Work closely with our Data Engineers to gather requirements for the currently developed data pipelines. Provide expertise in GCP services like DataProc, DataFlow, Cloud Functions, Workflows, Cloud Composer, and Bigquery, advocating for best practices in cloud-based data management.
  • Collaborate with data architects and other stakeholders to optimize data models and warehouse design for the cloud environment.
  • Develop and implement monitoring, quality, and validation processes to ensure the integrity of data pipelines and data.
  • Document all data engineering processes and create clear specifications for future reference and compliance.

Requirements

We look for big thinkers. People who can drive positive change, step up and show what's next – people with passion, can-do attitude and a hunger to learn and grow. In practice this means:

  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
  • Minimum of 5 years of experience as a Data Engineer with a focus on Google cloud-based solutions.
  • Strong knowledge of versioning and CI/CD.
  • Proficient in GCP services, with a strong emphasis on data-related products such as DataProc, DataFlow, Cloud Functions, Workflows, Cloud Composer, and Bigquery. Extensive experience with ETL tools, particularly dbt Labs, and a clear understanding of ETL best practices.
  • Experience in building and optimizing data pipelines, architectures, and data sets from structured/unstructured data sources.
  • Strong analytical skills with the ability to understand complex requirements and translate them into technical solutions. Excellent problem-solving abilities and a commitment to quality.
  • Strong communication skills, with the ability to work collaboratively in a team environment.
  • Relevant certifications in the Google Cloud Platform or other data engineering credentials are desirable. Proficiency in SQL and Python with knowledge of Spark.
  • Fluent in English, with strong written and verbal communication skills.

  • Data Engineer M2C

    4 weeks ago

    Pune, Maharashtra, India Worldline Full time

    Job Title: Data Engineer M2CWe are seeking a highly skilled Data Engineer to join our Data Management team on a transformative Move to Cloud (M2C) project. The ideal candidate will have a strong background in creating robust data ingestion pipelines and a deep understanding of ETL processes, particularly within the Google Cloud Platform ecosystem and using...

  • Senior Data Engineer

    4 weeks ago

    Pune, Maharashtra, India Data Axle Full time

    About Data Axle:Data Axle Inc. has been a leading provider of data, marketing solutions, sales, and research for 50 years in the US. With a strategic global centre of excellence in Pune, Data Axle delivers mission-critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging proprietary business &...

  • Senior Data Engineer

    3 weeks ago

    Pune, Maharashtra, India Data Axle Full time

    About Data AxleData Axle Inc. is a leading provider of data, marketing solutions, sales, and research. With a 50-year history in the US, the company has established a strategic global centre of excellence in Pune, delivering mission-critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging...

  • Senior Data Engineer

    3 weeks ago

    Pune, Maharashtra, India Data Axle Full time

    About Data AxleData Axle Inc. has been a leading provider of data, marketing solutions, sales, and research for over five decades in the US. Our global centre of excellence in Pune delivers mission-critical data services to our customers worldwide, leveraging our proprietary cloud-based technology platform and business & consumer databases.Job SummaryWe are...

  • Senior Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Data Axle Full time

    About Data Axle Data Axle Inc. has been a leading provider of data, marketing solutions, sales and research for decades in the US. We have established a strategic global centre of excellence in Pune, delivering mission-critical data services to our global customers through our proprietary cloud-based technology platform and leveraging our proprietary...

  • Data Engineer

    2 weeks ago

    Pune, Maharashtra, India NTT DATA Full time

    Job Title:Data EngineerJob Summary:NTT DATA is seeking a Data Engineer to join our team in Pune, India. The successful candidate will have demonstrable experience and expertise in at least one programming language, whether it's Python, Java, Scala, or another technology. We value attitude and aptitude and are seeking bright, highly motivated individuals to...

  • Data Engineer

    4 weeks ago

    Pune, Maharashtra, India NTT DATA Services Full time

    Job Title: Data EngineerLocation: Pune, IndiaWe are seeking a skilled Data Engineer to join our team in Pune, India. As a Data Engineer, you will work on exciting big data related projects that require processing large data sets from various sources. You will design and code stable and scalable data ingestion workflows and integrate them into existing...

  • Data Engineer

    4 weeks ago

    Pune, Maharashtra, India NTT DATA Services Full time

    Job Title: Data Engineer - Big Data SpecialistWe are seeking a highly skilled Data Engineer to join our team in Pune, India. As a Data Engineer, you will work on exciting big data related projects that require large data sets to be processed via a vendor sourced solution on a daily, weekly and monthly basis.Key Responsibilities:Analyzing data sets and...

  • Senior Data Center Engineer

    1 week ago

    Pune, Maharashtra, India NTT DATA Full time

    Job Title: Storage & Backup Engineer L2About the Role:We are seeking an experienced Storage & Backup Engineer L2 to join our team at NTT DATA. As a key member of our infrastructure team, you will be responsible for designing, implementing, and maintaining our data center infrastructure, including storage and backup systems.Key Responsibilities:Design and...

  • Senior Data Engineer

    4 weeks ago

    Pune, Maharashtra, India NTT DATA Services Full time

    Req ID: 298868 NTT DATA is a global leader in business and technology services, committed to helping clients innovate, optimize and transform for long term success. We are seeking a talented Senior Data Engineer to join our team in India.About the Role:We are looking for a skilled Data Engineer with expertise in designing and developing big data platforms....

  • Senior Data Engineer

    4 weeks ago

    Pune, Maharashtra, India NTT DATA Services Full time

    Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team in Pune, India. As a key member of our data engineering team, you will be responsible for designing and developing big data platforms using Spark, HBase, Hive, and other Hadoop ecosystem technologies.Key Responsibilities:Design and develop big data platforms using...

  • AWS Data Engineer

    3 weeks ago

    Pune, Maharashtra, India NTT DATA Services Full time

    Job Title: AWS Data EngineerAbout the Role:We are seeking a highly skilled AWS Data Engineer to join our team at NTT DATA Services. As an AWS Data Engineer, you will be responsible for designing, developing, and deploying data pipelines on Amazon Web Services (AWS).Key Responsibilities:Design and develop data pipelines using AWS services such as Glue,...

  • Senior Data Engineer

    3 weeks ago

    Pune, Maharashtra, India NTT DATA Services Full time

    Job Requirements:We are seeking a highly skilled Senior Data Engineer to join our team at NTT DATA Services. The ideal candidate will have a strong background in data engineering, with expertise in designing and developing big data platforms.Key Responsibilities:Design and develop big data platforms using Spark, HBase, Hive, and other Hadoop ecosystem...

  • Senior Data Engineer

    3 weeks ago

    Pune, Maharashtra, India NTT DATA Services Full time

    Job Requirements:We are seeking a highly skilled Senior Data Engineer to join our team in Pune, India. The ideal candidate will have a bachelor degree with 5+ years of programming experience on data platforms.Key Responsibilities:Design and develop big data platforms using expertise in Data Engineering.Deep understanding of data processing technology stacks:...

  • Senior Data Engineer Lead

    4 weeks ago

    Pune, Maharashtra, India Data Axle India Full time

    Job Title: Senior Data Engineer LeadData Axle India is a leading provider of data, marketing solutions, sales, and research services. We are seeking a highly experienced and dynamic Senior Data Engineer Lead to join our team.Key Responsibilities:Lead and manage a team of data engineers to design and implement scalable and efficient data solutions.Provide...

  • Data Axle India Technical Lead

    4 weeks ago

    Pune, Maharashtra, India Data Axle India Full time

    Job Title: Technical Lead - Data EngineerData Axle India is a leading provider of data, marketing solutions, sales, and research services. We are seeking a highly experienced Technical Lead - Data Engineer to join our team.Key Responsibilities:Lead and manage a team of data engineers to design, develop, and deploy scalable and efficient data...

  • Data Architect and Engineer Senior Specialist

    2 weeks ago

    Pune, Maharashtra, India NTT DATA Full time

    Job SummaryWe are seeking a skilled Systems Integration Senior Specialist to join our team in India. The ideal candidate will have a Master's or Bachelor's degree in computer science or a related field and at least 8 years of experience in implementing data applications and big data platforms.Expertise in designing, engineering, and deploying data ingestion,...

  • AWS Data Engineer

    3 weeks ago

    Pune, Maharashtra, India NTT DATA Services Full time

    Job SummaryWe are seeking a highly skilled AWS Data Engineer to join our team in Pune, Madhya Pradesh, India. The successful candidate will contribute to our client and have the following responsibilities:Key ResponsibilitiesWork with technical development team and team lead to understand desired application capabilities.Develop code using Python, such as...

  • Data Analyst

    4 weeks ago

    Pune, Maharashtra, India Data Dynamics Full time

    Job Title: Data ScientistObjective:We are seeking a highly skilled Data Scientist to join our team at Data Dynamics. As a Data Scientist, you will play a key role in developing and deploying machine learning models to drive business growth and improve customer experiences.Key Responsibilities:Custom Model Development: Design, develop, and deploy custom...

  • Senior Data Architect

    4 weeks ago

    Pune, Maharashtra, India Data Axle Full time

    About Data AxleData Axle Inc. is a leading provider of data, marketing solutions, and research services. With a strategic global centre of excellence in Pune, we deliver mission-critical data services to our global customers using our proprietary cloud-based technology platform and leveraging our proprietary business & consumer databases.Job SummaryWe are...