Data Engineering Expert

1 month ago


Pune, Maharashtra, India Springer Nature Group Full time

Springer Nature Group is a leading publisher of scientific books, journals, and magazines with over 3000 journal titles. We are seeking an experienced Data Engineer to join our team in Pune.

About Us

We're looking for a skilled Data Engineer to work with us in evolving a cross-platform view of our submission data. This involves driving workflow management, customer experience, and business reporting in up to 30 teams.

Job Description

We offer a competitive salary of $120,000 per year, making this a great opportunity for experienced professionals. As a Senior Data Engineer at Springer Nature Group, you will be responsible for designing, developing, and maintaining scalable data pipelines on Google Cloud Platform (GCP). You will work with BigQuery, Python, DBT, Terraform, and GIT to implement and optimize data storage solutions for large-scale processing.

You will collaborate with data scientists, analysts, and stakeholders to meet data requirements, ensuring data quality and integrity throughout the data lifecycle. Additionally, you will implement CI/CD pipelines for data applications and manage infrastructure using Terraform. Utilizing DBT for data modeling, testing, and documentation, you will use GIT for version control and code collaboration.

Responsibilities
  • Design and develop scalable data pipelines on GCP
  • Implement and optimize data storage solutions with BigQuery
  • Develop, test, and deploy data transformation workflows using Python
  • Collaborate with data scientists, analysts, and stakeholders
  • Ensure data quality and integrity
  • Implement CI/CD pipelines for data applications
  • Manage infrastructure using Terraform
  • Utilize DBT for data modeling, testing, and documentation
  • Use GIT for version control and code collaboration
About You

We're looking for someone with over 5 years of experience in data/software engineering on a cloud platform (AWS/GCP/Azure) using tools such as DBT and programming languages like Python, Scala, or Java. You should have strong SQL and data problem-solving skills, along with experience with data modeling and transformation tools like DBT. A solid understanding of modern data engineering practices and the ability to factor in non-functional aspects of data pipeline development are also essential.


  • Data Engineer Expert

    2 weeks ago


    Pune, Maharashtra, India HiLabs Full time

    Job Title: Data Engineer Expert">About the Role:We are seeking an experienced Data Engineer Expert to join our team at HiLabs. The successful candidate will design, develop, and optimize scalable ETL processes to ingest and process data from diverse sources.">Key Responsibilities:">">Design, develop, and maintain data pipelines using tools like Apache Spark,...


  • Pune, Maharashtra, India Awign Expert Full time

    Job OverviewPursue a challenging career as a Senior Product Manager at Awign Expert. As a key member of our team, you will be responsible for driving the development and success of motor insurance products.About UsAwign Expert is a dynamic company that offers exciting opportunities for product managers to grow and develop their skills.Estimated Salary:...


  • Pune, Maharashtra, India Capgemini Engineering Full time

    About the RoleWe are seeking a highly skilled Enterprise Data Architect & Integration Expert with in-depth knowledge of Siemens UADM (Unified Architecture Data Management) to join our dynamic team at Capgemini Engineering. As an Enterprise Data Architect, you will play a key role in the design, integration, and implementation of enterprise-level solutions....


  • Pune, Maharashtra, India Codinix Technologies Inc Full time

    Job Title: Data Engineering ExpertDescription:We are seeking an experienced Data Engineer to join our team at Codinix Technologies Inc. This is a contract position with a duration of 6 months to 1 year, based in Pune or Bengaluru (work from office/remote).Overview:The ideal candidate will have 4-7 years of experience working with data integration, data...


  • Pune, Maharashtra, India Data Dynamics Full time

    About Data Dynamics">Data Dynamics is a leading data-driven company that leverages cutting-edge technologies to drive business growth. Our team of experts collaborates with clients across various industries to deliver innovative solutions.Job Summary">We are seeking an experienced Senior Machine Learning Specialist to join our team. As a key member, you will...


  • Pune, Maharashtra, India Where U Elevate Full time

    Job Summary:We are seeking an experienced Cloud Data Engineering Expert to join our team at Where U Elevate. As a cloud data engineering expert, you will play a key role in designing and implementing large-scale cloud-based data processing systems that meet our customers' needs.About the Role:This role involves working closely with our data analytics team to...


  • Pune, Maharashtra, India Capco Technologies Pvt Ltd Full time

    Job Position:Data Engineering and Architecture ExpertAbout Our Company:We are Capco Technologies Pvt Ltd, a forward-thinking technology organization.Compensation Package:$180,000 - $250,000 per yearKey Responsibilities:Lead the design and implementation of data engineering and architecture solutions using AWS services.Collaborate with cross-functional teams...


  • Pune, Maharashtra, India Tata Consultancy Services Full time

    Job DescriptionWe are seeking a highly skilled Senior Data Engineering Expert to join our team at Tata Consultancy Services.About the RoleThe successful candidate will be responsible for designing and implementing scalable data architectures, leveraging Azure services such as ADLS, ADF, Azure Databricks, and Synapse. You will work closely with clients to...


  • Pune, Maharashtra, India Data Dynamics Full time

    About Data DynamicsWe are a forward-thinking organization seeking a highly skilled Data Science Expert for Machine Learning and NLP to join our team. As a key member of our data science division, you will be responsible for developing and deploying innovative machine learning models to drive business growth.Estimated Salary: $140,000 - $180,000 per yearJob...

  • Data Engineer

    1 month ago


    Pune, Maharashtra, India Tata Consultancy Services Full time

    Welcome to this exciting opportunity at Tata Consultancy Services! As a seasoned Data Engineer, you will play a pivotal role in shaping our client's data strategy using cutting-edge technologies.Job Title: Data Engineer - Azure Databricks ExpertEstimated Salary: ₹1,200,000 - ₹2,400,000 per annumLocation: Bangalore and PuneWe are looking for an...


  • Pune, Maharashtra, India Capgemini Engineering Full time

    **Company Overview**At Capgemini Engineering, we are seeking a skilled AspenTech Solutions Expert to join our team.The successful candidate will be responsible for implementing and supporting Aspentech IP.21 solutions for clients.We offer a competitive salary of $120,000 per annum, based on the national average in the United States.**Job Description**As an...


  • Pune, Maharashtra, India SGS Technical Services Pvt. Ltd Full time

    Job OverviewSGS Technical Services Pvt. Ltd is seeking an experienced Data Engineering Expert to join our team in Pune. This role involves designing, developing, and maintaining scalable data processing systems using Hadoop and PySpark.Responsibilities• Design and implement efficient data pipelines to process large datasets• Collaborate with data...

  • Cloud Engineer

    3 weeks ago


    Pune, Maharashtra, India Tekgence Inc Full time

    Job Title: Cloud Engineer - GCP Data ExpertA well-established client in the technology sector is seeking an experienced Cloud Engineer - GCP Data Expert to join their team.About the Role:The successful candidate will be responsible for designing, implementing, and managing large-scale data processing systems on Google Cloud Platform (GCP).Strong experience...

  • Big Data Engineer

    3 weeks ago


    Pune, Maharashtra, India LTIMindtree Full time

    Job SummaryWe are seeking a highly skilled Big Data Engineer - Databricks Expert to join our team at LTIMindtree. The ideal candidate will have experience with Azure Databricks, Python, and Time Series Processing.About the RoleAs a Big Data Engineer - Databricks Expert, you will design, construct, install, test, and maintain highly scalable data management...

  • Data Engineer

    2 weeks ago


    Pune, Maharashtra, India Solytics partners Full time

    About the RoleSolytics Partners is seeking an experienced Data Engineer to join our team as a Risk Management Expert. This critical hands-on engineer position will play a key role in applying data processing/reporting and practical artificial intelligence techniques to solve real-world problems.This role will focus on developing data, reporting, and...


  • Pune, Maharashtra, India Capgemini Engineering Full time

    Job DescriptionWe are seeking a highly skilled Quintiq Specialist to join our team at Capgemini Engineering.About the RoleThis is an exciting opportunity for a seasoned professional with extensive experience in Supply Chain Management, Workforce Planning, and Production Optimization. As a Quintiq Specialist, you will work closely with our clients to deliver...


  • Pune, Maharashtra, India Capgemini Engineering Full time

    About the RoleAs a Steel Industry Solutions Expert at Capgemini Engineering, you will be working with our team to deliver industry-leading solutions for the steel and metals sector. This is an exciting opportunity for experienced professionals to leverage their knowledge of supply chain management, workforce planning, and production optimization.


  • Pune, Maharashtra, India Data Dynamics Full time

    Company OverviewData Dynamics is a global leader in enterprise data management, focusing on Digital Trust and Data Democracy. The company's AI-powered self-service data management software revolutionizes traditional data management by empowering data creators of all skill levels to have ownership and control over their data.Salary and BenefitsThe estimated...


  • Pune, Maharashtra, India Freelance Full time

    Data Analytics Expert in AzureWe are seeking an experienced Data Analytics Expert in Azure to join our Freelance team. In this role, you will be responsible for designing and implementing data analytics solutions using Azure.Key Responsibilities:Design and implement data models using Databricks and other relevant tools.Collaborate with cross-functional teams...

  • GCP Data Engineer

    4 weeks ago


    Pune, Maharashtra, India Tata Consultancy Services Full time

    We are looking for a highly skilled GCP Data Engineer - Big Data Expert to join our team at Tata Consultancy Services. As a GCP Data Engineer, you will play a critical role in designing and implementing scalable data processing systems on Google Cloud Platform.About the Role:We are seeking an experienced professional with a strong background in GCP-based big...