Data Pipeline Specialist

21 hours ago


India TIU Consulting Full time

TIU Consulting is seeking a highly skilled Data Engineer to join our team in Pune.

We offer an estimated salary of ₹45,00,000 - ₹75,00,000 per annum, based on experience and qualifications.

Job Description

As a Data Engineer at TIU Consulting, you will be part of a cross-functional Scrum team that develops and supports our products. You will work closely with other R&D functions to design, implement, and maintain optimal data pipelines.

Key Responsibilities

  • Analyzing and solving product issues to support customers and the support groups
  • Developing new features and providing inputs to Product Owners and Developers on system behavior
  • Collaborating with cross-functional teams to ensure seamless integration of data pipelines

Required Skills and Qualifications

To succeed as a Data Engineer at TIU Consulting, you should have:

  • A minimum of 4 years' experience as a data engineer
  • Strong hands-on experience using Scala
  • Experience with AWS cloud services (related to data pipeline)
  • Knowledge of EMR, S3, Redshift, DocumentDB/MongoDB, Spark streaming, Spark, HDFS, Hive
  • Ability to create and maintain optimal data pipelines and apply performance tuning techniques
  • Strong analytical and debugging skills
  • Experience working in agile environments and ability to add comments in ADO
  • Strong communication skills to articulate technical viewpoints to Architects and Tech Leads

About Us

TIU Consulting is a leading consulting firm that helps businesses transform their data into actionable insights. We believe in fostering a collaborative environment where our employees can grow and excel.


  • Data Engineer

    21 hours ago


    India SolarSys Innovations Private Ltd Full time

    Are you passionate about unlocking the full potential of artificial intelligence and machine learning? SolarSys Innovations Private Ltd is seeking a skilled Data Engineer (AI Pipeline Specialist) to join our team! This exciting opportunity will challenge your technical expertise, creativity, and problem-solving skills.Job DescriptionIn this role, you will be...


  • India FLYONIT Full time

    Job DescriptionFlyonit is seeking an experienced AWS Data Pipeline Architect to lead the design and implementation of secure, scalable, and efficient data pipelines on AWS. As a key member of our team, you will be responsible for creating reliable and maintainable data integration solutions using services like Glue, Lambda, Step Functions, and...


  • India Innova ESI Full time

    Job Title: Data Transformation SpecialistAbout Innova ESIInnova ESI is a leading organization in the industry, and we're seeking a highly skilled Data Transformation Specialist to join our team.Job SummaryWe're looking for an experienced professional to lead the design, development, and implementation of data transformation processes. The ideal candidate...


  • India Synechron Full time

    We are seeking a skilled ETL Testing and Automation Engineer to join our innovative team in Pune, India.The ideal candidate will possess a strong understanding of ETL processes and be adept at automating testing for data pipelines and APIs using Python and Pytest.Synechron offers a competitive salary ranging from $120,000 to $180,000 per year, depending on...


  • India Mphasis Full time

    About the RoleAt Mphasis, we are seeking a highly skilled Data Engineering Expert - Data Pipeline Developer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining scalable data pipelines to ingest and transform data from multiple sources using AWS services like S3, Glue, and...


  • India Data Kart Association Full time

    We are seeking a detail-oriented Data Entry Specialist to join our team at the Data Kart Association. This is a remote, full-time position offering competitive compensation and benefits.As a Data Entry Specialist, you will be responsible for accurately entering data into our system. This role requires strong typing skills (at least 40 wpm) and attention to...


  • India Tata Consultancy Services Full time

    OverviewTata Consultancy Services is a leading IT consulting and business solutions firm that has been at the forefront of innovation for over 50 years.We are seeking an experienced Data Pipeline Developer to join our team in Mumbai, Chennai or Gandhinagar. As a key member of our data engineering team, you will be responsible for designing, implementing and...


  • Anywhere in India/Multiple Locations HR Full time

    Job Description:We are seeking a highly skilled Senior Pipeline Optimization Specialist to join our team.About the Role:The successful candidate will be responsible for designing, creating, and optimizing sales pipelines within CRM to align with business processes. This includes continuously monitoring and refining pipelines to improve efficiency and...


  • India NeenOpal Inc. Full time

    NeenOpal Inc. is seeking a skilled Senior Data Engineer to build and maintain robust data pipelines and integrations from 3rd party data sources.The ideal candidate will have experience in designing database import/export processes, generating client data warehouse deliverables, and working with various data integration tools.We offer a competitive salary...


  • India Manuh Technologies Full time

    About the Role:As a Data Engineering Specialist at Manuh Technologies, you will be responsible for designing, developing, and maintaining large-scale data processing systems using technologies like Cloudera, Hadoop, and Spark. With a strong focus on data processing and analytics, you will work with our team to develop and implement robust data solutions that...


  • India IntelERA Full time

    Job Title: Lead Data Validation SpecialistAs a Lead Data Validation Specialist at IntelERA, you will play a critical role in ensuring the accuracy and integrity of our complex data pipelines. We are seeking an experienced professional with deep expertise in validating ETL processes, optimizing performance, and collaborating with cross-functional teams to...


  • India Collabera Digital Full time

    About the RoleWe are seeking a skilled Data Engineer to design, develop, and optimize scalable data transformation and processing pipelines using Scala, Apache Spark, and Java.This role involves collaborating with our data and development teams to build innovative solutions, integrate with various databases, and ensure high-performance data systems.Key...


  • Northeast India ScS - Sofa Carpet Specialist Full time

    OverviewScS, a leading UK-based sofa specialist, offers an exciting opportunity for a Business Intelligence Data Analyst to join their team in Sunderland.As one of the country's largest retailers, ScS operates over 500 stores and is serviced by 9 distribution centres. With a rich history spanning over a century, the company has established itself as a...


  • india Senior Data Integration Engineer Full time

    Must Have Skills/Skill Requirement:Design and architect integration solutions to connect various enterprise applications, systems, and databases.Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.Utilize Azure Integration Services such as Azure Logic Apps,...


  • india Senior Data Integration Engineer Full time

    Must Have Skills/Skill Requirement: Design and architect integration solutions to connect various enterprise applications, systems, and databases. Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications. Utilize Azure Integration Services such as Azure Logic Apps,...


  • India Senior Data Integration Engineer Full time

    Must Have Skills/Skill Requirement: Design and architect integration solutions to connect various enterprise applications, systems, and databases. Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications. Utilize Azure Integration Services such as Azure Logic...


  • India ACL Digital Full time

    We are seeking a Chief Data Architecture Specialist to join our team at ACL Digital in Balewadi, Pune. This role is ideal for an experienced professional with 5-8 years of experience in data engineering.The successful candidate will have expertise in Spark/PySpark and SQL, with the ability to understand and manipulate complex level SQL queries for data...


  • India Quadrant Technologies Full time

    Job Title: Senior Data Engineering SpecialistAbout the Role:This is a full-time remote role for a data engineer with Quadrant Technologies.Key Responsibilities:Craft optimized and reusable high-quality code.BUILD ingestion pipelines via Azure Data Factory and create data transformation pipelines for analytical metrics using Pyspark/SQL/Scala/Python in Azure...


  • India MSRcosmos LLC Full time

    MSR Cosmos Group is currently seeking a skilled Software Test Engineer to join their team on a remote contract basis. This role offers an exciting opportunity for experienced professionals in software testing and data engineering.About MSR Cosmos LLCA reputable company in the industry, MSR Cosmos LLC provides cutting-edge solutions in data management and...


  • India ITI Data Full time

    ITI Data is seeking a highly skilled Cloud Data Engineering Lead to spearhead the design and development of scalable data pipelines on AWS. With a strong background in PySpark, Python, and AWS services, you will be responsible for building robust data integration solutions that enable data-driven insights across various internal and external sources.This is...