Data Pipeline Developer

2 days ago


India Tata Consultancy Services Full time

Overview

Tata Consultancy Services is a leading IT consulting and business solutions firm that has been at the forefront of innovation for over 50 years.

We are seeking an experienced Data Pipeline Developer to join our team in Mumbai, Chennai or Gandhinagar. As a key member of our data engineering team, you will be responsible for designing, implementing and maintaining complex data pipelines using Python and Snowflake SQL procedural language.

Salary Range: ₹15,00,000 - ₹25,00,000 per annum

Job Description

The successful candidate will have extensive experience in building data pipelines using Python and Snowflake SQL procedural language, with a strong focus on data processing and reporting.

You will work closely with cross-functional teams to design, develop and implement scalable data pipelines that meet the needs of our clients.

Required Skills and Qualifications

To be successful in this role, you will need:

  • 5-6 years of experience in building data pipelines using Python and Snowflake SQL procedural language
  • 2-3 years of experience in Airflow/MWAA service for data pipeline orchestration and schedule management
  • Deep knowledge and understanding of Snowflake Database Platform, including features like external tables, clustering, various data ingestion techniques and Warehouse management
  • Expertise in Snowflake internals and integration of Snowflake with other technologies for data processing and reporting
  • Knowledge of Tableau is a plus

Benefits

In addition to a competitive salary and benefits package, we offer:

  • A dynamic and supportive work environment
  • Ongoing training and development opportunities
  • A chance to work on exciting projects with a global impact

Others

Please note that only shortlisted candidates will be contacted for further evaluation.



  • India Mphasis Full time

    About the RoleAt Mphasis, we are seeking a highly skilled Data Engineering Expert - Data Pipeline Developer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining scalable data pipelines to ingest and transform data from multiple sources using AWS services like S3, Glue, and...


  • India TIU Consulting Full time

    TIU Consulting is seeking a highly skilled Data Engineer to join our team in Pune.We offer an estimated salary of ₹45,00,000 - ₹75,00,000 per annum, based on experience and qualifications.Job DescriptionAs a Data Engineer at TIU Consulting, you will be part of a cross-functional Scrum team that develops and supports our products. You will work closely...


  • India FLYONIT Full time

    Job DescriptionFlyonit is seeking an experienced AWS Data Pipeline Architect to lead the design and implementation of secure, scalable, and efficient data pipelines on AWS. As a key member of our team, you will be responsible for creating reliable and maintainable data integration solutions using services like Glue, Lambda, Step Functions, and...


  • India EXL Full time

    Job Description:We are seeking a talented Software Developer to join our team at EXL, where you will play a crucial role in designing and building scalable data pipelines for interacting with web-based APIs.About the Role:Develop, implement, and maintain efficient data pipelines for performing CRUD operations on data via GraphQL / RESTful APIs in a seamless...


  • India NeenOpal Inc. Full time

    NeenOpal Inc. is seeking a skilled Senior Data Engineer to build and maintain robust data pipelines and integrations from 3rd party data sources.The ideal candidate will have experience in designing database import/export processes, generating client data warehouse deliverables, and working with various data integration tools.We offer a competitive salary...


  • India Collabera Digital Full time

    About the RoleWe are seeking a skilled Data Engineer to design, develop, and optimize scalable data transformation and processing pipelines using Scala, Apache Spark, and Java.This role involves collaborating with our data and development teams to build innovative solutions, integrate with various databases, and ensure high-performance data systems.Key...


  • India Collabera Digital Full time

    Collabera Digital is a leading digital solutions company providing software engineering services to top-tier organizations.We are seeking an experienced Senior Java Developer to join our team and contribute to the development of high-performance data processing pipelines using Apache Spark.Key Responsibilities:Create Scala/Spark jobs for data transformation...


  • India ITI Data Full time

    ITI Data is seeking a highly skilled Cloud Data Engineering Lead to spearhead the design and development of scalable data pipelines on AWS. With a strong background in PySpark, Python, and AWS services, you will be responsible for building robust data integration solutions that enable data-driven insights across various internal and external sources.This is...

  • Data Engineer

    21 hours ago


    India SolarSys Innovations Private Ltd Full time

    Are you passionate about unlocking the full potential of artificial intelligence and machine learning? SolarSys Innovations Private Ltd is seeking a skilled Data Engineer (AI Pipeline Specialist) to join our team! This exciting opportunity will challenge your technical expertise, creativity, and problem-solving skills.Job DescriptionIn this role, you will be...


  • India MSRcosmos LLC Full time

    MSR Cosmos Group is currently seeking a skilled Software Test Engineer to join their team on a remote contract basis. This role offers an exciting opportunity for experienced professionals in software testing and data engineering.About MSR Cosmos LLCA reputable company in the industry, MSR Cosmos LLC provides cutting-edge solutions in data management and...


  • India ITI Data Full time

    We are seeking an experienced PySpark Data Engineer to join our team at ITI Data. As a key member of our team, you will design and build scalable data solutions for one of our Fortune 500 Client programs.About the Role:The ideal candidate will have extensive experience in working with Hadoop, NoSQL databases, and Spark framework on Python. You will be...


  • india Hevo Data Full time

    Hevo is hiring for a passionate Sales Development Representative with an eagle-eye view who can identify the right prospects in need of our solution to make their life easy. Job Role :You should be on top of your account book and engage with prospects. Introduce and position Hevo as a one-stop solution for all their data integration and pipeline...

  • Aws data engineer

    2 weeks ago


    India ITI Data Full time

    Job Description We are looking for an AWS Data with primary skills on Py Spark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....


  • India Wavicle Data Solutions Full time

    Wavicle Data Solutions is seeking an experienced Lead Data Engineer to play a pivotal role in architecting and implementing data solutions.About the RoleThis position offers a competitive salary of $180,000 - $220,000 per annum, commensurate with experience. Key ResponsibilitiesDesign and develop scalable and efficient data pipelines using Python and...

  • AWS Data Engineer

    4 months ago


    India ITI Data Full time

    Job Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....

  • AWS Data Engineer

    4 months ago


    India ITI Data Full time

    Job DescriptionWe are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources. There...

  • AWS Data Engineer

    1 month ago


    india ITI Data Full time

    Job Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....

  • AWS Data Engineer

    4 weeks ago


    India ITI Data Full time

    Job Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....

  • AWS Data Engineer

    3 months ago


    India ITI Data Full time

    Job Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....


  • India Synechron Full time

    We are seeking a skilled ETL Testing and Automation Engineer to join our innovative team in Pune, India.The ideal candidate will possess a strong understanding of ETL processes and be adept at automating testing for data pipelines and APIs using Python and Pytest.Synechron offers a competitive salary ranging from $120,000 to $180,000 per year, depending on...