Data Pipeline Developer
2 days ago
Overview
Tata Consultancy Services is a leading IT consulting and business solutions firm that has been at the forefront of innovation for over 50 years.
We are seeking an experienced Data Pipeline Developer to join our team in Mumbai, Chennai or Gandhinagar. As a key member of our data engineering team, you will be responsible for designing, implementing and maintaining complex data pipelines using Python and Snowflake SQL procedural language.
Salary Range: ₹15,00,000 - ₹25,00,000 per annum
Job Description
The successful candidate will have extensive experience in building data pipelines using Python and Snowflake SQL procedural language, with a strong focus on data processing and reporting.
You will work closely with cross-functional teams to design, develop and implement scalable data pipelines that meet the needs of our clients.
Required Skills and Qualifications
To be successful in this role, you will need:
- 5-6 years of experience in building data pipelines using Python and Snowflake SQL procedural language
- 2-3 years of experience in Airflow/MWAA service for data pipeline orchestration and schedule management
- Deep knowledge and understanding of Snowflake Database Platform, including features like external tables, clustering, various data ingestion techniques and Warehouse management
- Expertise in Snowflake internals and integration of Snowflake with other technologies for data processing and reporting
- Knowledge of Tableau is a plus
Benefits
In addition to a competitive salary and benefits package, we offer:
- A dynamic and supportive work environment
- Ongoing training and development opportunities
- A chance to work on exciting projects with a global impact
Others
Please note that only shortlisted candidates will be contacted for further evaluation.
-
Data Engineering Expert
2 weeks ago
India Mphasis Full timeAbout the RoleAt Mphasis, we are seeking a highly skilled Data Engineering Expert - Data Pipeline Developer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining scalable data pipelines to ingest and transform data from multiple sources using AWS services like S3, Glue, and...
-
Data Pipeline Specialist
21 hours ago
India TIU Consulting Full timeTIU Consulting is seeking a highly skilled Data Engineer to join our team in Pune.We offer an estimated salary of ₹45,00,000 - ₹75,00,000 per annum, based on experience and qualifications.Job DescriptionAs a Data Engineer at TIU Consulting, you will be part of a cross-functional Scrum team that develops and supports our products. You will work closely...
-
AWS Data Pipeline Architect
4 days ago
India FLYONIT Full timeJob DescriptionFlyonit is seeking an experienced AWS Data Pipeline Architect to lead the design and implementation of secure, scalable, and efficient data pipelines on AWS. As a key member of our team, you will be responsible for creating reliable and maintainable data integration solutions using services like Glue, Lambda, Step Functions, and...
-
Software Developer for Scalable Data Pipelines
21 hours ago
India EXL Full timeJob Description:We are seeking a talented Software Developer to join our team at EXL, where you will play a crucial role in designing and building scalable data pipelines for interacting with web-based APIs.About the Role:Develop, implement, and maintain efficient data pipelines for performing CRUD operations on data via GraphQL / RESTful APIs in a seamless...
-
Lead Data Pipeline Architect
4 days ago
India NeenOpal Inc. Full timeNeenOpal Inc. is seeking a skilled Senior Data Engineer to build and maintain robust data pipelines and integrations from 3rd party data sources.The ideal candidate will have experience in designing database import/export processes, generating client data warehouse deliverables, and working with various data integration tools.We offer a competitive salary...
-
India Collabera Digital Full timeAbout the RoleWe are seeking a skilled Data Engineer to design, develop, and optimize scalable data transformation and processing pipelines using Scala, Apache Spark, and Java.This role involves collaborating with our data and development teams to build innovative solutions, integrate with various databases, and ensure high-performance data systems.Key...
-
India Collabera Digital Full timeCollabera Digital is a leading digital solutions company providing software engineering services to top-tier organizations.We are seeking an experienced Senior Java Developer to join our team and contribute to the development of high-performance data processing pipelines using Apache Spark.Key Responsibilities:Create Scala/Spark jobs for data transformation...
-
Cloud Data Engineering Lead
1 week ago
India ITI Data Full timeITI Data is seeking a highly skilled Cloud Data Engineering Lead to spearhead the design and development of scalable data pipelines on AWS. With a strong background in PySpark, Python, and AWS services, you will be responsible for building robust data integration solutions that enable data-driven insights across various internal and external sources.This is...
-
Data Engineer
21 hours ago
India SolarSys Innovations Private Ltd Full timeAre you passionate about unlocking the full potential of artificial intelligence and machine learning? SolarSys Innovations Private Ltd is seeking a skilled Data Engineer (AI Pipeline Specialist) to join our team! This exciting opportunity will challenge your technical expertise, creativity, and problem-solving skills.Job DescriptionIn this role, you will be...
-
Software Test Engineer
2 weeks ago
India MSRcosmos LLC Full timeMSR Cosmos Group is currently seeking a skilled Software Test Engineer to join their team on a remote contract basis. This role offers an exciting opportunity for experienced professionals in software testing and data engineering.About MSR Cosmos LLCA reputable company in the industry, MSR Cosmos LLC provides cutting-edge solutions in data management and...
-
Big Data Engineer: Scalable Solutions Developer
21 hours ago
India ITI Data Full timeWe are seeking an experienced PySpark Data Engineer to join our team at ITI Data. As a key member of our team, you will design and build scalable data solutions for one of our Fortune 500 Client programs.About the Role:The ideal candidate will have extensive experience in working with Hadoop, NoSQL databases, and Spark framework on Python. You will be...
-
india Hevo Data Full timeHevo is hiring for a passionate Sales Development Representative with an eagle-eye view who can identify the right prospects in need of our solution to make their life easy. Job Role :You should be on top of your account book and engage with prospects. Introduce and position Hevo as a one-stop solution for all their data integration and pipeline...
-
Aws data engineer
2 weeks ago
India ITI Data Full timeJob Description We are looking for an AWS Data with primary skills on Py Spark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....
-
Lead Data Engineer: Strategic Data Architect
4 weeks ago
India Wavicle Data Solutions Full timeWavicle Data Solutions is seeking an experienced Lead Data Engineer to play a pivotal role in architecting and implementing data solutions.About the RoleThis position offers a competitive salary of $180,000 - $220,000 per annum, commensurate with experience. Key ResponsibilitiesDesign and develop scalable and efficient data pipelines using Python and...
-
AWS Data Engineer
4 months ago
India ITI Data Full timeJob Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....
-
AWS Data Engineer
4 months ago
India ITI Data Full timeJob DescriptionWe are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources. There...
-
AWS Data Engineer
1 month ago
india ITI Data Full timeJob Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....
-
AWS Data Engineer
4 weeks ago
India ITI Data Full timeJob Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....
-
AWS Data Engineer
3 months ago
India ITI Data Full timeJob Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....
-
Data Pipeline Quality Assurance Specialist
2 days ago
India Synechron Full timeWe are seeking a skilled ETL Testing and Automation Engineer to join our innovative team in Pune, India.The ideal candidate will possess a strong understanding of ETL processes and be adept at automating testing for data pipelines and APIs using Python and Pytest.Synechron offers a competitive salary ranging from $120,000 to $180,000 per year, depending on...