Data Pipeline Specialist
2 weeks ago
About the Role:
Are you a skilled data professional looking to drive business insights and decision making? We're seeking a talented Data Pipeline Specialist to join our dynamic team and work on cutting-edge data engineering solutions in a fast-paced environment. You'll have the opportunity to design, implement, and optimize data pipelines that drive business growth and success. With a focus on scalability and performance, you'll collaborate closely with cross-functional teams to streamline data processing and analytics.
Responsibilities:
- Design, develop, and maintain efficient and scalable data pipelines for real-time and batch data processing.
- Utilize Python and SQL to handle complex data transformations and automate workflows.
- Leverage AWS cloud services (S3, Lambda, RDS, etc.) for seamless data integration, storage, and processing.
- Create, integrate, and manage REST APIs to enable smooth data flow between systems and applications.
- Ensure data quality, performance tuning, and monitoring of the data pipeline infrastructure.
- Collaborate with data scientists, analysts, and other engineers to deliver end-to-end data solutions.
Requirements:
- Strong programming skills in Python for data manipulation and scripting.
- Advanced knowledge of SQL for querying, transformation, and optimization.
- Hands-on experience with AWS services for cloud-based data solutions.
- Proficient in developing and integrating REST APIs.
- Exposure to Docker and Kubernetes for containerization and orchestration is a plus.
- Excellent problem-solving skills and the ability to work in an agile environment.
-
ETL Data Pipeline Specialist
4 weeks ago
Bengaluru, Karnataka, India TecQubes Technologies Full timeETL Data Pipeline SpecialistAt TecQubes Technologies, we are seeking an experienced ETL Data Pipeline Specialist to join our team. As an ETL Data Pipeline Specialist, you will be responsible for providing expert support for ETL processes built on Azure Data Factory (ADF) and Azure Databricks (ADB).Diagnose and resolve complex ETL issues to ensure the smooth...
-
Data Engineer
3 weeks ago
Bengaluru, Karnataka, India NR Consulting - India Full timeJob Title: Data Engineer - Pipeline SpecialistJob Summary:We are seeking a highly skilled Data Engineer - Pipeline Specialist to join our team at NR Consulting - India. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining efficient data pipelines using tools like Apache Airflow, Luigi, or...
-
Data Pipeline Architect
3 weeks ago
Bengaluru, Karnataka, India NTT DATA Full timeJob SummaryWe are seeking a skilled Data Pipeline Architect to join our team in Bangalore, India. The successful candidate will design, build, and maintain scalable data pipelines using Databricks on AWS.Key Responsibilities:Design and develop data pipelines using Databricks on AWSIngest data from multiple sources using AWS services such as S3, Lambda, Glue,...
-
Azure Data Engineer
4 weeks ago
Bengaluru, Karnataka, India Coders Brain Technology Private Limited Full timeJob Title: Azure Data Engineer - Data Pipeline SpecialistAbout the Role:We are seeking a highly skilled Azure Data Engineer to join our team at Coders Brain Technology Private Limited. As a Data Pipeline Specialist, you will be responsible for designing, implementing, and optimizing data pipelines for efficient data ingestion, processing, and storage.Key...
-
Pipeline Integrity Specialist
3 weeks ago
Bengaluru, Karnataka, India ExxonMobil Corporation Full timeJob Title: Pipeline Integrity SpecialistAbout the RoleExxonMobil Corporation is seeking a highly skilled Pipeline Integrity Specialist to join our team. In this role, you will be responsible for ensuring the safe and reliable operation of our pipelines by identifying and mitigating potential risks.Key ResponsibilitiesDevelop and implement pipeline integrity...
-
Data Engineer
2 days ago
Bengaluru, Karnataka, India Luxoft Full timeJob OverviewLuxoft is seeking an experienced Data Engineer to join our team as a Cloud Data Pipeline Specialist. In this role, you will be responsible for designing and implementing scalable data pipelines within the Azure ecosystem.ResponsibilitiesDesign, develop, and maintain large-scale data processing pipelines using Azure Data Factory (ADF) and Azure...
-
Data Engineer
5 days ago
Bengaluru, Karnataka, India The Nielsen Company Full timeOverviewThe Nielsen Company is a leading provider of information and measurement solutions. Our team is dedicated to helping businesses succeed by providing accurate and reliable data.SalaryWe offer a competitive salary, estimated to be around $120,000 per year, based on the location and industry standards.About the RoleAs a Data Engineer - Cloud Pipeline...
-
Data Engineer
1 week ago
Bengaluru, Karnataka, India Genpact Full timeAt Genpact, we empower businesses to create lasting value for their clients by leveraging our deep business and industry knowledge, digital operations services, and expertise in data, technology, and AI.We are seeking a highly skilled Data Engineer - Scalable Data Pipelines Specialist to join our team.ResponsibilitiesAs a Data Engineer, you will work closely...
-
Data Specialist
1 month ago
Bengaluru, Karnataka, India NTT DATA Services Full timeAbout the RoleWe are seeking a highly skilled Data Specialist to join our team in Bangalore, India. As a key member of our data engineering team, you will be responsible for designing and developing data pipelines utilizing cloud technologies such as Azure, AWS, and GCP.Key ResponsibilitiesDesign and develop data pipelines using cloud technologiesLead a team...
-
Senior Data Analytics Specialist
3 weeks ago
Bengaluru, Karnataka, India NTT DATA Services Full timeJob Title: Senior Data Analytics SpecialistAbout the Role:We are seeking a skilled Senior Data Analytics Specialist to join our team in India. As a Senior Data Analytics Specialist, you will play a key role in designing, building, and maintaining the systems and infrastructure necessary for processing, collecting, storing, and analyzing large volumes of...
-
Pipeline Integrity Specialist
1 month ago
Bengaluru, Karnataka, India ExxonMobil Corporation Full timeAbout the RoleWe are seeking a highly skilled Pipeline Integrity Specialist to join our team at ExxonMobil Corporation. As a key member of our pipeline integrity team, you will be responsible for ensuring the reliability and integrity of our pipeline assets.Key ResponsibilitiesDevelop and implement pipeline integrity management programs to ensure compliance...
-
Cloud Engineer
2 days ago
Bengaluru, Karnataka, India NTT DATA Full timeJob OverviewNTT DATA, a global leader in business and technology services, is seeking a highly skilled Cloud Engineer - Data Specialist to join our team in Bangalore, India.About the RoleWe are looking for an experienced Cloud Engineer with expertise in designing, building, and maintaining scalable data pipelines using Databricks on AWS. The ideal candidate...
-
Data Engineer Cloud Migration Specialist
6 days ago
Bengaluru, Karnataka, India NTT DATA Full timeAbout the RoleWe are seeking a highly skilled Data Engineer Cloud Migration Specialist to join our team in Bangalore, India.The successful candidate will be responsible for designing, building and maintaining scalable data pipelines using Databricks on AWS, as well as integrating data from multiple sources using AWS services such as S3, Lambda, Glue, and...
-
Data Pipeline Automation Specialist
3 weeks ago
Bengaluru, Karnataka, India Clutterbot Full timeAbout ClutterbotImagine a world where you never have to worry about picking up clutter again At our robotics startup, we understand the challenges families face trying to balance work and daily responsibilities while keeping their homes tidy We're developing a cutting-edge household robot to revolutionize the way you live This safe and innovative robot will...
-
AWS Data Engineer Senior Specialist
4 weeks ago
Bengaluru, Karnataka, India NTT DATA Services Full timeJob Title: AWS Data Engineer Senior SpecialistJob Summary:We are seeking a highly skilled AWS Data Engineer Senior Specialist to join our team at NTT DATA Services. As a key member of our team, you will be responsible for designing, developing, and implementing data pipelines using AWS services such as Glue, Python, and Data Pipeline creation.Key...
-
Data Visualization Specialist
1 month ago
Bengaluru, Karnataka, India NTT DATA Full timeJob OverviewData Visualization Specialist - NTT DATAData visualization specialists utilize expertise in information visualization and design to create and deploy new platforms and services for visualization initiatives. Visualization specialists build interactive and complex data visualizations and analysis tools. They are responsible for translating the...
-
Data Engineer
3 weeks ago
Bengaluru, Karnataka, India Bosch Full timeJob DescriptionJob Overview:Development, monitoring, and maintenance of data pipelines across AE clusters involves leveraging technical expertise to ensure seamless data flow.Primary Responsibilities:Develop and maintain data pipelines for various AE plants, focusing on scalability and efficiency.Design and implement optimal data pipeline architecture,...
-
DevOps Data Engineer for Data Pipeline Solutions
3 weeks ago
Bengaluru, Karnataka, India PeopleLocus Full timeData Engineering Solutions SpecialistWe are seeking a highly skilled Data Engineering Solutions Specialist to join our team at PeopleLocus. As a key member of our team, you will be responsible for designing and implementing data engineering solutions in the big data space.Key Responsibilities:Design and implement data pipelines to support near real-time...
-
Cloud LLM Pipeline Architect
3 weeks ago
Bengaluru, Karnataka, India NTT DATA Full timeJob DescriptionCloud LLM Pipeline ArchitectAbout the RoleWe are seeking a skilled Cloud LLM Pipeline Architect to design, implement, and maintain our Large Language Model (LLM) infrastructure on a leading cloud platform. As a key member of our team, you will play a critical role in building, automating, and optimizing our LLM pipeline, ensuring seamless...
-
Data Engineering Cloud Specialist
7 days ago
Bengaluru, Karnataka, India NTT DATA Full timeJob Title: Data Engineering Cloud SpecialistAbout the RoleWe are seeking an experienced Data Engineer to join our team at NTT DATA. This is a fantastic opportunity to work on diverse data engineering activities on Azure Data platform and contribute to building a robust data pipeline connecting various enterprise data sources.About YouTo be successful in this...