Data Pipeline Specialist

2 weeks ago


Bengaluru, Karnataka, India TekPillar Full time

About the Role:

Are you a skilled data professional looking to drive business insights and decision making? We're seeking a talented Data Pipeline Specialist to join our dynamic team and work on cutting-edge data engineering solutions in a fast-paced environment. You'll have the opportunity to design, implement, and optimize data pipelines that drive business growth and success. With a focus on scalability and performance, you'll collaborate closely with cross-functional teams to streamline data processing and analytics.

Responsibilities:

  • Design, develop, and maintain efficient and scalable data pipelines for real-time and batch data processing.
  • Utilize Python and SQL to handle complex data transformations and automate workflows.
  • Leverage AWS cloud services (S3, Lambda, RDS, etc.) for seamless data integration, storage, and processing.
  • Create, integrate, and manage REST APIs to enable smooth data flow between systems and applications.
  • Ensure data quality, performance tuning, and monitoring of the data pipeline infrastructure.
  • Collaborate with data scientists, analysts, and other engineers to deliver end-to-end data solutions.

Requirements:

  • Strong programming skills in Python for data manipulation and scripting.
  • Advanced knowledge of SQL for querying, transformation, and optimization.
  • Hands-on experience with AWS services for cloud-based data solutions.
  • Proficient in developing and integrating REST APIs.
  • Exposure to Docker and Kubernetes for containerization and orchestration is a plus.
  • Excellent problem-solving skills and the ability to work in an agile environment.


  • Bengaluru, Karnataka, India TecQubes Technologies Full time

    ETL Data Pipeline SpecialistAt TecQubes Technologies, we are seeking an experienced ETL Data Pipeline Specialist to join our team. As an ETL Data Pipeline Specialist, you will be responsible for providing expert support for ETL processes built on Azure Data Factory (ADF) and Azure Databricks (ADB).Diagnose and resolve complex ETL issues to ensure the smooth...

  • Data Engineer

    3 weeks ago


    Bengaluru, Karnataka, India NR Consulting - India Full time

    Job Title: Data Engineer - Pipeline SpecialistJob Summary:We are seeking a highly skilled Data Engineer - Pipeline Specialist to join our team at NR Consulting - India. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining efficient data pipelines using tools like Apache Airflow, Luigi, or...


  • Bengaluru, Karnataka, India NTT DATA Full time

    Job SummaryWe are seeking a skilled Data Pipeline Architect to join our team in Bangalore, India. The successful candidate will design, build, and maintain scalable data pipelines using Databricks on AWS.Key Responsibilities:Design and develop data pipelines using Databricks on AWSIngest data from multiple sources using AWS services such as S3, Lambda, Glue,...

  • Azure Data Engineer

    4 weeks ago


    Bengaluru, Karnataka, India Coders Brain Technology Private Limited Full time

    Job Title: Azure Data Engineer - Data Pipeline SpecialistAbout the Role:We are seeking a highly skilled Azure Data Engineer to join our team at Coders Brain Technology Private Limited. As a Data Pipeline Specialist, you will be responsible for designing, implementing, and optimizing data pipelines for efficient data ingestion, processing, and storage.Key...


  • Bengaluru, Karnataka, India ExxonMobil Corporation Full time

    Job Title: Pipeline Integrity SpecialistAbout the RoleExxonMobil Corporation is seeking a highly skilled Pipeline Integrity Specialist to join our team. In this role, you will be responsible for ensuring the safe and reliable operation of our pipelines by identifying and mitigating potential risks.Key ResponsibilitiesDevelop and implement pipeline integrity...

  • Data Engineer

    2 days ago


    Bengaluru, Karnataka, India Luxoft Full time

    Job OverviewLuxoft is seeking an experienced Data Engineer to join our team as a Cloud Data Pipeline Specialist. In this role, you will be responsible for designing and implementing scalable data pipelines within the Azure ecosystem.ResponsibilitiesDesign, develop, and maintain large-scale data processing pipelines using Azure Data Factory (ADF) and Azure...

  • Data Engineer

    5 days ago


    Bengaluru, Karnataka, India The Nielsen Company Full time

    OverviewThe Nielsen Company is a leading provider of information and measurement solutions. Our team is dedicated to helping businesses succeed by providing accurate and reliable data.SalaryWe offer a competitive salary, estimated to be around $120,000 per year, based on the location and industry standards.About the RoleAs a Data Engineer - Cloud Pipeline...

  • Data Engineer

    1 week ago


    Bengaluru, Karnataka, India Genpact Full time

    At Genpact, we empower businesses to create lasting value for their clients by leveraging our deep business and industry knowledge, digital operations services, and expertise in data, technology, and AI.We are seeking a highly skilled Data Engineer - Scalable Data Pipelines Specialist to join our team.ResponsibilitiesAs a Data Engineer, you will work closely...

  • Data Specialist

    1 month ago


    Bengaluru, Karnataka, India NTT DATA Services Full time

    About the RoleWe are seeking a highly skilled Data Specialist to join our team in Bangalore, India. As a key member of our data engineering team, you will be responsible for designing and developing data pipelines utilizing cloud technologies such as Azure, AWS, and GCP.Key ResponsibilitiesDesign and develop data pipelines using cloud technologiesLead a team...


  • Bengaluru, Karnataka, India NTT DATA Services Full time

    Job Title: Senior Data Analytics SpecialistAbout the Role:We are seeking a skilled Senior Data Analytics Specialist to join our team in India. As a Senior Data Analytics Specialist, you will play a key role in designing, building, and maintaining the systems and infrastructure necessary for processing, collecting, storing, and analyzing large volumes of...


  • Bengaluru, Karnataka, India ExxonMobil Corporation Full time

    About the RoleWe are seeking a highly skilled Pipeline Integrity Specialist to join our team at ExxonMobil Corporation. As a key member of our pipeline integrity team, you will be responsible for ensuring the reliability and integrity of our pipeline assets.Key ResponsibilitiesDevelop and implement pipeline integrity management programs to ensure compliance...

  • Cloud Engineer

    2 days ago


    Bengaluru, Karnataka, India NTT DATA Full time

    Job OverviewNTT DATA, a global leader in business and technology services, is seeking a highly skilled Cloud Engineer - Data Specialist to join our team in Bangalore, India.About the RoleWe are looking for an experienced Cloud Engineer with expertise in designing, building, and maintaining scalable data pipelines using Databricks on AWS. The ideal candidate...


  • Bengaluru, Karnataka, India NTT DATA Full time

    About the RoleWe are seeking a highly skilled Data Engineer Cloud Migration Specialist to join our team in Bangalore, India.The successful candidate will be responsible for designing, building and maintaining scalable data pipelines using Databricks on AWS, as well as integrating data from multiple sources using AWS services such as S3, Lambda, Glue, and...


  • Bengaluru, Karnataka, India Clutterbot Full time

    About ClutterbotImagine a world where you never have to worry about picking up clutter again At our robotics startup, we understand the challenges families face trying to balance work and daily responsibilities while keeping their homes tidy We're developing a cutting-edge household robot to revolutionize the way you live This safe and innovative robot will...


  • Bengaluru, Karnataka, India NTT DATA Services Full time

    Job Title: AWS Data Engineer Senior SpecialistJob Summary:We are seeking a highly skilled AWS Data Engineer Senior Specialist to join our team at NTT DATA Services. As a key member of our team, you will be responsible for designing, developing, and implementing data pipelines using AWS services such as Glue, Python, and Data Pipeline creation.Key...


  • Bengaluru, Karnataka, India NTT DATA Full time

    Job OverviewData Visualization Specialist - NTT DATAData visualization specialists utilize expertise in information visualization and design to create and deploy new platforms and services for visualization initiatives. Visualization specialists build interactive and complex data visualizations and analysis tools. They are responsible for translating the...

  • Data Engineer

    3 weeks ago


    Bengaluru, Karnataka, India Bosch Full time

    Job DescriptionJob Overview:Development, monitoring, and maintenance of data pipelines across AE clusters involves leveraging technical expertise to ensure seamless data flow.Primary Responsibilities:Develop and maintain data pipelines for various AE plants, focusing on scalability and efficiency.Design and implement optimal data pipeline architecture,...


  • Bengaluru, Karnataka, India PeopleLocus Full time

    Data Engineering Solutions SpecialistWe are seeking a highly skilled Data Engineering Solutions Specialist to join our team at PeopleLocus. As a key member of our team, you will be responsible for designing and implementing data engineering solutions in the big data space.Key Responsibilities:Design and implement data pipelines to support near real-time...


  • Bengaluru, Karnataka, India NTT DATA Full time

    Job DescriptionCloud LLM Pipeline ArchitectAbout the RoleWe are seeking a skilled Cloud LLM Pipeline Architect to design, implement, and maintain our Large Language Model (LLM) infrastructure on a leading cloud platform. As a key member of our team, you will play a critical role in building, automating, and optimizing our LLM pipeline, ensuring seamless...


  • Bengaluru, Karnataka, India NTT DATA Full time

    Job Title: Data Engineering Cloud SpecialistAbout the RoleWe are seeking an experienced Data Engineer to join our team at NTT DATA. This is a fantastic opportunity to work on diverse data engineering activities on Azure Data platform and contribute to building a robust data pipeline connecting various enterprise data sources.About YouTo be successful in this...