Data Pipeline Engineer

1 month ago


Bangalore, Karnataka, India TekPillar Full time

Job Title : Data Pipeline Engineer

Location : Bangalore

Experience : 4-5 Years

About the Role :

Are you a skilled Data Pipeline Engineer looking to take your career to the next level? Join our dynamic team and work on cutting-edge data engineering solutions in a fast-paced environment You'll have the opportunity to design, implement, and optimize data pipelines that drive business insights and decision making. With a focus on scalability and performance, you'll collaborate closely with cross-functional teams to streamline data Responsibilities :


- Design, develop, and maintain efficient and scalable data pipelines for real-time and batch data processing.


- Utilize Python and SQL to handle complex data transformations and automate workflows.


- Leverage AWS cloud services (S3, Lambda, RDS, etc.) for seamless data integration, storage, and processing.


- Create, integrate, and manage REST APIs to enable smooth data flow between systems and applications.


- Ensure data quality, performance tuning, and monitoring of the data pipeline infrastructure.


- Collaborate with data scientists, analysts, and other engineers to deliver end-to-end data solutions.


Skills and Qualifications :


- Strong programming skills in Python for data manipulation and scripting.


- Advanced knowledge of SQL for querying, transformation, and optimization.


- Hands-on experience with AWS services for cloud-based data solutions.


- Proficient in developing and integrating REST APIs.


- Exposure to Docker and Kubernetes for containerization and orchestration is a plus.


- Excellent problem-solving skills and the ability to work in an agile environment.

(ref:hirist.tech)
  • Data Engineer

    1 month ago


    Bangalore, Karnataka, India Creencia Technologies Pvt Ltd Full time

    Job Description:We are seeking a skilled Data Engineer to join our team. The ideal candidate will have a strong background in Data Engineering, with expertise in building and managing data pipelines. Proficiency in Scala programming, as well as experience with Java, GCP, and Spark, is essential for this role.Salary : 14-18 LPA Responsibilities :- Design,...

  • ETL Developer

    1 month ago


    Bangalore, Karnataka, India Zenotis Group Full time

    Job Requirement :- Develop and Maintain ETL Pipelines : Design, develop, and implement scalable ETL workflows using PySpark, Python, and AWS Glue, Databricks.- Data Transformation and Integration : Extract, transform, and load data from various sources to AWS S3 and Redshift.- Performance Optimization : Identify and resolve performance bottlenecks in ETL...

  • Data Engineer

    1 month ago


    Bangalore, Karnataka, India Rcs groups Full time

    Roles and Responsibilities : - Develop and maintain scalable and reliable data pipelines to ingest data from various APIs into the AWS ecosystem.- Manage data storage solutions using S3 buckets, ensuring best practices in data organization and security.- Utilize AWS Redshift for data warehousing tasks, optimizing data retrieval and query performance.-...

  • Senior Data Engineer

    1 month ago


    Bangalore/Karnataka, Karnataka, India Kloud9 Full time

    Job Description :As a Senior Data Engineer, you will partner with Software Engineers, Data Scientists and Business Intelligence Engineers. You will gain a deep understanding of our services and the data they produce and become our resident expert in how to transform that data into a format that is useful for analytics and business intelligence. You will...

  • AI/ML Engineer

    1 month ago


    Bangalore, Karnataka, India WIZSTAFFING PRIVATE LIMITED Full time

    We are seeking a talented and experienced AI/ML Engineer with domain-specific knowledge in multilingual audio signal and text processing, coupled with expertise in data engineering and data processing pipelines. The ideal candidate will have a strong background in artificial intelligence (AI) and machine learning (ML), with a focus on audio signal...

  • Solution Engineer

    1 month ago


    Bangalore, Karnataka, India HEVO DATA Full time

    Overview :. We're seeking a talented Solutions Engineer with strong background in Data Domain to join our growing Sales team. You'll work one-on-one with the sales team to help discover our customers' business and technical needs and demonstrate how Hevo's platform can solve their real-time data replication needs. In this role, you will have...

  • ETL Developer

    1 month ago


    Bangalore, Karnataka, India ProPMO Services Private Limited Full time

    Position : ETL DeveloperLocation : BangaloreExperience Required : 5+ yearsMust-Have Skills : AWS Glue, Athena, S3, Redshift, Data Pipeline, Lambda, MySQL, SQL ServerPosition Overview :We are seeking an experienced ETL Developer with over 5 years of expertise to join our team in Bangalore. The ideal candidate will have a strong background in AWS services and...


  • Bangalore, Karnataka, India HEVO DATA Full time

    About Hevo : Ever wondered, what's common between Zepto, Napster, Curefit, Groww, Jumio, Cars24 ? They all super-charge their business growth with Hevo Data Pipelines. How? 2 of every 3 modern day companies are unable to take data driven decision making due to fragmented data across 100s business software. Hevo is a simple, intuitive, and powerful...

  • Data Engineer

    1 month ago


    Bangalore, Karnataka, India Recruitment Consulting firm Full time

    About the Role :We are looking for 6 Senior Data Analysts & Data Engineers at the Consultant level who are experienced with Python, Databricks, Computer Vision, SQL, and Azure. You will work on cutting-edge data engineering and analytics projects, helping build and optimize data pipelines, developing IoT integration solutions, and working with Azure Cloud...

  • Data Engineer

    1 month ago


    Bangalore, Karnataka, India Consero Global Solutions Full time

    We are seeking experienced, motivated and enthusiastic Data Engineering Specialists to join our team. As part of the team, you will be involved in the implementation of the ongoing and new initiatives for our company and contribute to our mission of delivering high-quality data-driven solutions to our clients. Role Description : The data engineering role...

  • Data Engineer

    1 month ago


    Bangalore, Karnataka, India Spigot Software Full time

    Responsibility :- Design, develop, and maintain scalable data pipelines and analytics solutions using DBT, Snowflake, and related technologies- Collaborate with stakeholders to gather requirements and translate business needs into technical solutions- Develop efficient code with unit testing and code documentation- Ensuring accuracy and integrity of data and...

  • Data Engineer

    1 month ago


    Bangalore, Karnataka, India Easy Recruitz Full time

    Data engineer : Hadoop. Location : Bangalore (Hybrid). We are looking for an Engineer II to join our growing team of data experts. This role is responsible for developing, maintaining and optimizing data pipelines, delivering data timely to our cross-functional teams and support reporting and analytics. The Engineer will work closely with product partner,...

  • DevOps Engineer

    4 weeks ago


    Bangalore, Karnataka, India Marelli Full time

    Job description - DevOps engineer (software integration) Primary Responsibilities : - Design and implement CI/CD/CT pipelines to ensure quick and automatic release of code changes.- Develop, maintain, and enhance automation for software integration, testing, and deployment.- Automate manual processes in software integration via Python or Shell or other...


  • Bangalore, Karnataka, India The Metromax Group Full time

    Responsibilities : 1. Data for AI :- Design and implement data pipelines specifically tailored for AI training and model- development.- Partner with AI data scientists and engineers to understand their data needs and ensure- efficient data access.- Implement data pre-processing and feature engineering techniques for optimal model- performance.2. AWS...

  • DevOps Engineer

    1 month ago


    Bangalore, Karnataka, India Tekpillar Full time

    Job Title : DevOps EngineerExperience : 4 to 7 yearsLocation : BangaloreResponsibilities : - Design, implement, and maintain CI/CD pipelines using Jenkins and GitLab CI- Work with Groovy in Jenkins pipelines for automation and customization- Develop and maintain scripts using Python for automating tasks and solving problems- Debug and resolve issues in the...

  • Azure Data Engineer

    1 month ago


    Bangalore, Karnataka, India Softpath Technologies LLC Full time

    Job Description :In your role as an Azure Data Engineer, you will be responsible for expanding and optimising data and pipeline architectures, and for optimising data collection and flow across functional teams. Your responsibilities include assisting software developers, database architects, data analysts, and data scientists with data initiatives and...

  • DevOps Engineer

    1 month ago


    Bangalore, Karnataka, India Evoke HR Solutions Full time

    About the Job :We are seeking a seasoned DevOps Engineer to join our dynamic team and drive our software delivery process. As a DevOps Engineer, you will play a crucial role in automating and streamlining our infrastructure and application deployment pipelines.Key Responsibilities :Infrastructure as Code :- Design, implement, and maintain infrastructure as...

  • Data Engineer

    1 month ago


    Bangalore, Karnataka, India MNR Solutions Full time

    Job Description :We are looking for a skilled Gen AI Data Engineer to join our innovative team in Bangalore. The ideal candidate will have experience in data engineering with a focus on artificial intelligence (AI) and machine learning (ML) applications. This role will involve developing and optimizing data pipelines, enabling effective data management, and...

  • Azure DevOps Engineer

    1 month ago


    Bangalore, Karnataka, India GenZS Recruitment Solutions Full time

    Job Title : Azure DevOps EngineerExperience : 3+ yearsLocation : BangaloreJob Type : Full-timeJob Summary :We are seeking a highly skilled Azure DevOps Engineer with 3+ years of experience to join our dynamic team in Bangalore. The ideal candidate will have in-depth knowledge of Azure cloud services, strong experience with CI/CD pipelines, and expertise in...

  • Data Engineer

    3 weeks ago


    Bangalore, Karnataka, India DIATOZ Solutions Pvt ltd., Full time

    Role Description :This is a full-time hybrid role for a Data Engineer at DIATOZ. The Data Engineer will be responsible for tasks such as data engineering, data modeling, ETL processes, data warehousing, and data analytics. The role is primarily located in Bengaluru with flexibility for remote work.Experience : 2.5 to 5 yearsKey Responsibilities : Data...