Data Pipeline Engineer

1 month ago


Bangalore, India TekPillar Full time

Job Title : Data Pipeline Engineer

Location : Bangalore

Experience : 4-5 Years

About the Role :

Are you a skilled Data Pipeline Engineer looking to take your career to the next level? Join our dynamic team and work on cutting-edge data engineering solutions in a fast-paced environment You'll have the opportunity to design, implement, and optimize data pipelines that drive business insights and decision making. With a focus on scalability and performance, you'll collaborate closely with cross-functional teams to streamline data Responsibilities :


- Design, develop, and maintain efficient and scalable data pipelines for real-time and batch data processing.


- Utilize Python and SQL to handle complex data transformations and automate workflows.


- Leverage AWS cloud services (S3, Lambda, RDS, etc.) for seamless data integration, storage, and processing.


- Create, integrate, and manage REST APIs to enable smooth data flow between systems and applications.


- Ensure data quality, performance tuning, and monitoring of the data pipeline infrastructure.


- Collaborate with data scientists, analysts, and other engineers to deliver end-to-end data solutions.


Skills and Qualifications :


- Strong programming skills in Python for data manipulation and scripting.


- Advanced knowledge of SQL for querying, transformation, and optimization.


- Hands-on experience with AWS services for cloud-based data solutions.


- Proficient in developing and integrating REST APIs.


- Exposure to Docker and Kubernetes for containerization and orchestration is a plus.


- Excellent problem-solving skills and the ability to work in an agile environment.

(ref:hirist.tech)
  • Data Engineer

    1 week ago


    Bangalore/Pune, India Talentpro Edge Full time

    About the RoleWe are seeking a skilled Data Engineer to join our team at Talentpro Edge as a Pipeline Developer. As a seasoned professional, you will play a pivotal part in designing and implementing large-scale data pipelines using Google Cloud Platform (GCP) services. Your expertise in ETL logic, data structures, and scripting languages such as Python will...


  • Bangalore, India Innovatily Pvt. Ltd Full time

    About Us : Innovatily is dedicated to transforming data into actionable insights. We leverage cutting-edge technologies like Apache Spark and AWS Glue to build robust, scalable ETL pipelines that support our diverse data processing needs. We are seeking talented ETL Developers to join our team and help us scale our data infrastructure.Job Description : As an...

  • Hevo Data

    1 week ago


    Bangalore/Bangalore, India HEVO DATA Full time

    This role provides a great opportunity to own and build highly scalable and fault-tolerant platform services that will help support thousands of customers' data pipelines and load data reliability to the different cloud warehouses. These services are the core of the Hevo platform that helps provide building no code-low pipeline. Also, makes a huge...

  • Azure Data Engineer

    50 minutes ago


    Bangalore, India ACENET CONSULTING PRIVATE LIMITED Full time

    About Us : AceNet Consulting is a fast-growing global business and technology consulting firm specializing in business strategy, digital transformation, technology consulting, product development, start-up advisory and fund-raising services to our global clients across banking & financial services, healthcare, supply chain & logistics, consumer retail,...


  • Bangalore/Chennai, India ADVANSOFT Full time

    At Advansoft, we're seeking a skilled Data Engineer to join our team. This is an excellent opportunity for a motivated professional to take on new challenges and contribute to the growth of our company.Estimated Salary: ₹7-32 LPA (Lakhs Per Annum)About the Role:We are looking for an experienced Data Engineer who can design and implement efficient data...

  • Data Engineer

    1 month ago


    Bangalore, India Rcs groups Full time

    Roles and Responsibilities : - Develop and maintain scalable and reliable data pipelines to ingest data from various APIs into the AWS ecosystem.- Manage data storage solutions using S3 buckets, ensuring best practices in data organization and security.- Utilize AWS Redshift for data warehousing tasks, optimizing data retrieval and query performance.-...


  • Bangalore/Remote, India Infometry Full time

    Job Title: Data Engineer for Machine Learning Pipelines">About Infometry: We are a technology-driven company dedicated to delivering innovative solutions. Our mission is to empower businesses by harnessing the power of machine learning.">Salary: ₹15,00,000 - ₹25,00,000 per annum (dependent on experience)">Job Description:">Data Scientist Role: As a Data...

  • Senior Data Engineer

    1 month ago


    Bangalore/Karnataka, India Kloud9 Full time

    Job Description : As a Senior Data Engineer, you will partner with Software Engineers, Data Scientists and Business Intelligence Engineers. You will gain a deep understanding of our services and the data they produce and become our resident expert in how to transform that data into a format that is useful for analytics and business intelligence. You will...

  • Data engineer

    3 months ago


    Bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost...

  • Data Engineer

    3 months ago


    Bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and...

  • Junior Data Engineer

    1 month ago


    Chennai/Bangalore, India Selsoft Full time

    Job role : Junior data Engineer Location : Chennai / Bangalore Experience : 1-2 years Job Description : - Building and maintaining data pipelines and ETL processes - Managing data storage and ensuring data quality - Developing and maintaining databases and data warehouses - Working with data scientists and analysts to understand business...

  • Python Developer

    2 months ago


    bangalore, India Teamware Solutions Full time

    Role: Software Developer - Data PipelinesTeam: Alpha DataDepartment: DevelopmentLocation: BangaloreOverview:The Data Development group manages the lifecycle of data used for trading, back-testing, and research. The team works with quantitative researchers and tech teams to integrate, process, and serve data from various sources into the data...

  • Data Engineer

    2 months ago


    bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data EngineerLocation: Yemalur, BangaloreYour Key Responsibilities:Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders.Lead the architecture, design, and delivery of enterprise grade microservices.Deliver assigned projects within budgeted time, cost and agreed...

  • Data Engineer

    3 months ago


    bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and...

  • Data Engineer

    3 months ago


    bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders.Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and agreed...

  • Solution Engineer

    1 month ago


    Bangalore, India HEVO DATA Full time

    Overview :. We're seeking a talented Solutions Engineer with strong background in Data Domain to join our growing Sales team. You'll work one-on-one with the sales team to help discover our customers' business and technical needs and demonstrate how Hevo's platform can solve their real-time data replication needs. In this role, you will...

  • Python Developer

    2 months ago


    Bangalore, India Teamware Solutions Full time

    Role: Software Developer - Data Pipelines Team: Alpha Data Department: Development Location: Bangalore Overview: The Data Development group manages the lifecycle of data used for trading, back-testing, and research. The team works with quantitative researchers and tech teams to integrate, process, and serve data from various sources into...


  • bangalore, India Hevo Data Full time

    About HevoHevo is a simple, intuitive, and powerful No-code Data Pipeline platform that enables companies to consolidate data from multiple software for faster analytics.Doordash, Footlocker, Arhaus, Santander, and thousands of other data-driven companies have one thing in common. They all use Hevo Data’s fully managed Automated Pipelines to consolidate...


  • bangalore, India Hevo Data Full time

    About Hevo Hevo is a simple, intuitive, and powerful No-code Data Pipeline platform that enables companies to consolidate data from multiple software for faster analytics. Doordash, Footlocker, Arhaus, Santander, and thousands of other data-driven companies have one thing in common. They all use Hevo Data’s fully managed Automated Pipelines to...


  • Bangalore, India HEVO DATA Full time

    About Hevo : Ever wondered, what's common between Zepto, Napster, Curefit, Groww, Jumio, Cars24 ? They all super-charge their business growth with Hevo Data Pipelines. How? 2 of every 3 modern day companies are unable to take data driven decision making due to fragmented data across 100s business software. Hevo is a simple, intuitive, and powerful...