Data Pipeline Optimizer

2 days ago


Bengaluru, Karnataka, India ACENET CONSULTING PRIVATE LIMITED Full time
About the Role:
We are seeking an experienced Azure Data Engineer to join our team at AceNet Consulting Private Limited. As a data engineer, you will play a critical role in building, optimizing, and maintaining scalable data pipelines and models using Azure technologies. Your primary focus will be on ensuring data quality, integrity, and security while meeting business requirements.

Key Responsibilities:
- Design and develop ETL pipelines using Azure Data Factory
- Develop data models and Information Model objects (PO, Invoice, Vendor, etc.)
- Write optimized SQL queries with advanced functions (CTEs, Window Functions)
- Implement Spark optimizations (partitioning, AQE, large datasets)
- Troubleshoot and fix pipeline and code issues
- Handle large-scale data ingestion and transformations

Requirements:
- 3+ years of experience in data engineering with expertise in Azure technologies
- Strong understanding of data modeling, data warehousing, and business intelligence
- Excellent problem-solving skills with experience in scenario-based projects
- Strong communication and collaboration skills with experience working with cross-functional teams
- Bachelor's degree in Computer Science, Engineering, or related field
The estimated salary for this position is $100,000 - $160,000 per year.

  • Bengaluru, Karnataka, India NTT DATA Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team in Bangalore, India. This role involves designing, building, and maintaining scalable data pipelines using Databricks on AWS.The ideal candidate will have experience with Databricks, including Apache Spark development, and proficiency in Python or Scala for Spark job development....


  • Bengaluru, Karnataka, India Innovatily Pvt. Ltd Full time

    About Innovatily Pvt. Ltd.We are a data-driven company dedicated to transforming raw data into actionable insights. Our team leverages cutting-edge technologies like Apache Spark and AWS Glue to build robust, scalable ETL pipelines that support our diverse data processing needs.Job OverviewWe are seeking an experienced Data Engineer to join our team as an...


  • Bengaluru, Karnataka, India TekPillar Full time

    About the Role:Are you a skilled data professional looking to drive business insights and decision making? We're seeking a talented Data Pipeline Specialist to join our dynamic team and work on cutting-edge data engineering solutions in a fast-paced environment. You'll have the opportunity to design, implement, and optimize data pipelines that drive business...


  • Bengaluru, Karnataka, India Aditi Consulting Full time

    Aditi Consulting is a leading provider of data-driven solutions. We are looking for a skilled Data Pipeline Architect to join our team.Location: Bangalore/HybridEstimated Salary: ₹12,00,000 - ₹20,00,000 per annumCompany OverviewAt Aditi Consulting, we believe in harnessing the power of data to drive business decisions. Our team of experts works...


  • Bengaluru, Karnataka, India Neerinfo Solutions Full time

    Job RequirementsWe are seeking a highly skilled Cloud Data Infrastructure Specialist to join our team at Neerinfo Solutions. The successful candidate will be responsible for designing and implementing scalable cloud data infrastructure using AWS services.Key Responsibilities:Design, develop, and maintain AWS-based data pipelines using services such as AWS...


  • Bengaluru, Karnataka, India Hevo Data Full time

    Job Overview:As a Sales Development Representative at Hevo Data, you will be responsible for managing your account book and engaging with prospects to introduce and position Hevo as a one-stop solution for their data integration and pipeline needs.Key Accountabilities:Develop and execute territory plans to identify and pursue new business opportunitiesBuild...


  • Bengaluru, Karnataka, India Hevo Data Full time

    About Hevo DataWe're a San Francisco/Bangalore-based company with 2000+ customers across 45+ countries in e-commerce, financial technology, and healthcare.Our fully managed Automated Pipelines help data-driven companies like Doordash, Footlocker, Arhaus, Santander, and thousands more consolidate their data from multiple sources.We've raised $42 Million to...


  • Bengaluru, Karnataka, India TMRW Full time

    Job DescriptionWe are seeking a Big Data Infrastructure Specialist to design, develop, and maintain robust and scalable data pipelines for business intelligence and machine learning. The successful candidate will collaborate with data analysts, data scientists, and other data consumers within the business to manage the data warehouse table structure and...


  • Bengaluru, Karnataka, India Gloify Full time

    About the RoleGloify is looking for an experienced Data Engineer to create and manage our data pipeline infrastructure. This position requires strong technical skills in designing and implementing data pipelines, as well as collaboration with cross-functional teams.Main Tasks and Deliverables:Build, maintain and optimize data pipelines using various...


  • Bengaluru, Karnataka, India Rohini IT Consulting LLP Full time

    Data Integration SolutionsRohini IT Consulting LLP is seeking a highly skilled Ab Initio Developer to design, develop, and implement robust and efficient data pipelines using Ab Initio's powerful ETL capabilities. The successful candidate will have 2.5 to 8 years of hands-on experience in Ab Initio development and a strong understanding of Ab Initio...


  • Bengaluru, Karnataka, India Coders Brain Technology Private Limited Full time

    Job Overview: We are looking for a talented individual to lead our data modeling and pipeline optimization efforts. As a Senior Data Architect - DBT, you will be responsible for designing, building, and maintaining data models using DBT, implementing transformations to ensure data quality and consistency, and collaborating with data engineering teams to...


  • Bengaluru, Karnataka, India Luxoft Full time

    Project Overview:Luxoft is seeking a skilled Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems.About the Role:We are looking for an expert in data pipeline creation, data analysis, and query performance tuning within the Azure...


  • Bengaluru, Karnataka, India Gloify Full time

    About GloifyWe are seeking an experienced Data Pipeline Architect to design, develop, and maintain our data pipeline architecture.Our team works with cutting-edge technology, focusing on scalability and efficiency. As a key member of the team, you will contribute to creating and optimizing our data pipeline infrastructure.Responsibilities:Design and Optimize...


  • Bengaluru, Karnataka, India Powerplay Full time

    **Job Title:** Cloud Data Pipeline DeveloperWe are seeking a skilled Cloud Data Pipeline Developer to join our team at Powerplay.The successful candidate will design, implement, and maintain cloud-based data pipelines that meet the needs of our business teams and data scientists.Key Responsibilities:Develop secure and compliant data processing pipelines for...


  • Bengaluru, Karnataka, India DamcoSoft Pvt Ltd Full time

    About the Role:At DamcoSoft Pvt Ltd, we are looking for an experienced Big Data Engineer to lead our data initiatives and ensure optimal data delivery architecture. This role involves designing and implementing scalable data pipelines, assembling large complex data sets, and identifying internal process improvements.Responsibilities:Design and implement data...

  • Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India SG Analytics Pvt Limited Full time

    About SG AnalyticsWe are SG Analytics Pvt Limited, a leading research and analytics firm that offers datacentric research and contextual analytics services to companies across various sectors.Job DescriptionThe Data Engineer will be responsible for designing, building, and testing end-to-end data pipelines, including data ingestion, integration, and...


  • Bengaluru, Karnataka, India SMARTWORK IT SERVICES Full time

    Job Summary:We are looking for a talented Cloud Data Architecture Expert to join our team at SMARTWORK IT SERVICES in Pune or Bangalore. The successful candidate will design, implement, and optimize data pipelines and solutions for large-scale data processing and analytics using Snowflake, SQL, Python, and Azure.About the Role:The ideal candidate will have...


  • Bengaluru, Karnataka, India Aditi Consulting Full time

    Job Title: Data Pipeline Solutions SpecialistWe are seeking an experienced Data Pipeline Solutions Specialist to join our Data and Analytics team at Aditi Consulting. The ideal candidate will have a strong background in data pipelines, architectures, and data sets, with experience working with relational databases, query authoring (SQL), and various...


  • Bengaluru, Karnataka, India Jobeefie pvt ltd Full time

    About the RoleWe are seeking a skilled Data Pipelines Engineer to contribute to the design, development, and maintenance of efficient and scalable data pipelines at Jobeefie pvt ltd.Key Responsibilities:Design and Implementation: Develop robust ETL processes to extract, transform, and load data from various sources into target systems.SQL Query Writing:...


  • Bengaluru, Karnataka, India SIERA IT SERVICES PRIVATE LIMITED Full time

    Job Summary:We are seeking a talented Data Engineer to join our team at Siera IT Services Private Limited. As a Data Engineer, you will be responsible for designing and implementing data pipelines using Azure Databricks and Python, as well as ensuring compliance with best practices and quality measures.">Key Responsibilities:Design and implement data...