Senior Data Pipeline Engineer

3 days ago


Bengaluru, India Tata Consultancy Services Full time

Greetings from TCSJob Title: Senior Data EngineeerRequired Skillset: Azure Data Factory, Databricks, Delta Live Tables, Python, SQL, Terraform, YAML, Azure Services, Data Warehousing, CI/CD, Data Governance, Purview, Informatica.Location: KolkataExperience Range: 8+yrs Job DescriptionMust-Have** Strong proficiency in Azure Data Factory, Databricks, Delta Live Tables.Solid experience with Python, SQL, YAML, and Terraform.Hands-on experience in building and optimizing scalable data pipelines.Expertise in Data Warehousing, Lakehouse Architecture, and Data Modelling.Knowledge of CI/CD practices and data governance tools like Purview or Informatica. Good To Have:Experience in Machine Learning integration and collaboration with data scientistsKnowledge of metadata management and observability frameworksStrong stakeholder engagement and communication skillsExperience in Australian Energy or Utilities domain Responsibility of / Expectations from the Role: Design, build, and optimize scalable data pipelines using Azure Data Factory, Databricks, and Delta Live Tables.Implement ETL processes across diverse data assets ensuring data quality and performance.Develop and manage data warehouses and lakehouses for structured and semi-structured data.Ensure compliance with data security, governance, and privacy standards using Purview and Informatica.Collaborate with data scientists and ML engineers to operationalize machine learning pipelines.Implement CI/CD pipelines for automating data pipeline deployments.Translate complex technical solutions into business insights for stakeholders.Troubleshoot and resolve performance bottlenecks in data workflows.Thanks & RegardsLeo M M



  • Bengaluru, India Tata Consultancy Services Full time

    Role**: Senior Data EngineerRequired Technical Skill Set: Senior Data EngineerDesired Experience Range: 7 - 10 yrsNotice Period: Immediate to 90Days onlyLocation of Requirement: BangaloreWe are currently planning to do a Virtual Interview Job Description:Python, Scala/Java, Spark, SQL, Snowflake, Airflow, Databricks, AWS Big data technologiesDesign, develop,...


  • Bengaluru, India AVIN ENGINEERING CONSULTANCY Full time

    Company Description AVIN Engineering, based in Bangalore, India, specializes in consultancy services for both offshore and onshore pipeline engineering, subsea services, and project management within the oil and gas industry. Our team of dedicated engineers excels in conceptual design, FEED, detailed engineering design, construction, and commissioning,...


  • Bengaluru, Karnataka, India DNEG Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Brahma is a pioneering enterprise AI company developing Astras, AI-native products built to help enterprises and creators innovate at scale. Brahma enables teams to break creative bottlenecks, accelerate storytelling, and deliver standout content with speed and efficiency. Part of the DNEG Group, Brahma brings together Hollywood's leading creative...


  • Bengaluru, India Coforge Full time

    AWS Data EngineerJob Location: BengaluruExperience Required: 5+ YearsMandatory Skills: AWS Services, ETL, ETL Integration, CodePipeline, Jenkins, Glue, EMR, Athena, ECS, EKS, Kubernetes, CloudWatch, Prometheus, Grafana, Python, Shell, or PowerShellJob Description:We are looking for an experienced AWS Engineer with around 5-8 years of hands-on experience in...


  • Bengaluru, Karnataka, India DNEG Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Brahma is a pioneering enterprise AI company developing Astras, AI-native products built to help enterprises and creators innovate at scale.Brahma enables teams to break creative bottlenecks, accelerate storytelling, and deliver standout content with speed and efficiency.Part of the DNEG Group, Brahma brings together Hollywoods leading creative...


  • Bengaluru, Karnataka, India NTT DATA Global Delivery Services Ltd Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    ERP Senior Specialist Job Title: Azure Senior Data Engineer We are looking a highly skilled and experienced Senior Azure Data Engineer to join our team. This role requires deep expertise in Azure Data Factory and Databricks, including CI/CD setup for Databricks, and strong proficiency in ETL, SQL, and modern data engineering practices. You will be the...


  • Bengaluru, India Bahwan CyberTek Full time

    Role Overview We are seeking a skilled and motivated Data Engineer with 5–8 years of experience in building scalable data pipelines using Python, PySpark, and AWS services. The ideal candidate will have hands-on expertise in big data processing, orchestration using AWS Step Functions, and serverless computing with AWS Lambda. Familiarity with DynamoDB and...


  • Bengaluru, India People Tech Group Inc Full time

    We are Hiring - Data Engineer Bengaluru!Job Title: AWS Data EngineerLocation: BengaluruExperience: 5+YearsNotice : Immediate JoinersJob Summary:We are looking for a skilled and experienced Data Engineer with over 5 years of experience in data engineering and data migration projects. The ideal candidate should possess strong expertise in SQL, Python, data...


  • Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About the RoleAs a Senior Data Engineer cum Data Scientist, you will be a key contributor to designing, developing, and operating advanced data architectures, pipelines, and analytics solutions within the Palantir ecosystemYou will leverage your deep expertise in Palantir Foundry and Gotham platforms, combined with strong AI capabilities, to solve complex...

  • Data Engineer

    2 days ago


    Bengaluru, India Creeno Solutions Pvt ltd Full time

    Job Description : We are looking for a highly skilled Data Engineer with a strong background in designing, building, and maintaining scalable data pipelines and business intelligence solutions. The ideal candidate should have a solid mix of hands-on experience in Azure cloud services, SQL development, data integration, and reporting tools to support...