Senior Data Pipeline Engineer

3 days ago

Bengaluru, India Coforge Full time

AWS Data EngineerJob Location: BengaluruExperience Required: 5+ YearsMandatory Skills: AWS Services, ETL, ETL Integration, CodePipeline, Jenkins, Glue, EMR, Athena, ECS, EKS, Kubernetes, CloudWatch, Prometheus, Grafana, Python, Shell, or PowerShellJob Description:We are looking for an experienced AWS Engineer with around 5-8 years of hands-on experience in designing, deploying, and managing applications on the AWS cloud platform. The ideal candidate should have strong expertise in AWS services, automation, and cloud security, along with the ability to collaborate with cross-functional teams to deliver scalable and secure cloud solutions.Key Responsibilities5-8 years of professional work experience in a relevant fieldDesign, develop, and maintain scalable data pipelines and ETL workflows on AWS.Strong SQL skills and experience with structured/unstructured data processing.Ingest, process, and transform large datasets using AWS services (Glue, EMR, Athena, Redshift, Lambda).Build and optimize data lake and data warehouse solutions leveraging S3, Lake Formation, and Redshift Spectrum.Collaborate with stakeholders to design and integrate APIs/microservices for data access and consumption.Develop reusable, testable, and efficient code in Python/Java/Scala/Node.Js for data engineering solutions.Work with DevOps teams to automate deployments, manage CI/CD pipelines, and ensure reliability (CodePipeline, Jenkins, GitHub Actions).Build serverless solutions using AWS Lambda, API Gateway, and DynamoDB.Ensure best practices for data security, governance, monitoring, and cost optimization on AWS.Troubleshoot, optimize, and improve the performance of data workflows and applications.Required Skills & Qualifications5+ years of experience in data engineering with strong AWS expertise.Hands-on with AWS services such as Glue, EMR, Athena, Redshift, Lambda, S3, RDS, EC2, and VPC.Familiarity with CI/CD pipelines and DevOps practices for data deployments.Exposure to container orchestration (ECS, EKS, Kubernetes) and monitoring tools (CloudWatch, Prometheus, Grafana).Strong scripting skills in Python, Shell, or PowerShell.Education / Qualification:BE/ B.Tech / BCA / B.Sc. / M.CA / M.TECH / Any GraduatePlease share your resume at anshul.meshram@coforge.com

  • Senior Data Pipeline Engineer

    3 days ago

    Bengaluru, India Tata Consultancy Services Full time

    Greetings from TCS!Job Title: Senior Data EngineeerRequired Skillset: Azure Data Factory, Databricks, Delta Live Tables, Python, SQL, Terraform, YAML, Azure Services, Data Warehousing, CI/CD, Data Governance, Purview, Informatica.Location: KolkataExperience Range: 8+yrs Job DescriptionMust-Have** Strong proficiency in Azure Data Factory, Databricks, Delta...

  • Lead Data Pipeline Engineer

    5 days ago

    Bengaluru, India Tata Consultancy Services Full time

    Role**: Senior Data EngineerRequired Technical Skill Set: Senior Data EngineerDesired Experience Range: 7 - 10 yrsNotice Period: Immediate to 90Days onlyLocation of Requirement: BangaloreWe are currently planning to do a Virtual Interview Job Description:Python, Scala/Java, Spark, SQL, Snowflake, Airflow, Databricks, AWS Big data technologiesDesign, develop,...

  • Senior Pipeline Engineer

    2 days ago

    Bengaluru, Karnataka, India DNEG Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Brahma is a pioneering enterprise AI company developing Astras, AI-native products built to help enterprises and creators innovate at scale. Brahma enables teams to break creative bottlenecks, accelerate storytelling, and deliver standout content with speed and efficiency. Part of the DNEG Group, Brahma brings together Hollywood's leading creative...

  • Senior Pipeline Engineer

    1 week ago

    Bengaluru, Karnataka, India DNEG Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Brahma is a pioneering enterprise AI company developing Astras, AI-native products built to help enterprises and creators innovate at scale.Brahma enables teams to break creative bottlenecks, accelerate storytelling, and deliver standout content with speed and efficiency.Part of the DNEG Group, Brahma brings together Hollywoods leading creative...

  • Data Pipeline Engineer

    2 weeks ago

    Bengaluru, India Bahwan CyberTek Full time

    Role Overview We are seeking a skilled and motivated Data Engineer with 5–8 years of experience in building scalable data pipelines using Python, PySpark, and AWS services. The ideal candidate will have hands-on expertise in big data processing, orchestration using AWS Step Functions, and serverless computing with AWS Lambda. Familiarity with DynamoDB and...

  • Data Pipeline Engineer

    2 weeks ago

    Bengaluru, India People Tech Group Inc Full time

    We are Hiring - Data Engineer Bengaluru!Job Title: AWS Data EngineerLocation: BengaluruExperience: 5+YearsNotice : Immediate JoinersJob Summary:We are looking for a skilled and experienced Data Engineer with over 5 years of experience in data engineering and data migration projects. The ideal candidate should possess strong expertise in SQL, Python, data...

  • Senior Data Engineer cum Data Scientist

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About the RoleAs a Senior Data Engineer cum Data Scientist, you will be a key contributor to designing, developing, and operating advanced data architectures, pipelines, and analytics solutions within the Palantir ecosystemYou will leverage your deep expertise in Palantir Foundry and Gotham platforms, combined with strong AI capabilities, to solve complex...

  • Data Engineer

    3 days ago

    Bengaluru, India Creeno Solutions Pvt ltd Full time

    Job Description : We are looking for a highly skilled Data Engineer with a strong background in designing, building, and maintaining scalable data pipelines and business intelligence solutions. The ideal candidate should have a solid mix of hands-on experience in Azure cloud services, SQL development, data integration, and reporting tools to support...

  • Senior Pipeline Engineer

    1 week ago

    Bengaluru, India DNEG Full time

    Job Description Brahma is a pioneering enterprise AI company developing Astras, AI-native products built to help enterprises and creators innovate at scale. Brahma enables teams to break creative bottlenecks, accelerate storytelling, and deliver standout content with speed and efficiency. Part of the DNEG Group, Brahma brings together Hollywood's leading...

  • Data Pipeline Engineer

    2 weeks ago

    Bengaluru, India Cantordust Solutions LLC Full time

    Location: Preferred: Bangalore (On-site); Alternatives: Mumbai, Kathmandu (On-site)Type: Contract work, with potential for conversion to full time.Duration: September - December 2025Start Date: ImmediateWho We AreWe are recent MIT graduates experienced in digital transformation and AI, with expertise in various sectors including consulting, energy,...