Senior Data Pipeline Engineer

2 weeks ago

Chennai, Tamil Nadu, India beBeeData Full time ₹ 18,00,000 - ₹ 24,00,000

Job Description:

">

This role involves designing, developing and maintaining data pipelines in Amazon Web Services (AWS).

">

Key Responsibilities and Technical Skills:

">
  • ">
  • Technical Skills:">
    • ">
    • - ETL Tools: Talend">
    • - Database: Snowflake, Oracle, Amazon RDS (Aurora, Postgres), DB2, SQL server, and Cassandra">
    • - Big Data and Amazon Services: Apache Sqoop, AWS S3, Hue, AWS CLI, Amazon EMR, Amazon MSK, Amazon Sagemaker, Apache Spark">
    • - Data Modeling Tools: Archimate, Erwin, Oracle Data Modeler">
    • - Scheduling Tools: Autosys, SFTP, AirFlow">
    • Key Responsibilities:">
      • ">
      • - Designing, building and automating ETL processes using AWS services.">
      • - Developing and maintaining data pipelines to move and transform data from diverse sources into data warehouses or data lakes.">
      • - Ensuring data quality and integrity through validation, cleansing and monitoring ETL processes.">
      • - Optimizing ETL workflows for performance, scalability and cost efficiency within the AWS environment.">
      • - Troubleshooting and resolving issues related to data processing and ETL workflows.">
      • - Implementing and maintaining security measures and compliance standards for data pipelines and infrastructure.">
      • - Documenting ETL processes, data mappings and system architecture.">
      • - Implementing security measures such as IAM roles and access controls.">
      • - Diagnosing and resolving issues related to AWS services, infrastructure and applications.">
      • - Proficiency in Big Data tools and AWS services relevant to data storage and processing.">
      • - Strong SQL skills for querying databases and manipulating data during the transformation process.">
      • - Programming and scripting proficiency primarily in Python for automating tasks, developing custom transformations and interacting with AWS services via SDKs and APIs.">
      • - Data warehousing and modeling expertise including understanding data warehousing concepts, dimensional modeling and schema design to optimize data storage and retrieval.">
      • - Familiarity with DevOps practices including CI/CD pipelines and infrastructure as code.">
      • - Experience in Insurance domain.">
      ">
    ">

Benefits:

">
  • ">
  • Opportunity to work on cutting-edge ETL projects ">
  • Collaborative team environment ">
  • Professional growth opportunities">
">

  • Senior Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India Eucloid Data Solutions Full time US$ 1,50,000 - US$ 2,00,000 per year

    About The Role:Eucloid is looking for a senior Data Engineer with hands-on expertise in Databricks to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which may include starting from up- stream and down-stream...

  • Data Pipeline Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India beBeeDataPipelineEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Data Pipeline EngineerWe are seeking a skilled data engineer to design, build, and optimize data pipelines using industry-leading technologies. The ideal candidate will have hands-on experience in developing ETL jobs and writing optimized SQL queries.About the Role:Design and develop data pipelines for large-scale data processing.Collaborate with...

  • Advanced Data Pipeline Developer

    2 weeks ago

    Chennai, Tamil Nadu, India beBeeDataEngineering Full time ₹ 18,00,000 - ₹ 25,00,000

    Senior Data Engineer Job OpportunityWe are looking for a highly skilled Senior Data Engineer to lead our team in developing efficient data pipelines, following best practices and standards.Key Responsibilities:Develop scalable ETL pipelines that meet business requirements and adhere to company standards.Perform thorough integration testing of created...

  • Lead / Senior Pipeline Engineer

    1 week ago

    Chennai, Tamil Nadu, India KBR, Inc. Full time US$ 90,000 - US$ 1,20,000 per year

    TitleLead / Senior Pipeline EngineerJOB TITLE: Senior Technical Professional - PipelineREPORTS TO:Head of the DepartmentJOB LOCATION:Chennai, IndiaSummaryThe candidate will be part of a Team of Piping discipline involved in Oil and gas onshore / refinery/ gas gathering stations/ well pads/cross-country pipelineJob DetailsSenior Pipeline Engineer - More than...

  • Senior Data Pipeline Developer

    2 weeks ago

    Chennai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 2,51,20,000

    Data Engineer OpportunityWe are seeking an experienced data engineer to join our team in a role that will involve designing, developing, testing, and supporting data pipelines and applications using Python, PySpark, and SQL on AWS.Key Responsibilities:Designing and developing scalable and efficient data pipelines using Python, PySpark, and SQL on...

  • Senior Data Pipeline Specialist

    1 week ago

    Chennai, Tamil Nadu, India beBeeDataPipelineSpecialist Full time ₹ 15,00,000 - ₹ 25,00,000

    We are seeking a skilled Data Pipeline Specialist to lead our data engineering efforts. This is an exciting opportunity for an experienced professional to drive innovation and growth in our organization.About the RoleThis role will involve designing, developing, and maintaining scalable and robust data architectures and pipelines. The successful candidate...

  • Senior Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India Grethena Full time

    Company Description :Company : Grethena Private LimitedLocation : ChennaiExperience : 10+ yearsSalary : As per market standardsJob Title : Senior Data EngineerAbout us :Grethena - Shaping The Digital Landspace Our team of experts has years of experience in App, AI, OTT Platform and Booking App Development. We are passionate about helping our clients succeed...

  • Senior Data Pipeline Developer

    2 weeks ago

    Chennai, Tamil Nadu, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    \As a key member of our Data Engineering team, you will play a critical role in designing and developing scalable data infrastructure that supports business intelligence.\The ideal candidate has strong SQL skills, hands-on experience with cloud ETL tools, and a passion for building robust data pipelines.\Required Skills and Qualifications:\\5–8 years of...

  • Senior Data Pipeline Architect

    1 week ago

    Chennai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    About this roleWe're seeking a skilled Data Engineer to design, build and maintain scalable data pipelines and solutions. In this position, you'll work closely with cross-functional teams to ensure the availability, accuracy and performance of data infrastructure.Key responsibilities:Design, develop and maintain ETL/ELT data pipelines for batch and near...

  • Senior Data Pipeline Specialist

    1 week ago

    Chennai, Tamil Nadu, India beBeeEngineer Full time ₹ 15,00,000 - ₹ 28,00,000

    ETL Engineer PositionThis is an opportunity to become a crucial part of our ETL engineering team.As an ETL engineer, you will be responsible for ensuring the smooth flow of data through our pipelines and transformation processes. You will use your skills in data validation, SQL scripting, and testing to ensure the accuracy and completeness of our data.Key...