Senior Data Pipeline Architect

1 day ago


Chennai, Tamil Nadu, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000
Job Description:">

As a data engineer, you will play a pivotal role in crafting and maintaining large-scale data pipelines. Leveraging Python and AWS (S3, Redshift, Lambda, Glue), you will ensure seamless data flow, optimize ETL processes, and guarantee data integrity, security, and accessibility.

Key Responsibilities:
  1. Develop and maintain robust data pipelines using Python and AWS (S3, Redshift, Lambda, Glue).
  2. Implement and optimize complex ETL processes for massive datasets.
  3. Ensure data consistency, confidentiality, and usability.
  4. Collaborate closely with teams to meet business data requirements.
  5. Possess 5+ years of experience in data engineering with Python and AWS.
  6. Hold strong knowledge of ETL tools (Glue, Talend, etc.) and SQL.
  7. Familiarity with data warehousing and modeling principles.


  • Chennai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 27,00,000

    Senior Data EngineerYou will play a key role in driving the development and implementation of our data pipeline, working closely with DW/BI leads to understand new ETL pipeline requirements.With 5+ years of experience, you will collaborate with stakeholders to identify gaps in existing pipelines and develop data models for reporting needs.As a seasoned data...


  • Chennai, Tamil Nadu, India beBeeDataPipeline Full time ₹ 18,00,000 - ₹ 24,00,000

    Job Title:Senior Test Engineer - Data Pipeline Specialist About the Job We are seeking an experienced Senior Test Engineer to drive testing strategy and execution for a project leveraging Databricks, Data Factory pipelines and Power BI. The ideal candidate will have expertise in testing data pipelines using Python, SQL, etc. Key Responsibilities Develop and...


  • Chennai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,04,000 - ₹ 1,30,878

    Job TitleAs a Data Engineer Lead, you will be responsible for developing and implementing ETL pipelines using Databricks on cloud AWS.The ideal candidate will have 5+ years of relevant experience and overall 8+ years of experience. They should be proficient in Python, PySpark, and SQL with hands-on experience developing data pipelines.Key qualifications...


  • Chennai, Tamil Nadu, India beBeeDataStrategist Full time ₹ 3,11,53,900 - ₹ 4,61,20,600

    Senior Data StrategistWe are seeking an experienced Senior Data Strategist to join our team.Develop and implement data-driven strategies to drive business growth and improve decision-making capabilities.Collaborate with cross-functional teams to design, develop, and deploy scalable data solutions that meet business requirements.Architect and design...


  • Chennai, Tamil Nadu, India beBeeInformatica Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Senior Data EngineerWe are seeking a highly skilled and experienced Informatica IDMC ETL Developer (Lead-Level) with a deep understanding of data pipeline development, data integration architecture, and Informatica Cloud Data Integration (CDI). The ideal candidate will have a strong background in developing, documenting, testing, and maintaining...


  • Chennai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Senior Databricks Engineer / Technical LeadJob Summary: We are seeking an experienced data engineer to develop modern data warehouse solutions using Databricks and Azure Stack.Key Responsibilities:Developing data engineering and analytics solutions using Databricks, Azure Stack, and Python/Pyspark.Collaborating with DW/BI leads to understand new...


  • Chennai, Tamil Nadu, India beBeesenior Full time ₹ 23,04,000 - ₹ 30,15,000

    Senior Test Engineer PositionWe are seeking a seasoned Senior Test Engineer to spearhead testing strategy and execution for a project involving Databricks, Data Factory pipelines, and Power BI. The ideal candidate will have expertise in testing data pipelines using Python, SQL, etc., along with experience in JIRA test management.Required Skills and...


  • Chennai, Tamil Nadu, India beBeeDataArchitecture Full time ₹ 1,80,00,000 - ₹ 2,20,00,000

    Data Architect and Engineering ManagerWe are seeking an accomplished Data Architect and Engineering Manager to lead our data engineering initiatives. This senior role will oversee the design, development, and implementation of large-scale data processing systems.Key Responsibilities:Develop and implement scalable data architecture designs using Python, AWS,...


  • Chennai, Tamil Nadu, India beBeeData Full time US$ 90,000 - US$ 1,20,000

    Job Title:Cloud Data Solutions ArchitectJob Description:We are seeking a highly skilled Cloud Data Solutions Architect to join our team. As a key member of our data engineering team, you will design and develop scalable and high-performance cloud-based data pipelines using Azure Data Factory (ADF).You will collaborate with cross-functional teams to integrate...

  • Data Architect

    5 days ago


    Chennai, Tamil Nadu, India Tata Consultancy Services Full time

    TCS is Hiring Data Architect For Pune and Chennai locationExperience : yearsMode of interview : VirtualLocation : Pune / ChennaiJOB DESCRIPTION:Must have:Proficiency in SQL, data modeling tools, and pipeline orchestration tools.Familiar with modern data stacks (Snowflake, Databricks, Apache Spark, Kafka).Hands-on experience with at least one major cloud...