Senior Data Pipeline Architect

1 day ago


Chennai, Tamil Nadu, India Globalemployees Full time
Job Title: Senior Data Pipeline Architect

Globalemployees is seeking a skilled Senior Data Pipeline Architect to lead the design and implementation of our data engineering infrastructure. The successful candidate will have a strong background in data engineering and a proven track record of architecting scalable data pipelines.

Data Pipeline Architecture Overview

  • Architect and implement data pipelines to extract, transform, and load (ETL) data from various sources.
  • Design and develop data models and database systems to support data storage and retrieval.
  • Lead collaboration with data scientists and analysts to understand data needs and develop data solutions.
  • Develop, test, and maintain scalable data pipelines and ETL processes.
  • Ensure data integrity, security, and quality across data platforms.
  • Monitor and troubleshoot data pipeline performance.

Key Responsibilities:

  • Lead the design and implementation of data engineering workflows using Apache Spark, Kafka, and other tools.
  • Develop and maintain complex SQL queries and database schema.
  • Work closely with cross-functional teams to design and implement data-driven solutions.
  • Design and implement robust data validation and quality control mechanisms.

Requirements:

  • Proven experience in data engineering and ETL development.
  • Proficiency in SQL, Python, and data processing tools (e.g., Apache Spark, Kafka).
  • Familiarity with cloud platforms (AWS, GCP, Azure) and data warehousing.
  • Strong problem-solving and analytical skills.
  • Bachelor's degree in Computer Science, Data Engineering, or related field.

Estimated Salary: 170000 USD per year, depending on location and experience.



  • Chennai, Tamil Nadu, India Colan Infotech Pvt Ltd Full time

    Job Title: Data Pipeline ArchitectColan Infotech Pvt Ltd is looking for an experienced Data Pipeline Architect to join our team in Chennai. As a Data Pipeline Architect, you will design, develop, and maintain data pipelines and data warehouses on Google Cloud Platform (GCP).About the Role:Develop data pipelines using GCP tools like Dataflow, Dataproc, and...


  • Chennai, Tamil Nadu, India Walking Tree Full time

    Job Title: Data Pipeline Architect">About the Role:">We are seeking an experienced ETL Test Engineer to join our team at Walking Tree. As a key member of our data engineering team, you will design, implement and continuously expand data pipelines by performing extraction, transformation, and loading activities.">Your Responsibilities:">">Gather requirements...


  • Chennai, Tamil Nadu, India Hirexa Solutions Full time

    Job OverviewHirexa Solutions is seeking a highly skilled Data Pipeline Architect to design and implement efficient data pipelines using Scala and Spark.About the RoleThis is an exceptional opportunity for experienced professionals with strong expertise in big data technologies, scalable data processing, and API development.The ideal candidate will have 6+...


  • Chennai, Tamil Nadu, India Colan Infotech Private Limited Full time

    Greetings from Colan Infotech Private LimitedAs a Senior Data Engineer, you will be responsible for designing and developing scalable data pipelines using Pyspark / Scala Spark, Azure Databricks, Azure Data Factory, Azure Datalake, Python, and SQL.We are looking for an experienced professional who can optimize SQL queries for efficient data extraction and...


  • Chennai, Tamil Nadu, India Cynosure Corporate Solutions Full time

    Job DescriptionCynosure Corporate Solutions is looking for a highly skilled Data Pipeline Architect Lead to join our team. As a key member of our engineering team, you will be responsible for designing and implementing large-scale data pipelines using Hadoop/Spark ecosystem tools such as Sqoop, Spark, SQL, API, Hive, Oozie, Airflow, etc..About the RoleIn...


  • Chennai, Tamil Nadu, India Novac Technology Solutions Full time

    Senior Data ArchitectEstimated Salary: $120,000 - $180,000 per yearAbout UsNovac Technology Solutions is a leading fintech company that specializes in digital transformation and cloud solutions. We have strong technology and domain expertise in Financial Services, Insurance Services, Retail Solutions, and Digital Learning.Job DescriptionWe are seeking an...


  • Chennai, Tamil Nadu, India Novac Technology Solutions Full time

    Job Title: Senior Data ArchitectEstimated Salary: $120,000 - $180,000 per annum.About Novac Technology SolutionsWe are a leading fintech company with a focus on innovation and customer satisfaction. We work on exciting projects that impact the future of financial services and collaborate with a talented and diverse team in a supportive work environment.Job...


  • Chennai, Tamil Nadu, India Tata Consultancy Services Full time

    Job OverviewTata Consultancy Services is seeking an experienced Senior Cloud Data Architect to join our team. As a key member of our data engineering team, you will be responsible for designing and implementing large-scale data pipelines and architectures in Azure.


  • Chennai, Tamil Nadu, India U-Set Consultancy Private Limited Full time

    U-Set Consultancy Private Limited is seeking a skilled Senior Data Pipeline Developer to join our team. This role involves designing, executing, and maintaining test cases for ETL pipelines and data transformations. The ideal candidate will have experience working with one or more combinations of ETL tools, cloud platforms, and programming languages.Job...


  • Chennai, Tamil Nadu, India 1HResource Solutions Full time

    Job Description:About the RoleWe are seeking a highly skilled Senior Data Architect to join our team at 1HResource Solutions in Chennai. As a Senior Data Architect, you will be responsible for designing and implementing big data platforms to support large-scale data integration projects.Key Responsibilities:Designing, developing, and maintaining large-scale...


  • Chennai, Tamil Nadu, India BigIdea Technology Solutions Full time

    Job Title: Senior Snowflake Data Architect About the Role:We are seeking an experienced Senior Snowflake Data Architect to design, develop, and maintain efficient data storage and retrieval solutions within the Snowflake platform.The ideal candidate will have a deep understanding of data warehousing concepts, strong SQL skills, and experience in...


  • Chennai, Tamil Nadu, India Covenant Consultants Full time

    Job OverviewWe are seeking a seasoned data engineering expert to spearhead the design and development of our BigQuery-based data processing pipelines. This is a full-time, mid-level position that requires 4 to 6 years of experience in data warehousing and BQ.The successful candidate will have in-depth knowledge of SQL, ETL, and Big Data Technologies as...

  • Big Data Architect

    3 days ago


    Chennai, Tamil Nadu, India Trinity Technology solutions Full time

    We are Trinity Technology Solutions, a forward-thinking company seeking an exceptional Senior Cloud Data Engineer to drive the development and deployment of robust data pipelines and warehouse solutions on Google Cloud Platform (GCP). With over 5+ years of experience in big data engineering or a related field, you will leverage your expertise in big data...


  • Chennai, Tamil Nadu, India Colan Infotech Pvt Ltd Full time

    We're seeking an accomplished Azure Data Engineer to drive innovation in our data engineering department.Estimated Salary: ₹1,200,000 - ₹1,800,000 per annum.Role SummaryThis role involves designing and implementing robust data pipelines that cater to the company's data-driven initiatives. As an Azure Data Engineer, you'll work closely with...


  • Chennai, Tamil Nadu, India NTT DATA Full time

    About the Role We are currently seeking a Senior Cloud Solutions Architect to join our team in Chennai, Tamil Nādu (IN), India. As a Senior Cloud Solutions Architect at NTT DATA, you will be responsible for designing and implementing integrations using Oracle Integration Cloud (OIC). Your primary focus will be on connecting Oracle SaaS applications,...


  • Chennai, Tamil Nadu, India NTT DATA Services Full time

    We are seeking a highly skilled Senior Network Architect to join our team at NTT DATA Services.The ideal candidate will have strong experience with network virtualization, security, and cloud technologies, particularly in VMware NSX.As a Senior Network Architect, you will design, implement, and manage NSX solutions to enhance network performance, security,...


  • Chennai, Tamil Nadu, India Getronics Full time

    Job Summary:We are seeking an experienced Senior Cloud Data Architect to join our team at Getronics. The ideal candidate will have a strong background in data engineering and experience working with Google Cloud Platform.About the Role:This is a challenging and rewarding role that requires the ability to design, implement, and manage large-scale data systems...

  • Senior Data Engineer

    1 month ago


    Chennai, Tamil Nadu, India Wavicle Data Solutions Full time

    We are seeking an Experienced AWS Data Architect with a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. The ideal candidate will have a deep understanding of AWS services, data engineering best practices, and cloud architecture.Key Responsibilities:Design, develop, and maintain robust ETL pipelines on...


  • Chennai, Tamil Nadu, India Fedrus global Full time

    Data Engineering Team LeadFedrus Global seeks an accomplished Senior Data Engineer to lead our data engineering team. As a seasoned expert in data engineering, you will be responsible for overseeing the design and implementation of end-to-end data pipelines, collaborating with cross-functional teams, and driving innovation in data solutions.Main...


  • Chennai, Tamil Nadu, India Alp Consulting Ltd. Full time

    We are seeking a highly skilled Senior Azure Data Architect to join Alp Consulting Ltd.Key Responsibilities:Design and implement ETL processes using Azure Data Factory and SSIS to facilitate data extraction, transformation, and loading from various sources.Develop real-time data streaming solutions using Azure Stream Analytics and Azure Event Hubs to support...