Data Pipeline Architect

1 day ago


Chennai, Tamil Nadu, India Colan Infotech Pvt Ltd Full time
Job Title: Data Pipeline Architect

Colan Infotech Pvt Ltd is looking for an experienced Data Pipeline Architect to join our team in Chennai. As a Data Pipeline Architect, you will design, develop, and maintain data pipelines and data warehouses on Google Cloud Platform (GCP).

About the Role:

  • Develop data pipelines using GCP tools like Dataflow, Dataproc, and Cloud Functions.
  • Optimize data pipelines for performance and scalability.
  • Implement data quality checks and monitoring.
  • Design and implement data warehouses and data marts on GCP.
  • Model data for reporting and analytics.
  • Optimize query performance and data storage.
  • Analyze data to identify trends, patterns, and anomalies.
  • Create visualizations using tools like Data Studio or Looker.

Qualifications:

  • 5+ years of experience in data engineering.
  • Strong proficiency in SQL and experience with database technologies.
  • Hands-on experience with GCP services, including BigQuery, Dataflow, Dataproc, Cloud Storage, and Dataform.
  • Experience with data warehousing concepts and methodologies.
  • Knowledge of data modeling and ETL processes.
  • Familiarity with cloud computing platforms and services.
  • Excellent problem-solving and analytical skills.
  • Strong communication and collaboration skills.
  • Ability to work effectively in a fast-paced and dynamic environment.

Estimated Salary: ₹1,200,000 - ₹2,400,000 per annum



  • Chennai, Tamil Nadu, India Globalemployees Full time

    Job Title: Senior Data Pipeline ArchitectGlobalemployees is seeking a skilled Senior Data Pipeline Architect to lead the design and implementation of our data engineering infrastructure. The successful candidate will have a strong background in data engineering and a proven track record of architecting scalable data pipelines.Data Pipeline Architecture...


  • Chennai, Tamil Nadu, India Walking Tree Full time

    Job Title: Data Pipeline Architect">About the Role:">We are seeking an experienced ETL Test Engineer to join our team at Walking Tree. As a key member of our data engineering team, you will design, implement and continuously expand data pipelines by performing extraction, transformation, and loading activities.">Your Responsibilities:">">Gather requirements...


  • Chennai, Tamil Nadu, India Hirexa Solutions Full time

    Job OverviewHirexa Solutions is seeking a highly skilled Data Pipeline Architect to design and implement efficient data pipelines using Scala and Spark.About the RoleThis is an exceptional opportunity for experienced professionals with strong expertise in big data technologies, scalable data processing, and API development.The ideal candidate will have 6+...


  • Chennai, Tamil Nadu, India Cynosure Corporate Solutions Full time

    Job DescriptionCynosure Corporate Solutions is looking for a highly skilled Data Pipeline Architect Lead to join our team. As a key member of our engineering team, you will be responsible for designing and implementing large-scale data pipelines using Hadoop/Spark ecosystem tools such as Sqoop, Spark, SQL, API, Hive, Oozie, Airflow, etc..About the RoleIn...


  • Chennai, Tamil Nadu, India Colan Infotech Private Limited Full time

    Greetings from Colan Infotech Private LimitedAs a Senior Data Engineer, you will be responsible for designing and developing scalable data pipelines using Pyspark / Scala Spark, Azure Databricks, Azure Data Factory, Azure Datalake, Python, and SQL.We are looking for an experienced professional who can optimize SQL queries for efficient data extraction and...


  • Chennai, Tamil Nadu, India Covenant Consultants Full time

    Job OverviewWe are seeking a seasoned data engineering expert to spearhead the design and development of our BigQuery-based data processing pipelines. This is a full-time, mid-level position that requires 4 to 6 years of experience in data warehousing and BQ.The successful candidate will have in-depth knowledge of SQL, ETL, and Big Data Technologies as...


  • Chennai, Tamil Nadu, India Colan Infotech Pvt Ltd Full time

    We're seeking an accomplished Azure Data Engineer to drive innovation in our data engineering department.Estimated Salary: ₹1,200,000 - ₹1,800,000 per annum.Role SummaryThis role involves designing and implementing robust data pipelines that cater to the company's data-driven initiatives. As an Azure Data Engineer, you'll work closely with...


  • Chennai, Tamil Nadu, India Tata Consultancy Services Full time

    About the RoleWe are seeking a skilled Data Engineer to join our team at Tata Consultancy Services. As an Azure Data Engineer, you will be responsible for designing, developing, and implementing large-scale data pipelines and data lakes/warehouses in a cloud environment.Job DescriptionThe successful candidate will have 4-7 years of experience in working with...


  • Chennai, Tamil Nadu, India Colan Infotech Private Limited Full time

    Colan Infotech Private Limited seeks a highly skilled Data Systems Architect to lead the design, development and maintenance of scalable data pipelines. The ideal candidate should have 4-8 years of experience in the field and be proficient in programming languages such as Python, SQL and Pyspark/Scala Spark.The successful candidate will work closely with...


  • Chennai, Tamil Nadu, India IT Source Global Full time

    We are seeking a highly skilled Cloud Data Architect and Engineer to join our team at IT Source Global. This role is responsible for designing and developing scalable, high-performance data processing and transformation pipelines using Apache Spark within Databricks.About the RoleThis is an exceptional opportunity to lead big data pipeline design and...


  • Chennai, Tamil Nadu, India Colan Infotech Private Limited Full time

    Job DescriptionWe are seeking an experienced Data Engineer to join our team at Colan Infotech Private Limited. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining scalable data pipelines using Pyspark / Scala Spark, Databricks, Python, and SQL.The ideal candidate will have strong programming skills...

  • Big Data Architect

    4 weeks ago


    Chennai, Tamil Nadu, India ADVANSOFT Full time

    Job Title: Big Data ArchitectWe are looking for an experienced Big Data Architect to join our team at AdvanSoft.Estimated Salary: 7,000,000 - 32,000,000 INR per annum (approximately $90,000-$420,000 USD)About the RoleThe successful candidate will be responsible for designing and implementing scalable data pipelines that integrate raw data from various...


  • Chennai, Tamil Nadu, India Novac Technology Solutions Full time

    Senior Data ArchitectEstimated Salary: $120,000 - $180,000 per yearAbout UsNovac Technology Solutions is a leading fintech company that specializes in digital transformation and cloud solutions. We have strong technology and domain expertise in Financial Services, Insurance Services, Retail Solutions, and Digital Learning.Job DescriptionWe are seeking an...


  • Chennai, Tamil Nadu, India Bahwan CyberTek Full time

    **Job Title:** Snowflake ArchitectWe are seeking a skilled Snowflake Architect to lead and manage the design, implementation, and optimization of data warehouse solutions on Snowflake.**Salary Range:** ₹1200,000 - ₹1800,000 per annum (depending on location and experience)**Job Description:Key ResponsibilitiesDesign and implement Snowflake-based data...

  • Cloud Data Architect

    3 weeks ago


    Chennai, Tamil Nadu, India Altimetrik India Pvt. Ltd Full time

    Cloud Data Architect Job Description at Altimetrik India Pvt. LtdAbout the RoleWe are seeking an experienced Cloud Data Architect to design, build, and maintain robust data pipelines using Google Cloud Platform (GCP) tools.Responsibilities:Design and develop efficient data models in BigQuery and Bigtable, optimizing for performance and scalability to support...

  • Cloud Data Architect

    4 weeks ago


    Chennai, Tamil Nadu, India Tech Mahindra Full time

    We are seeking a skilled Cloud Data Architect to join our team at Tech Mahindra. As a Cloud Data Architect, you will play a crucial role in designing and implementing cloud-based data solutions that drive business growth and innovation.The ideal candidate will have experience working with GCP services such as Dataflow, BigQuery, and Data Composer, as well as...


  • Chennai, Tamil Nadu, India Collabera Full time

    Data Architect and ManagerThis is a full-time on-site role for a Data Architect and Manager at Collabera Digital in Pune or Chennai/Mumbai.The Data Architect and Manager will oversee the design and implementation of large-scale data systems, collaborating with cross-functional teams to drive business outcomes through data-driven insights.Position...


  • Chennai, Tamil Nadu, India Bahwan CyberTek Full time

    Job Title: Data Architect LeaderBahwan CyberTek Job DescriptionWe are seeking a highly skilled Data Architect Leader to lead and manage the design, implementation, and optimization of data warehouse solutions on Snowflake. The ideal candidate will have extensive experience in cloud data platforms, data architecture, and Snowflake's capabilities, working with...

  • Senior Data Engineer

    1 month ago


    Chennai, Tamil Nadu, India Wavicle Data Solutions Full time

    We are seeking an Experienced AWS Data Architect with a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. The ideal candidate will have a deep understanding of AWS services, data engineering best practices, and cloud architecture.Key Responsibilities:Design, develop, and maintain robust ETL pipelines on...


  • Chennai, Tamil Nadu, India U-Set Consultancy Private Limited Full time

    U-Set Consultancy Private Limited is seeking a skilled Senior Data Pipeline Developer to join our team. This role involves designing, executing, and maintaining test cases for ETL pipelines and data transformations. The ideal candidate will have experience working with one or more combinations of ETL tools, cloud platforms, and programming languages.Job...