Data Pipeline Architect

3 weeks ago


BangaloreChennai, India ADVANSOFT Full time

At Advansoft, we're seeking a skilled Data Engineer to join our team. This is an excellent opportunity for a motivated professional to take on new challenges and contribute to the growth of our company.

Estimated Salary: ₹7-32 LPA (Lakhs Per Annum)

About the Role:

  • We are looking for an experienced Data Engineer who can design and implement efficient data pipelines using Python and pSpark.
  • The ideal candidate will have expertise in processing and transforming large volumes of data, ensuring scalability and performance.
  • Our team collaborates closely with data scientists, analysts, and business stakeholders to deliver solutions that meet business needs.

Responsibilities:

  1. Develop and maintain data pipelines for ingesting raw data from various sources into the Hadoop ecosystem.
  2. Design and implement data models that facilitate efficient querying and analysis of structured and unstructured data.
  3. Maintain documentation for data pipelines, data models, and ETL processes to facilitate knowledge sharing and troubleshooting.
  4. Collaborate with cross-functional teams to understand data requirements and deliver solutions that meet business needs.

Required Skills and Qualifications:

  • Strong expertise in Python, pSpark, Hadoop, Hive, and Airflow.
  • Experience in job scheduling using Airflow.

Benefits:

As a Data Engineer at Advansoft, you will have opportunities for career growth and professional development, working with a talented team of professionals who share your passion for innovation and excellence.

Location: Bangalore, Chennai, Pune

Notice Period: Immediate to 15 days (serving notice period is preferred)



  • Chennai, Tamil Nadu, India Colan Infotech Pvt Ltd Full time

    Job Title: Data Pipeline ArchitectColan Infotech Pvt Ltd is looking for an experienced Data Pipeline Architect to join our team in Chennai. As a Data Pipeline Architect, you will design, develop, and maintain data pipelines and data warehouses on Google Cloud Platform (GCP).About the Role:Develop data pipelines using GCP tools like Dataflow, Dataproc, and...


  • Chennai, Tamil Nadu, India Globalemployees Full time

    Job Title: Senior Data Pipeline ArchitectGlobalemployees is seeking a skilled Senior Data Pipeline Architect to lead the design and implementation of our data engineering infrastructure. The successful candidate will have a strong background in data engineering and a proven track record of architecting scalable data pipelines.Data Pipeline Architecture...


  • Chennai, Tamil Nadu, India Engineering Services company Full time

    **Job Title:**We are seeking a highly skilled Data Pipeline Architect to design and implement large-scale data pipelines using Azure cloud services.The ideal candidate will have expertise in designing, developing, and maintaining scalable and efficient data pipelines using Azure Data Factory, Azure Databricks, and Azure Synapse Analytics.Key...


  • Chennai, Tamil Nadu, India Walking Tree Full time

    Job Title: Data Pipeline Architect">About the Role:">We are seeking an experienced ETL Test Engineer to join our team at Walking Tree. As a key member of our data engineering team, you will design, implement and continuously expand data pipelines by performing extraction, transformation, and loading activities.">Your Responsibilities:">">Gather requirements...


  • Chennai/Noida/Gurgaon/Gurugram/Mumbai, India ANRI Solutions HR Services Full time

    Job Title: Data Pipeline ArchitectWe are seeking an experienced Big Data Engineer to create end-to-end data pipelines. As a Data Pipeline Architect at ANRI Solutions HR Services, you will design and develop scalable data processing systems using Spark and Scala.About the Role:Expertise in Spark framework with Scala language and PySparkExperience in ETL and...


  • Chennai, Tamil Nadu, India Cynosure Corporate Solutions Full time

    Job DescriptionCynosure Corporate Solutions is looking for a highly skilled Data Pipeline Architect Lead to join our team. As a key member of our engineering team, you will be responsible for designing and implementing large-scale data pipelines using Hadoop/Spark ecosystem tools such as Sqoop, Spark, SQL, API, Hive, Oozie, Airflow, etc..About the RoleIn...


  • Chennai/Noida/Gurgaon/Gurugram/Mumbai, India ANRI Solutions HR Services Full time

    About the RoleWe are seeking a highly skilled Senior Data Pipeline Architect to join our team at ANRI Solutions HR Services. This is an exceptional opportunity to work with cutting-edge technologies and drive business growth.Key ResponsibilitiesDesign, develop, and implement end-to-end data pipelines using Spark and Scala.Collaborate with cross-functional...


  • chennai, India Crayon Data Full time

    Role:AI Architect Exp: 10 to 15 yrs Location: Chennai(Hybrid) In non-cloud Large Language Model (LLM) deployments, the AI Architect serves as a strategic leader, driving the alignment of AI solutions with business objectives while addressing critical challenges like scalability, governance, and security. Their role ensures sustainable and impactful AI...

  • Data architect

    3 weeks ago


    Bangalore, India Data Inc Full time

    Job Title: Data Architect Location: Pune/Hyderabad/Bangalore Vacancy Type: Fixed Term contract (6 Months initial) Pay rate:- - Role purpose (overall high-level summary of the role) Data & Analytics Office (DAO) promotes a data-driven culture across bank through our strategy of: Fix The Back Book: To protect our data we need robust policies...


  • Chennai, Tamil Nadu, India Colan Infotech Pvt Ltd Full time

    We're seeking an accomplished Azure Data Engineer to drive innovation in our data engineering department.Estimated Salary: ₹1,200,000 - ₹1,800,000 per annum.Role SummaryThis role involves designing and implementing robust data pipelines that cater to the company's data-driven initiatives. As an Azure Data Engineer, you'll work closely with...

  • Data Architect

    3 weeks ago


    Bangalore, India Data Inc Full time

    Job Title: Data Architect Location: Pune/Hyderabad/Bangalore Vacancy Type: Fixed Term contract (6 Months initial) Pay rate:- - Role purpose (overall high-level summary of the role) Data & Analytics Office (DAO) promotes a data-driven culture across bank through our strategy of: Fix The Back Book: To protect our data we need robust policies...

  • Data architect

    3 weeks ago


    Bangalore, India Wipro Full time

    Greetings....!!! This is regarding Job opportunity for Azure Data Architect Exp Range- 10 to 14years Job Description 10+ Years of Overall IT experience. 8+ Years of experience - Azure (Data Lake, ADB, ADF, ADLS, Functions, Synapse, Integration etc) , Spark, Scala, Hadoop 5+ Years of experience - Python, Py Spark, Pipeline Orchestration (Airflow),...

  • Senior Data Architect

    2 weeks ago


    Chennai, Tamil Nadu, India Wavicle Data Solutions Full time

    Job Title: Senior Data Architect**Overview**We are seeking an experienced Senior Data Architect to join our team at Wavicle Data Solutions. The successful candidate will play a pivotal role in architecting and implementing data solutions, leveraging their expertise in managing data-related projects, including Data Engineering and Data Analytics...


  • bangalore, India Data Inc Full time

    Job Title: Data ArchitectLocation: Pune/Hyderabad/BangaloreVacancy Type: Fixed Term contract (6 Months initial)Pay rate:- -Role purpose (overall high-level summary of the role)Data & Analytics Office (DAO) promotes a data-driven culture across bank through our strategy of:Fix The Back Book: To protect our data we need robust policies for data management and...

  • Data architect

    3 weeks ago


    Bangalore, India MPACT TRAINING AND DEVELOPMENT Full time

    We are seeking experienced, motivated andenthusiastic Data Architect to join our team. As part of the team, you will be involved in the implementation of the ongoing and new initiatives for our company and contribute to our mission of delivering high-quality data-driven solutions to our clients. Primary Skills: Snowflake, AWS/Azure data services, Data...

  • AI Architect

    4 weeks ago


    Chennai, India Crayon Data Full time

    Role:AI ArchitectExp: 10 to 15 yrsLocation: Chennai(Hybrid)In non-cloud Large Language Model (LLM) deployments, the AI Architect serves as a strategic leader, driving the alignment of AI solutions with business objectives while addressing critical challenges like scalability, governance, and security. Their role ensures sustainable and impactful AI adoption...


  • Chennai, Tamil Nadu, India Wavicle Data Solutions Full time

    Wavicle Data Solutions is seeking a highly experienced Data Solutions Architect Lead to join our team.Estimated salary for this role in the United States: $160,000 - $240,000 per year.About the RoleWe are looking for a seasoned professional with a strong background in data engineering and analytics. The ideal candidate will have experience leading...


  • Bangalore, India TekPillar Full time

    Job Title : Data Pipeline EngineerLocation : BangaloreExperience : 4-5 YearsAbout the Role : Are you a skilled Data Pipeline Engineer looking to take your career to the next level? Join our dynamic team and work on cutting-edge data engineering solutions in a fast-paced environment! You'll have the opportunity to design, implement, and optimize data...

  • Data architect

    4 weeks ago


    Chennai, India Bahwan CyberTek Full time

    Job Description: Snowflake Architect Position: Snowflake Architect Location: Chennai, Bangalore, Pune, Coimbatore Employment Type: Full-Time/ Permanent Role Overview: We are seeking a skilled Snowflake Architect to lead and manage the design, implementation, and optimization of data warehouse solutions on Snowflake. The ideal candidate will...

  • AI Architect

    4 weeks ago


    Chennai, India Crayon Data Full time

    Role:AI Architect Exp: 10 to 15 yrs Location: Chennai(Hybrid) In non-cloud Large Language Model (LLM) deployments, the AI Architect serves as a strategic leader, driving the alignment of AI solutions with business objectives while addressing critical challenges like scalability, governance, and security. Their role ensures sustainable and impactful AI...