Data Pipeline Architect
3 weeks ago
At Advansoft, we're seeking a skilled Data Engineer to join our team. This is an excellent opportunity for a motivated professional to take on new challenges and contribute to the growth of our company.
Estimated Salary: ₹7-32 LPA (Lakhs Per Annum)
About the Role:
- We are looking for an experienced Data Engineer who can design and implement efficient data pipelines using Python and pSpark.
- The ideal candidate will have expertise in processing and transforming large volumes of data, ensuring scalability and performance.
- Our team collaborates closely with data scientists, analysts, and business stakeholders to deliver solutions that meet business needs.
Responsibilities:
- Develop and maintain data pipelines for ingesting raw data from various sources into the Hadoop ecosystem.
- Design and implement data models that facilitate efficient querying and analysis of structured and unstructured data.
- Maintain documentation for data pipelines, data models, and ETL processes to facilitate knowledge sharing and troubleshooting.
- Collaborate with cross-functional teams to understand data requirements and deliver solutions that meet business needs.
Required Skills and Qualifications:
- Strong expertise in Python, pSpark, Hadoop, Hive, and Airflow.
- Experience in job scheduling using Airflow.
Benefits:
As a Data Engineer at Advansoft, you will have opportunities for career growth and professional development, working with a talented team of professionals who share your passion for innovation and excellence.
Location: Bangalore, Chennai, Pune
Notice Period: Immediate to 15 days (serving notice period is preferred)
-
Data Pipeline Architect
3 weeks ago
Chennai, Tamil Nadu, India Colan Infotech Pvt Ltd Full timeJob Title: Data Pipeline ArchitectColan Infotech Pvt Ltd is looking for an experienced Data Pipeline Architect to join our team in Chennai. As a Data Pipeline Architect, you will design, develop, and maintain data pipelines and data warehouses on Google Cloud Platform (GCP).About the Role:Develop data pipelines using GCP tools like Dataflow, Dataproc, and...
-
Senior Data Pipeline Architect
3 weeks ago
Chennai, Tamil Nadu, India Globalemployees Full timeJob Title: Senior Data Pipeline ArchitectGlobalemployees is seeking a skilled Senior Data Pipeline Architect to lead the design and implementation of our data engineering infrastructure. The successful candidate will have a strong background in data engineering and a proven track record of architecting scalable data pipelines.Data Pipeline Architecture...
-
Data Pipeline Architect
2 weeks ago
Chennai, Tamil Nadu, India Engineering Services company Full time**Job Title:**We are seeking a highly skilled Data Pipeline Architect to design and implement large-scale data pipelines using Azure cloud services.The ideal candidate will have expertise in designing, developing, and maintaining scalable and efficient data pipelines using Azure Data Factory, Azure Databricks, and Azure Synapse Analytics.Key...
-
Data Pipeline Architect
1 month ago
Chennai, Tamil Nadu, India Walking Tree Full timeJob Title: Data Pipeline Architect">About the Role:">We are seeking an experienced ETL Test Engineer to join our team at Walking Tree. As a key member of our data engineering team, you will design, implement and continuously expand data pipelines by performing extraction, transformation, and loading activities.">Your Responsibilities:">">Gather requirements...
-
Data Pipeline Architect
3 weeks ago
Chennai/Noida/Gurgaon/Gurugram/Mumbai, India ANRI Solutions HR Services Full timeJob Title: Data Pipeline ArchitectWe are seeking an experienced Big Data Engineer to create end-to-end data pipelines. As a Data Pipeline Architect at ANRI Solutions HR Services, you will design and develop scalable data processing systems using Spark and Scala.About the Role:Expertise in Spark framework with Scala language and PySparkExperience in ETL and...
-
Data Pipeline Architect Lead
3 weeks ago
Chennai, Tamil Nadu, India Cynosure Corporate Solutions Full timeJob DescriptionCynosure Corporate Solutions is looking for a highly skilled Data Pipeline Architect Lead to join our team. As a key member of our engineering team, you will be responsible for designing and implementing large-scale data pipelines using Hadoop/Spark ecosystem tools such as Sqoop, Spark, SQL, API, Hive, Oozie, Airflow, etc..About the RoleIn...
-
Senior Data Pipeline Architect
1 month ago
Chennai/Noida/Gurgaon/Gurugram/Mumbai, India ANRI Solutions HR Services Full timeAbout the RoleWe are seeking a highly skilled Senior Data Pipeline Architect to join our team at ANRI Solutions HR Services. This is an exceptional opportunity to work with cutting-edge technologies and drive business growth.Key ResponsibilitiesDesign, develop, and implement end-to-end data pipelines using Spark and Scala.Collaborate with cross-functional...
-
Crayon Data | AI Architect
5 days ago
chennai, India Crayon Data Full timeRole:AI Architect Exp: 10 to 15 yrs Location: Chennai(Hybrid) In non-cloud Large Language Model (LLM) deployments, the AI Architect serves as a strategic leader, driving the alignment of AI solutions with business objectives while addressing critical challenges like scalability, governance, and security. Their role ensures sustainable and impactful AI...
-
Data architect
3 weeks ago
Bangalore, India Data Inc Full timeJob Title: Data Architect Location: Pune/Hyderabad/Bangalore Vacancy Type: Fixed Term contract (6 Months initial) Pay rate:- - Role purpose (overall high-level summary of the role) Data & Analytics Office (DAO) promotes a data-driven culture across bank through our strategy of: Fix The Back Book: To protect our data we need robust policies...
-
Cloud Data Pipeline Architect
3 weeks ago
Chennai, Tamil Nadu, India Colan Infotech Pvt Ltd Full timeWe're seeking an accomplished Azure Data Engineer to drive innovation in our data engineering department.Estimated Salary: ₹1,200,000 - ₹1,800,000 per annum.Role SummaryThis role involves designing and implementing robust data pipelines that cater to the company's data-driven initiatives. As an Azure Data Engineer, you'll work closely with...
-
Data Architect
3 weeks ago
Bangalore, India Data Inc Full timeJob Title: Data Architect Location: Pune/Hyderabad/Bangalore Vacancy Type: Fixed Term contract (6 Months initial) Pay rate:- - Role purpose (overall high-level summary of the role) Data & Analytics Office (DAO) promotes a data-driven culture across bank through our strategy of: Fix The Back Book: To protect our data we need robust policies...
-
Data architect
3 weeks ago
Bangalore, India Wipro Full timeGreetings....!!! This is regarding Job opportunity for Azure Data Architect Exp Range- 10 to 14years Job Description 10+ Years of Overall IT experience. 8+ Years of experience - Azure (Data Lake, ADB, ADF, ADLS, Functions, Synapse, Integration etc) , Spark, Scala, Hadoop 5+ Years of experience - Python, Py Spark, Pipeline Orchestration (Airflow),...
-
Senior Data Architect
2 weeks ago
Chennai, Tamil Nadu, India Wavicle Data Solutions Full timeJob Title: Senior Data Architect**Overview**We are seeking an experienced Senior Data Architect to join our team at Wavicle Data Solutions. The successful candidate will play a pivotal role in architecting and implementing data solutions, leveraging their expertise in managing data-related projects, including Data Engineering and Data Analytics...
-
Data Inc | Data Architect
3 weeks ago
bangalore, India Data Inc Full timeJob Title: Data ArchitectLocation: Pune/Hyderabad/BangaloreVacancy Type: Fixed Term contract (6 Months initial)Pay rate:- -Role purpose (overall high-level summary of the role)Data & Analytics Office (DAO) promotes a data-driven culture across bank through our strategy of:Fix The Back Book: To protect our data we need robust policies for data management and...
-
Data architect
3 weeks ago
Bangalore, India MPACT TRAINING AND DEVELOPMENT Full timeWe are seeking experienced, motivated andenthusiastic Data Architect to join our team. As part of the team, you will be involved in the implementation of the ongoing and new initiatives for our company and contribute to our mission of delivering high-quality data-driven solutions to our clients. Primary Skills: Snowflake, AWS/Azure data services, Data...
-
AI Architect
4 weeks ago
Chennai, India Crayon Data Full timeRole:AI ArchitectExp: 10 to 15 yrsLocation: Chennai(Hybrid)In non-cloud Large Language Model (LLM) deployments, the AI Architect serves as a strategic leader, driving the alignment of AI solutions with business objectives while addressing critical challenges like scalability, governance, and security. Their role ensures sustainable and impactful AI adoption...
-
Data Solutions Architect Lead
4 days ago
Chennai, Tamil Nadu, India Wavicle Data Solutions Full timeWavicle Data Solutions is seeking a highly experienced Data Solutions Architect Lead to join our team.Estimated salary for this role in the United States: $160,000 - $240,000 per year.About the RoleWe are looking for a seasoned professional with a strong background in data engineering and analytics. The ideal candidate will have experience leading...
-
Data Pipeline Engineer
1 month ago
Bangalore, India TekPillar Full timeJob Title : Data Pipeline EngineerLocation : BangaloreExperience : 4-5 YearsAbout the Role : Are you a skilled Data Pipeline Engineer looking to take your career to the next level? Join our dynamic team and work on cutting-edge data engineering solutions in a fast-paced environment! You'll have the opportunity to design, implement, and optimize data...
-
Data architect
4 weeks ago
Chennai, India Bahwan CyberTek Full timeJob Description: Snowflake Architect Position: Snowflake Architect Location: Chennai, Bangalore, Pune, Coimbatore Employment Type: Full-Time/ Permanent Role Overview: We are seeking a skilled Snowflake Architect to lead and manage the design, implementation, and optimization of data warehouse solutions on Snowflake. The ideal candidate will...
-
AI Architect
4 weeks ago
Chennai, India Crayon Data Full timeRole:AI Architect Exp: 10 to 15 yrs Location: Chennai(Hybrid) In non-cloud Large Language Model (LLM) deployments, the AI Architect serves as a strategic leader, driving the alignment of AI solutions with business objectives while addressing critical challenges like scalability, governance, and security. Their role ensures sustainable and impactful AI...