Data Pipeline Architect
4 days ago
Role - Data EngineerExperience - 6 to 11 years onlyLocations - Hyderabad or Bangalore or Noida, or ChennaiRequired Notice Period - Immediate Joiners Interview ProcessL1 - Bare Bot TestL2 - Face-to-Face at client locationMust Have Skills6 to 11 years of overall experienceShould have working experience with PythonShould have working experience with PySparkShould have working experience with AWS (Redshift or S3 or Glue or Lambda)Should have working experience with SQLShould have working experience with AirflowData Engineer: Role Summary:Supports data ingestion, transformations, and Redshift data pipeline development. Focuses on data validation, logging, and error handling.Strong experience in PySpark, Python, and SQL (MUST have)Working knowledge of AWS Glue, Redshift, and S3 (MUST have)Familiarity with JSON parsing and flattening (MUST have)Understanding of data pipeline error handling and logging (MUST have)Apache Airflow (DAG writing and scheduling (MUST have)Version control with GIT (MUST have)EMR exposure is good to haveAWS (S3, Glue, Redshift) is (MUST Have) (Glue is optional, though)Python (pandas, json, logging) (MUST Have)GitLab, AirflowTo apply, connect with Abhishek via abhishek.m@livecjobs.com or WhatsApp on 9154908075
-
Data Pipeline Architect
2 weeks ago
Hyderabad, India Logic Pursuits Full timeJob Title: Data Engineer (Snowflake + dbt/Matillion)Location: Hyderabad, IndiaJob Type: Full-timeJob Description:We are looking for an experienced and results-driven Data Engineer to join our growing Data Engineering team. The ideal candidate will be proficient in building scalable, high-performance data transformation pipelines using Snowflake and dbt, and...
-
AWS Data Pipeline Architect
3 weeks ago
Hyderabad, India Atyeti Inc Full timeRequired Skills & QualificationsBachelor’s or Master’s degree in Computer Science or equivalent experience5+ years of hands-on experience as an Application Developer or in similar software engineering rolesAdvanced skills in Python; strong SQL and cloud-native development experience (AWS)Proven expertise in architecting scalable data pipelines (ETL/ELT)...
-
Data Pipeline Architect
5 days ago
Hyderabad, India Tata Consultancy Services Full timeGreetings from TCS!TCS has always been in the spotlight for being adept in the next big technologies. What we can offer you is a space to explore varied technologies and quench your techie soul.We are hiring Data Engineer role for Hyderabad LocationRole: Data EngineerRequired Skill: Python ,Databricks ,SQLExperience: 6-8 yearsLocation: HyderabadMinimum...
-
Data Pipeline Architect
2 weeks ago
Hyderabad, India Tata Consultancy Services Full time- Advanced working Scala ,SQL,Python/PySpark knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases. - Experience building and optimizing ‘Cloud big data’ data pipelines, architectures and data sets. - Experience performing root cause analysis on internal and external...
-
Data Pipeline Specialist
2 weeks ago
hyderabad, India beBeeDataEngineer Full timeJob OverviewAs a Data Engineer, you will be responsible for designing and developing robust data pipelines and platforms that enable efficient storage, processing, and consumption of data across the enterprise.The role requires high-quality, timely, and governed data delivery to data scientists, analysts, and business users. You will play a crucial role in...
-
Cloud Data Pipeline Architect
2 weeks ago
Hyderabad, India Tata Consultancy Services Full timeROLE : Azure Data Factory E1Exp : 4 to 6Location : HyderabadJD:Role Overview We are seeking a highly skilled Azure Data Engineer with strong expertise in Azure Synapse Analytics and Microsoft Fabric. The ideal candidate will have hands-on experience in designing, developing, and maintaining scalable data solutions, modern data warehouses, and advanced...
-
Principal Data Pipeline Architect
2 weeks ago
Hyderabad, India ValueMomentum Full timeRole: Lead Data EngineerPrimary skills: Databricks, PySpark, SQLSecondary skills: Advanced SQL, Azure Data Factory, and Azure Data lake.Experience: 7 to 15 YearAbout the Job We are seeking a Tech Lead –Databricks Data Engineer with experience in designing and developing data pipelines using Azure Databricks, Data Factory, and Datalake.The role involves...
-
Ai Architects
1 week ago
Hyderabad, Telangana, India NTT DATA Full time**Req ID**: 341039 We are currently seeking a AI Architects to join our team in Hyderabad, Telangana (IN-TG), India (IN). **Location**: | **Experience**: 15+ years (5+ in AI/ML architecture) **Role Overview** **Key Responsibilities** - Architect and deliver **GenAI, LLM, and agentic AI solutions**: - Excellent understanding of Agentic Frameworks, MLOps,...
-
Principal Data Pipeline Engineer
7 days ago
Hyderabad, India Tech Mahindra Full timeWe are seeking a highly skilled and motivated Senior Data Engineer/s to architect and implement scalable ETL and data storage solutions using Microsoft Fabric and the broader Azure technology stack. This role will be pivotal in building a metadata driven data lake that ingests data from over 100 structured and semi structured sources, enabling rich insights...
-
MLOps Architect
3 weeks ago
Hyderabad, India NTT Data Full timeJob Description Key Responsibilities: . Build and maintain ML pipelines for training, validation, deployment, and monitoring . Implement CI/CD for ML artifacts, including data versioning and model registries . Monitor model performance and drift trigger retraining workflows as needed . Manage infrastructure (cloud, containerized, on-prem) for...