Senior Cloud Data Engineer
5 days ago
Job Description Senior Cloud Data Engineer 241 Key Responsibilities - Develop and maintain end-to-end data pipelines for ingesting, wrangling, transforming, and joining data from diverse sources. - Design and implement scalable, high-performance ETL pipelines using tools such as AWS Glue, Databricks, Apache Airflow, and DataProc. - Develop data models, schemas, and storage solutions for relational, NoSQL, and lakehouse environments (Snowflake, BigQuery, Delta Lake). - Optimize data pipelines for performance and cost, including infrastructure considerations. - Implement CI/CD pipelines for data solutions and infrastructure using tools like GitHub Actions, Jenkins, Terraform, or similar. - Collaborate with teams to define architecture, design patterns, and reusable solutions for complex distributed systems. - Perform code reviews, debugging, testing, and validation to ensure high-quality and reliable data solutions. - Monitor pipeline performance, identify defects, perform root cause analysis (RCA), and implement preventive measures. - Work with AI/ML teams to enable LLM-based data classification, data enrichment, and data governance automation. - Support documentation, including design documents, architecture diagrams, source-target mappings, test cases, and release notes. - Mentor and guide team members on best practices, coding standards, and technical certifications. - Interface with stakeholders to clarify requirements, present design options, and provide guidance on implementation. Required Skills & Expertise - Strong proficiency in Python, PySpark, and SQL for large-scale data processing. - Hands-on experience with cloud platforms (AWS, Azure, or GCP) and their data services (S3, Redshift, RDS, BigQuery, Lambda, Glue, DataProc, CloudFormation, CloudWatch). - Extensive experience in ETL pipeline development, data lakes, data warehouses, and distributed systems. - Knowledge of IaC tools such as Terraform for provisioning and managing cloud infrastructure. - Experience with CI/CD pipelines and DevOps practices for data and infrastructure deployment. - Familiarity with data governance, compliance, security, and performance optimization. - Experience with NoSQL databases (Document DB, MongoDB, DynamoDB) and analytical data formats (Parquet, Iceberg). - Working knowledge of LLM integration for data classification, RAG workflows, or AI-assisted data processing is a plus. Skills: classification,design,infrastructure,aws,cloud,ci,pipelines,cd,data,architecture
-
Senior Engineer, Data Engineering
6 days ago
India Data-Hat AI Full timeDepartment: Data Engineering & AI Solutions Reports To: Lead Data Solutions Architect Travel: International travel required (up to 30–40%) We are hiring a senior-level Data Engineer to lead the design, development, and optimization of high-performance data infrastructure that underpins mission-critical AI systems. With 12+ years of experience,...
-
Senior Cloud Engineer
4 days ago
Noida, Uttar Pradesh, India NTT DATA Global Delivery Services Ltd Full time ₹ 20,00,000 - ₹ 25,00,000 per yearSenior Cloud Engineer Advisor Req ID: 304573 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Senior Cloud Engineer Advisor to join our team in Noida, Uttar Pradesh (IN-UP),...
-
Data engineer
7 days ago
India Data-Hat AI Full timeDepartment: Data Engineering & AI Solutions Reports To: Lead Data Solutions Architect Travel: International travel required (up to 30–40%) Position Summary: We are hiring a senior-level Data Engineer to lead the design, development, and optimization of high-performance data infrastructure that underpins mission-critical AI systems. With 12+...
-
Senior/lead data engineer
7 days ago
India Eucloid Data Solutions Full timeAbout The Role: Eucloid is looking for a senior/ lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which may includestarting from up- stream and down-stream technology selection to...
-
Senior/Lead Data Engineer
7 days ago
India Eucloid Data Solutions Full timeAbout The Role: Eucloid is looking for a senior/ lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which may includestarting from up- stream and down-stream technology selection to...
-
Senior/Lead Data Engineer
1 week ago
India Eucloid Data Solutions Full timeAbout The Role: Eucloid is looking for a senior/ lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which may includestarting from up- stream and down-stream technology selection to...
-
Senior/Lead Data Engineer
7 days ago
India Eucloid Data Solutions Full timeAbout The Role: Eucloid is looking for a senior/ lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which may includestarting from up- stream and down-stream technology selection to...
-
Senior/Lead Data Engineer
1 week ago
India Eucloid Data Solutions Full timeAbout The Role:Eucloid is looking for a senior/ lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which may includestarting from up- stream and down-stream technology selection to designing...
-
Data Engineer
1 week ago
India Data-Hat AI Full timeDepartment: Data Engineering & AI Solutions Reports To: Lead Data Solutions Architect Travel: International travel required (up to 30–40%) Position Summary: We are hiring a senior-level Data Engineer to lead the design, development, and optimization of high-performance data infrastructure that underpins mission-critical AI systems. With 12+ years of...
-
Data Engineer
7 days ago
India Data-Hat AI Full timeDepartment: Data Engineering & AI Solutions Reports To: Lead Data Solutions Architect Travel: International travel required (up to 30–40%) Position Summary: We are hiring a senior-level Data Engineer to lead the design, development, and optimization of high-performance data infrastructure that underpins mission-critical AI systems. With 12+...
