Data Pipeline Architect
2 days ago
Senior Software Engineer Job DescriptionWe are seeking a highly skilled and experienced Senior Software Engineer to join our team. The successful candidate will be responsible for designing data collection strategies, developing and maintaining robust and scalable data pipelines.The role is critical in our data ecosystem, delivering new analytical software solutions to access timely, accurate, and complete data for insights, products, and operational efficiency.Key Responsibilities:Design, develop, and maintain high-performance, fault-tolerant data ingestion pipelines using Python.Integrate with diverse data sources (databases, APIs, streaming platforms, cloud storage, etc.).Implement data transformation and cleansing logic during ingestion to ensure data quality.Monitor and troubleshoot data ingestion pipelines, identifying and resolving issues promptly.Collaborate with database engineers to optimize data models for fast consumption.Evaluate and propose new technologies or frameworks to improve ingestion efficiency and reliability.Develop and implement self-healing mechanisms for data pipelines to ensure continuity.Define and uphold Service Level Agreements and Service Level Objectives for data freshness, completeness, and availability.Participate in on-call rotation as needed for critical data pipeline issuesRequired Skills and Qualifications:6+ years of experience, ideally with background in Computer Science, working in software product companies.Extensive Python Expertise: Extensive experience in developing robust, production-grade applications with Python.Data Collection & Integration: Proven experience collecting data from various sources (REST APIs, OAuth, GraphQL, Kafka, S3, SFTP, etc.).Distributed Systems & Scalability: Strong understanding of distributed systems concepts, designing for scale, performance optimization, and fault tolerance.Cloud Platforms: Experience with major cloud providers (AWS or GCP) and their data-related services (e.g., S3, EC2, Lambda, SQS, Kafka, Cloud Storage, GKE).Database Fundamentals: Solid understanding of relational databases (SQL, schema design, indexing, query optimization). OLAP database experience is a plus (Hadoop), Clickhouse.Monitoring & Alerting: Experience with monitoring tools (e.g., Prometheus, Grafana) and setting up effective alerts.Version Control: Proficiency with Git.Containerization (Plus): Experience with Docker and Kubernetes.Streaming Technologies (Plus): Experience with real-time data processing using Kafka, Flink, Spark Streaming.
-
Data/Enterprise Architect
2 weeks ago
India Aptus Data Labs Full timeAptus Data Labs is a leading Data and AI company specializing in Pharma, Manufacturing & Supply Chain, Banking & FinTech, and Technology domains. We offer innovative analytical solutions and consulting services to help businesses make quick, data-driven decisions essential for growth and sustainability in evolving industries. Leveraging cutting-edge...
-
Enterprise Data Architect
2 weeks ago
India Aptus Data Labs Full timeCompany Description Aptus Data Labs is a leading Data and AI company specializing in Pharma, Manufacturing & Supply Chain, Banking & FinTech, and Technology domains. We offer innovative analytical solutions and consulting services to help businesses make quick, data-driven decisions essential for growth and sustainability in evolving industries. Leveraging...
-
Enterprise Data Architect
2 weeks ago
India Aptus Data Labs Full timeCompany Description Aptus Data Labs is a leading Data and AI company specializing in Pharma, Manufacturing & Supply Chain, Banking & FinTech, and Technology domains. We offer innovative analytical solutions and consulting services to help businesses make quick, data-driven decisions essential for growth and sustainability in evolving industries. Leveraging...
-
Enterprise Data Architect
2 weeks ago
India Aptus Data Labs Full timeCompany Description Aptus Data Labs is a leading Data and AI company specializing in Pharma, Manufacturing & Supply Chain, Banking & FinTech, and Technology domains. We offer innovative analytical solutions and consulting services to help businesses make quick, data-driven decisions essential for growth and sustainability in evolving industries. Leveraging...
-
Enterprise Data Architect
2 weeks ago
India Aptus Data Labs Full timeCompany DescriptionAptus Data Labs is a leading Data and AI company specializing in Pharma, Manufacturing & Supply Chain, Banking & FinTech, and Technology domains. We offer innovative analytical solutions and consulting services to help businesses make quick, data-driven decisions essential for growth and sustainability in evolving industries. Leveraging...
-
Highly Skilled Data Pipeline Architect
1 week ago
india beBeeData Full timeCloud Data Engineer Job DescriptionLemongrass is seeking an experienced Cloud Data Engineer with a strong background in AWS, Azure, and GCP.Key Responsibilities:Design, develop, and maintain scalable data pipelines using cloud-native tools (AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow).Architect and implement data lakes and data warehouses on...
-
Data Observability Architect
6 days ago
India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per yearReq ID: 349022NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Observability Architect to join our team in Remote, Karnātaka (IN-KA), India (IN). "Job Duties: OverviewWe are...
-
MLOps Architect
5 days ago
Hyderabad, India NTT Data Full timeJob Description Key Responsibilities: . Build and maintain ML pipelines for training, validation, deployment, and monitoring . Implement CI/CD for ML artifacts, including data versioning and model registries . Monitor model performance and drift trigger retraining workflows as needed . Manage infrastructure (cloud, containerized, on-prem) for...
-
AI Engineer
2 weeks ago
India BeGig Full timeJob Role- AI Engineer (Data Pipelines & RAG)Job Type- Full-timeWork Mode- Remote(6 days working) We are looking for a hands-on AI/Data Engineer (4–7 years) to build and scale data pipelines powering GenAI and agentic applications. You’ll architect data models, build ETL/ELT workflows, and integrate pipelines with RAG-based systems in a fast-paced startup...
-
Senior Data Engineer
4 days ago
Bengaluru, India NTT Data Full timeJob Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Senior Data Engineer / Developer (Pipelines & Analytics) to join our team in Bangalore, Karntaka (IN-KA), India (IN)....
