
Scalable Cloud Data Pipelines Engineer
5 days ago
Design and implement scalable data pipelines using cloud services.
Key Responsibilities :
- Develop and maintain complex ETL/ELT workflows utilizing cloud-based tools like AWS Glue, Lambda, and Step Functions.
- Work with large datasets to optimize data processing for performance, scalability, and cost-effectiveness.
- Collaborate with cross-functional teams to identify bottlenecks and improve query performance on Redshift, Athena, and Glue.
- Apply in-depth knowledge of cloud services : EC2, S3, RDS, Lambda, IAM, VPC, CloudFormation, CloudWatch, etc.
- Experience with serverless architectures (AWS Lambda, API Gateway, Step Functions) and networking (VPC, Route 53, ELB, Security Groups, etc.).
- Proficiency in scripting languages such as Python or Bash and automation tools (AWS Systems Manager, AWS Lambda).
- Understanding of containerization (Docker, Kubernetes, AWS ECS, EKS, Fargate) and monitoring solutions (AWS CloudWatch, AWS X-Ray, ELK Stack).
- Expertise in working with databases (RDS, DynamoDB, Aurora, Redshift) and storage solutions (S3, EBS, EFS, Glacier).
- Knowledge of network connectivity options (AWS Direct Connect, Transit Gateway, VPN solutions).
-
Senior Data Pipeline Architect
5 days ago
Delhi, Delhi, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 25,00,000Data Engineering RoleAs a Data Engineer, you will play a vital role in designing and implementing scalable data pipelines. Your primary responsibility will be to ensure the integrity and accessibility of data for banking operations and analytics.Main Responsibilities :Develop robust ETL processes for efficient data extraction, transformation, and...
-
Cloud Data Engineer
2 days ago
Delhi, Delhi, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000We are seeking a highly skilled Senior Data Engineer with extensive experience in designing, developing and deploying large-scale data processing pipelines on AWS cloud infrastructure.About the RoleThe ideal candidate will have strong proficiency in AWS services such as Amazon S3, AWS Glue, AWS Lambda, and Amazon Redshift, as well as hands-on experience in...
-
Scalable Data Architect
2 days ago
Delhi, Delhi, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 35,00,000Build Scalable Data InfrastructureAs a seasoned data engineer, you will play a key role in shaping the future of our microdrama OTT app. Your primary responsibility will be designing and building scalable data pipelines, ETL/ELT workflows, and real-time systems to drive user insights, engagement tracking, and revenue optimization.You will own the data...
-
Cloud Data Engineer
3 weeks ago
Delhi, Delhi, India Lemongrass Full timeAbout LemongrassLemongrass is a software-enabled services provider, synonymous with SAP on Cloud, focused on delivering superior, highly automated Managed Services to Enterprise customers. Our customers span multiple verticals and geographies across the Americas, EMEA and APAC. We partner with AWS, SAP, Microsoft and other global technology leaders.We are...
-
Senior Cloud Data Engineer
6 days ago
Delhi, Delhi, India beBeeDataScientist Remote Work Freelance Full time ₹ 60,00,000 - ₹ 1,00,00,000We are seeking a highly skilled Python developer to join our organization. The ideal candidate will have a deep understanding of data integration and cloud-based solutions.Key Responsibilities:Data Pipeline Management: Design, implement, and manage cloud-based data pipelines using Azure and Google Cloud platforms to facilitate efficient data flow and...
-
Senior Data Pipeline Specialist
5 days ago
Delhi, Delhi, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Job SummaryWe are seeking a highly skilled Data Engineer to join our team at ns-global-corporation. The ideal candidate will have a passion for designing, developing, and optimizing scalable data pipelines on AWS to support analytics, reporting, and business intelligence needs.The role involves working with modern cloud-native services, migrating legacy data...
-
Chief Data Pipeline Architect
5 days ago
Delhi, Delhi, India beBeeCloud Full time ₹ 2,00,00,000 - ₹ 2,50,00,000Senior Data Engineer - Cloud Migration Expert"> Job Description: We are seeking a seasoned Data Engineer to lead the migration of our data pipelines from SAS to Google Cloud Platform (GCP) technologies. As a key member of our team, you will be responsible for designing and deploying reliable, scalable solutions tailored to our data landscape."> Key...
-
Senior Data Engineer
5 days ago
Delhi, Delhi, India Aptus Data Labs Full timeJob Title : Senior Data EngineerLocation : : 58 YearsEmployment Type : Full-TimeAbout the Role :Aptus Data Labs is looking for a talented and proactive Senior Data Engineer to help build the backbone of our enterprise data and AI initiatives. Youll work on modern data lake architectures and high-performance pipelines in AWS, enabling real-time insights and...
-
Cloud Data Engineer
2 days ago
Delhi, Delhi, India beBeeData Full time US$ 1,00,000 - US$ 1,70,000We are seeking a highly skilled professional to join our organization in a critical data engineering role.Job Summary:The ideal candidate will be responsible for designing and developing robust data pipelines that handle high-volume financial data.Design and develop end-to-end data pipelines for financial datasets, ensuring seamless integration with internal...
-
Senior Data Pipeline Engineer
3 days ago
Delhi, Delhi, India beBeeDataPipeline Full time ₹ 10,00,000 - ₹ 15,00,000Azure Data Factory Job Description", "We are seeking a skilled and experienced data pipeline engineer to join our team in designing and developing scalable and efficient data pipelines and ETL processes using Azure Data Factory.", "Responsibilities:", "", "Design and develop data pipelines and ETL processes using Azure Data Factory.", "Integrate data from...