
Data Pipeline Architect
1 week ago
This position involves the design, development and deployment of end-to-end data pipelines on AWS cloud infrastructure. The right candidate will have hands-on experience in working with services such as Amazon S3, AWS Glue, AWS Lambda and Amazon Redshift.
Responsibilities:
- Design and develop end-to-end data pipelines on AWS cloud infrastructure using services like Amazon S3, AWS Glue, AWS Lambda and Amazon Redshift.
- Implement data processing and transformation workflows using Apache Spark and SQL to support analytics and reporting requirements.
- Build and maintain orchestration workflows to automate data pipeline execution, scheduling and monitoring.
- Collaborate with analysts and business stakeholders to understand data requirements and deliver scalable data solutions.
- Optimize data pipelines for performance, reliability and cost-effectiveness, leveraging AWS best practices and cloud-native technologies.
Qualifications:
- Minimum 8+ years of experience building and deploying large-scale data processing pipelines in a production environment.
- Hands-on experience in designing and building data pipelines on AWS cloud infrastructure.
- Strong proficiency in AWS services such as Amazon S3, AWS Glue, AWS Lambda and Amazon Redshift.
- Apache Spark experience for data processing and analytics.
- Orchestration skills with AppFlow, Event Bridge and Lambda.
- Solid understanding of data modeling, database design principles and SQL and Spark SQL.
-
Senior Data Pipelines Architect
2 weeks ago
Lucknow, Uttar Pradesh, India beBeeDataPipeline Full time ₹ 20,00,000 - ₹ 25,00,000ETL Developer/Senior DeveloperDesign and develop scalable data pipelines using IBM DataStage and AWS Glue/Lambda.Collaborate with architects, business analysts, and data modelers to ensure timely delivery of critical data assets supporting analytics and AI/ML use cases.Required Skills:At least 4 years of experience in ETL development with at least 1–2...
-
Senior Data Pipeline Architect
2 weeks ago
Lucknow, Uttar Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 20,10,000We are seeking a skilled professional to design, build, and optimize scalable data pipelines in our organization.Key responsibilities include:Designing, building, and maintaining ETL/ELT pipelines using AWS Glue, Lambda, and DBT.Developing and optimizing data models in Snowflake for scalability and performance.Writing efficient and optimized SQL queries for...
-
Data Pipeline Specialist
4 days ago
Lucknow, Uttar Pradesh, India beBeeSnowflakeDataArchitect Full time ₹ 27,00,000 - ₹ 31,00,000Snowflake Data Architect PositionKey Role Summary:We are seeking a highly skilled Snowflake Expert with hands-on experience in Matillion ETL and proven expertise in the Banking, Financial Services domain.The ideal candidate will design, develop, and optimize scalable data pipelines, data models, and analytics solutions on Snowflake, ensuring compliance,...
-
Chief Data Pipeline Architect
1 week ago
Lucknow, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000Freelance Data Engineer JobThis is a freelance data engineer position where you will work with us to design and develop large-scale data pipelines.We require an experienced freelancer to collaborate with our teams and clients to deliver robust, scalable, and high-performance data solutions.Key Skills and QualificationsStrong expertise in Python and SQL with...
-
Expert Data Pipeline Architect
5 days ago
Lucknow, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 19,00,000Design and Develop Large-Scale Data PipelinesAs a Senior Data Engineer, you will be responsible for designing and developing large-scale data pipelines using Airflow. You will work closely with cross-functional teams to implement efficient data processing solutions.Key Responsibilities:Data Pipeline Design and DevelopmentCollaborate with data scientists and...
-
Senior Data Pipeline Specialist
2 days ago
Lucknow, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000About the RoleWe are looking for skilled professionals to design, develop, and manage data pipelines and transformation frameworks.As a key member of our team, you will work closely with data architects, platform engineers, and DevOps teams to build scalable, resilient, and efficient data engineering solutions using modern tools and best practices.Design and...
-
Chief Data Pipeline Architect
1 week ago
Lucknow, Uttar Pradesh, India beBeeDataEngineer Full time US$ 1,50,000 - US$ 2,00,000We are seeking a seasoned professional to spearhead the development of scalable data pipelines. The ideal candidate will have expertise in AWS cloud services and Databricks.Key Responsibilities:The Data Engineer will design, develop, and maintain data pipelines using AWS and Databricks.They will build and optimize ETL/ELT processes for large-scale...
-
Expert Data Architect
4 days ago
Lucknow, Uttar Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Job Title: Expert Data ArchitectWe are seeking an experienced data architect to join our dynamic team.The ideal candidate will be responsible for designing, implementing, and optimizing data pipelines on the Azure platform. You will work closely with data architects and other stakeholders to ensure data accessibility, reliability, and performance.Key...
-
Chief Data Architect
3 days ago
Lucknow, Uttar Pradesh, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,50,00,000Cloud Data Architect",'The Cloud Data Architect will design and implement robust, scalable data platforms using Azure services.",'">Data Pipeline Development: Design, build, and maintain robust and scalable data pipelines to ingest, transform, and load data from various sources into the cloud-based data platform. This includes creating and managing jobs,...
-
Data Architect
1 week ago
Lucknow, Uttar Pradesh, India beBeeData Full time ₹ 18,00,000 - ₹ 24,00,000Job SummaryWe are seeking a skilled Data Architect to design and develop scalable data pipelines that process and transform large volumes of structured and unstructured data.Key Responsibilities:Design and implement data architectures for processing structured and unstructured data.Build and maintain ETL/ELT workflows for data ingestion from diverse sources...