
Chief Data Pipeline Architect
1 week ago
This is a freelance data engineer position where you will work with us to design and develop large-scale data pipelines.
We require an experienced freelancer to collaborate with our teams and clients to deliver robust, scalable, and high-performance data solutions.
Key Skills and Qualifications- Strong expertise in Python and SQL with at least 5 years of data engineering experience.
- Proficiency in PySpark, AWS services, and Databricks for ETL/ELT pipeline development.
- Hands-on experience with Linux/Bash scripting for automation and data operations.
- Familiarity with Agile and CI/CD practices.
You will be responsible for:
- Designing, developing, and maintaining large-scale data pipelines using PySpark, AWS, and Databricks.
- Performing data profiling, validation, and transformation using Python and SQL.
- Optimizing and monitoring workflows for performance, scalability, and cost efficiency.
- Troubleshooting and resolving data inconsistencies, configuration issues, and pipeline errors.
- Collaborating with cross-functional teams to define and implement data requirements.
- Ensuring thorough documentation and knowledge sharing across stakeholders.
This role offers the opportunity to work on challenging projects, gain experience working with our teams, and develop your skills in data engineering.
-
Chief Data Pipeline Architect
1 week ago
Lucknow, Uttar Pradesh, India beBeeDataEngineer Full time US$ 1,50,000 - US$ 2,00,000We are seeking a seasoned professional to spearhead the development of scalable data pipelines. The ideal candidate will have expertise in AWS cloud services and Databricks.Key Responsibilities:The Data Engineer will design, develop, and maintain data pipelines using AWS and Databricks.They will build and optimize ETL/ELT processes for large-scale...
-
Chief Data Architect
2 days ago
Lucknow, Uttar Pradesh, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,50,00,000Cloud Data Architect",'The Cloud Data Architect will design and implement robust, scalable data platforms using Azure services.",'">Data Pipeline Development: Design, build, and maintain robust and scalable data pipelines to ingest, transform, and load data from various sources into the cloud-based data platform. This includes creating and managing jobs,...
-
Data Pipeline Architect
1 week ago
Lucknow, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000Job Title: Senior AWS Data EngineerThis position involves the design, development and deployment of end-to-end data pipelines on AWS cloud infrastructure. The right candidate will have hands-on experience in working with services such as Amazon S3, AWS Glue, AWS Lambda and Amazon Redshift.Responsibilities:Design and develop end-to-end data pipelines on AWS...
-
Senior Data Pipelines Architect
2 weeks ago
Lucknow, Uttar Pradesh, India beBeeDataPipeline Full time ₹ 20,00,000 - ₹ 25,00,000ETL Developer/Senior DeveloperDesign and develop scalable data pipelines using IBM DataStage and AWS Glue/Lambda.Collaborate with architects, business analysts, and data modelers to ensure timely delivery of critical data assets supporting analytics and AI/ML use cases.Required Skills:At least 4 years of experience in ETL development with at least 1–2...
-
Chief Architect Position
2 weeks ago
Lucknow, Uttar Pradesh, India beBeeArchitect Full time ₹ 1,50,00,000 - ₹ 2,50,00,000We are seeking an accomplished Chief Architect to spearhead our architectural team.Main Responsibilities:Supervise the creation and development of large-scale infrastructure projectsCollaborate with cross-functional teams to ensure timely project completionMaintain technical standards for architectural designsProvide expert guidance on building codes, zoning...
-
Chief Data Architecture Strategist
4 days ago
Lucknow, Uttar Pradesh, India beBeeData Architect Full time ₹ 2,00,00,000 - ₹ 2,50,00,000About the RoleThis is an exceptional opportunity to lead the design, development, and implementation of data architecture, distributed systems, and machine learning platforms. In this role, you will oversee the creation of scalable, production-grade RESTful APIs that enable seamless integration across distributed systems and AI-powered applications.Key...
-
Data Pipeline Specialist
3 days ago
Lucknow, Uttar Pradesh, India beBeeSnowflakeDataArchitect Full time ₹ 27,00,000 - ₹ 31,00,000Snowflake Data Architect PositionKey Role Summary:We are seeking a highly skilled Snowflake Expert with hands-on experience in Matillion ETL and proven expertise in the Banking, Financial Services domain.The ideal candidate will design, develop, and optimize scalable data pipelines, data models, and analytics solutions on Snowflake, ensuring compliance,...
-
Senior Data Pipeline Architect
2 weeks ago
Lucknow, Uttar Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 20,10,000We are seeking a skilled professional to design, build, and optimize scalable data pipelines in our organization.Key responsibilities include:Designing, building, and maintaining ETL/ELT pipelines using AWS Glue, Lambda, and DBT.Developing and optimizing data models in Snowflake for scalability and performance.Writing efficient and optimized SQL queries for...
-
Chief Enterprise Data Architect
1 day ago
Lucknow, Uttar Pradesh, India beBeeEnterprise Full time ₹ 13,50,000 - ₹ 18,15,000We are seeking a skilled professional to architect end-to-end enterprise-grade data solutions that align with both business goals and technical strategy.This role involves designing scalable, secure, and aligned data architectures. The ideal candidate will have experience in architecting enterprise-level data solutions and proficiency with tools and...
-
Expert Data Pipeline Architect
5 days ago
Lucknow, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 19,00,000Design and Develop Large-Scale Data PipelinesAs a Senior Data Engineer, you will be responsible for designing and developing large-scale data pipelines using Airflow. You will work closely with cross-functional teams to implement efficient data processing solutions.Key Responsibilities:Data Pipeline Design and DevelopmentCollaborate with data scientists and...