
Senior Data Solution Architect
3 days ago
We're seeking a skilled Freelance Data Engineer to join our team. As a key member, you'll be responsible for crafting data pipelines using AWS services like Glue, PySpark, and Step Functions. Your expertise in pytest for testing and Git/GitHub for version control will ensure seamless collaboration and high-quality deliverables.
Key Responsibilities:- Data Pipeline Design: Develop scalable and efficient data pipelines utilizing AWS Glue, PySpark, and Step Functions.
- ETL/ELT Processes: Implement ETL/ELT processes for ingesting, transforming, and delivering data from multiple sources.
- Storage Solutions: Manage and optimize storage solutions with Amazon S3.
- Python Code: Write reusable and maintainable Python code for data engineering workflows.
- Unit and Integration Tests: Implement unit and integration tests using pytest to ensure data quality and pipeline reliability.
- Collaboration: Collaborate using Git/GitHub for version control, code reviews, and CI/CD integration.
- Technical Documentation: Create clear and concise technical documentation for pipelines, workflows, and design decisions.
- Troubleshooting: Troubleshoot and resolve issues related to data pipelines and AWS services.
- 5–10 years of data engineering experience, with at least 5 years in the AWS ecosystem.
- Strong coding skills in Python with experience in PySpark.
- Hands-on experience with AWS Glue, Step Functions, and S3.
- Proficiency in pytest for test automation.
- Solid understanding of Git/GitHub workflows.
- Excellent communication skills with a focus on documentation and knowledge sharing.
-
Senior Big Data Solutions Architect
1 day ago
Cochin, Kerala, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000We are seeking a seasoned Senior Big Data Solutions Architect to spearhead the design and implementation of our next-generation data warehouse. This visionary will lead the development of a scalable PostgreSQL-based data warehousing solution, leveraging open-source technologies and cloud infrastructure.Key Responsibilities:Data Engineering &...
-
Data Solutions Architect
4 days ago
Cochin, Kerala, India beBeeDataArchitect Full time ₹ 2,00,00,000 - ₹ 2,50,00,000Job Title: Data Solutions ArchitectAbout UsWe are a leading insurance company, with operations in 54 countries and territories. Our mission is to provide commercial and personal property and casualty insurance, personal accident and supplemental health insurance, reinsurance and life insurance to a diverse group of clients.Our VisionWe strive to be at the...
-
Data Architect
7 days ago
Cochin, Kerala, India beBeeData Full time ₹ 1,20,90,000 - ₹ 2,45,35,000Job DescriptionAs a Senior Data Architect in the Health Payer Domain, you will design and develop scalable, secure, and high-performance data architectures to drive business growth. You will lead the development of long-term data strategies and short-term tactical data solutions, ensuring alignment with business goals.The ideal candidate will have expertise...
-
Databricks Data Solutions Architect
5 days ago
Cochin, Kerala, India beBeeDataSolutions Full time ₹ 2,00,00,000 - ₹ 2,50,00,000**Job Title:** Databricks Data Solutions ArchitectDesign, develop and maintain scalable, secure and high-performance data pipelines and ETL processes on Databricks.Lead the architecture and implementation of data solutions that integrate multiple structured and unstructured sources into Delta Lake and cloud data warehouses.Collaborate with business...
-
Cloud Data Solutions Architect
4 days ago
Cochin, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000As a Cloud Data Solutions Architect, you will design and build robust data pipelines to efficiently ingest, process and deliver data insights.Main Responsibilities:Create scalable data solutions using cloud-based services to meet business objectives.Implement and maintain DevOps pipelines for seamless data workflows.Collaborate with cross-functional teams to...
-
Senior Data Architect
1 day ago
Cochin, Kerala, India beBeeDataExpert Full time ₹ 3,00,00,000 - ₹ 4,00,00,000As a senior data architect, you will be responsible for leading our organization's data strategy and governance initiatives.The ideal candidate will have a strong background in large-scale, distributed data systems and experience working with CPG/FMCG data use cases.You will oversee the development and implementation of modern data platforms, including...
-
Cloud Data Solutions Architect
3 days ago
Cochin, Kerala, India beBeeData Full time ₹ 12,50,000 - ₹ 21,50,000Job OpportunityWe are seeking an experienced professional to lead the design, implementation, and optimization of scalable data solutions.About the RoleThis is a challenging position that requires a deep understanding of data warehousing concepts and experience with structured, semi-structured, and unstructured data.Key Responsibilities:Architect and deliver...
-
Data Architect
7 days ago
Cochin, Kerala, India Qode Full time ₹ 15,00,000 - ₹ 20,00,000 per yearIntroductionWe are looking for candidates with 10 +years of experience in data architect role.Responsibilities include:• Design and implement scalable, secure, and cost-effective data architectures using GCP.• Lead the design and development of data pipelines with BigQuery, Dataflow, and Cloud Storage.• Architect and implement data lakes, data...
-
Principal Data Architect
21 hours ago
Cochin, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000Job Title:Strategic Data Solutions LeadExperience: 10 - 14 years of experience leading cross-functional teams and architecting data-intensive applicationsLocation: Gurugram, Chennai, Jaipur, Pune, Bhopal, BangaloreAbout the Job:We are seeking a highly skilled Strategic Data Solutions Lead to lead our Data Warehouse team. As a key member of our team, you will...
-
Senior Data Architect
7 days ago
Cochin, Kerala, India beBeeDataArchitect Full time ₹ 2,00,00,000 - ₹ 2,50,00,000Data Architect">We are seeking a skilled Cloud Data Architect to join our team. The ideal candidate will have expertise in designing and implementing data architecture solutions on Google Cloud Platform.This role is ideal for someone with hands-on experience in delivering multiple data and analytics solutions on GCP, including data ingestion, processing, and...