Advanced Large Scale Data Architect
2 days ago
Job Title: Senior Data ArchitectLocation: Remote / HybridEmployment Type: Contract/ Freelance We are looking for a seasoned Senior Data Engineer to architect, build and own the data pipelines that power our large language model development. As a senior individual contributor, you will be the team's expert on data ingestion, processing and quality for all AI training. Your primary mission is to design and develop scalable automated systems that transform massive raw datasets into pristine model-ready formats. While your focus will be on data engineering, your expertise will be valued in collaborating on model training runs and experiments. You're the perfect fit if you are a python expert who thrives on solving large-scale data challenges and enjoys working at the intersection of data engineering and machine learning.Key Responsibilities Design, develop and own robust scalable automated etl/elt pipelines in python for ingesting and processing terabyte scale text datasets. Implement rigorous data cleaning deduplication filtering and normalization strategies. Define and enforce data quality standards to ensure the highest integrity for model training. Efficiently structure and format diverse datasets for consumption by llm training frameworks. Work closely with our team of ai researchers and ml engineers to understand data requirements define metrics and support the model training lifecycle. Continuously optimize data processing workflows for speed cost and reliability. Occasionally assist in launching monitoring and debugging data related issues during model training runs. Required Skills and Qualifications 8+ years of professional experience in data engineering data processing or backend software engineering. Expert-level proficiency in python and its data ecosystem e.g. pandas numpy dask polars. Proven experience building and maintaining large-scale data pipelines. Deep understanding of data structures data modeling and software engineering best practices e.g. git cicd testing. Experience handling and parsing diverse data formats at scale. Excellent problem-solving skills and a meticulous attention to detail. Strong communication and collaboration skills with experience working in a team environment. Benefits Opportunity to lead cutting-edge ai and ml projects. Collaborative and innovative team culture. Competitive compensation with continuous learning opportunities.
-
thrissur, India beBeeDataEngineering Full timeData Engineering Lead – Large Scale Web CrawlingAt the forefront of our organization's data-driven strategy, we are seeking a seasoned Data Engineering Manager to spearhead the development and maintenance of large-scale web crawling systems.This accomplished professional will lead and mentor high-performing data engineering and web crawling teams.The ideal...
-
thrissur, India beBeeIntegration Full timeEnterprise Integration ProfessionalThis role involves designing, developing, and implementing large-scale enterprise integration solutions.Develop and implement complex integration strategies for enterprise systems.Collaborate with cross-functional teams to gather integration requirements and ensure alignment with business objectives.Design and build...
-
Data Architect Position
2 days ago
thrissur, India beBeeData Full timeData Architect PositionWe are seeking a skilled Data Architect to join our team.Design, build and optimize large-scale data pipelines and ETL workflowsDevelop efficient and reusable Python scripts for data processingCreate complex SQL queries for data extraction, transformation and analyticsCollaborate with cross-functional teams (analytics, product,...
-
Advanced AI Architect
3 hours ago
thrissur, India beBeeArtificialintelligence Full timeSenior AI Engineer (Cloud)We are seeking a seasoned Senior AI Engineer to lead the development of a Graph Analytics Platform for fighting financial crime and promoting explainable AI.Design, develop and implement distributed entity resolution algorithms at scale using Apache Spark. These algorithms will utilize techniques like LSH, canopy clustering and...
-
Sr. data architect
1 week ago
Thrissur, India TUTOADDA Full timeSenior Data Architect – SnowflakeLocation: Trivandrum / Kochi (Hybrid / Remote Flexibility) Experience: 10+ Years Budget: Up to ₹30 LPA Notice Period: Immediate Joiners Preferred Working Hours: 12 PM – 9 PM IST (Mandatory EST Overlap) We are looking for an experienced Senior Data Architect with strong expertise in Snowflake, enterprise data...
-
Data Platform Architect
2 days ago
thrissur, India beBeeData Full timeExpert Data Engineer WantedWe are seeking an experienced data professional to join our team. The ideal candidate will have a minimum of 7-10 years of experience designing and implementing production-scale data platforms.The successful candidate will be responsible for architecting scalable and reliable data infrastructure from the ground up, designing robust...
-
Senior Data Solutions Architect
2 days ago
thrissur, India beBeeDataEngineer Full timeAbout this roleWe are looking for an experienced Data Engineering professional to lead the design and development of our data ingestion and transformation pipelines.You will be responsible for architecting, building, and maintaining robust data acquisition frameworks that support large-scale analytics and operational data systems.Job RequirementsExtensive...
-
Cloud Data Engineer
3 hours ago
thrissur, India beBeeData Full timeWe are seeking a skilled professional to lead the migration of large-scale SQL workloads from on-premise environments to Azure. This role requires hands-on experience in modern data engineering tools and platforms within the Azure ecosystem.Key Responsibilities:Migrate large-scale SQL workloads to Azure, ensuring high data integrity and minimal...
-
Senior data architect- snowflake
2 weeks ago
Thrissur, India USEReady Full timeUSEReady is a data and analytics firm that provides the strategies, tools, capability, and capacity that businesses need to turn their data into a competitive advantage. USEReady partners with cloud and data ecosystem leaders like Tableau, Salesforce, Snowflake and Amazon Web Services, and has been named Tableau partner of the year multiple times. We are...
-
Data Architect Leader
6 hours ago
thrissur, India beBeeData Full timeSenior Architect of Data SolutionsThis is a highly technical role requiring 12–15 years of experience, proven leadership in data architecture and deep knowledge of ETL/analytics solutions for education data ecosystems or similarly regulated verticals.Design end-to-end data architecture and roadmaps for large-scale education platforms (ingestion → storage...
