Senior Data Architect

2 weeks ago

dindigul, India beBeeDataEngineer Full time

Data Engineer – Python ExpertJob Title: Data Engineer – Python Expert (Freelance Role)Location: Remote/HybridEmployment Type: Contract/FreelanceJob Description:We seek a seasoned Senior Data Engineer to design, develop, and own robust data pipelines that power our large language model development. As a senior Individual Contributor, you will be the team's expert on data ingestion, processing, and quality for all AI training.Your primary mission is to build scalable, automated systems that transform massive, raw datasets into pristine, model-ready formats. While your focus will be on data engineering, your expertise will be valued in collaborating on model training runs and experiments.You are the perfect fit if you are a Python expert who thrives on solving large-scale data challenges and enjoys working at the intersection of data engineering and machine learning.Key Responsibilities:Architect & Build: Design, develop, and own ETL/ELT pipelines in Python for ingesting and processing terabyte-scale text datasets.Data Quality: Implement data cleaning, deduplication, filtering, and normalization strategies to ensure data integrity.Data Transformation: Structure and format diverse datasets for consumption by LLM training frameworks.Collaboration: Work closely with AI researchers and ML engineers to understand data requirements and support model training lifecycle.Optimization: Continuously optimize data processing workflows for speed, cost, and reliability.Requirements:8+ years of experience in data engineering, data processing, or backend software engineering.Expert-level proficiency in Python and its data ecosystem.Proven experience building and maintaining large-scale data pipelines.Deep understanding of data structures, data modeling, and software engineering best practices.Excellent problem-solving skills and attention to detail.Benefits:Opportunity to lead cutting-edge AI and ML projects.Collaborative and innovative team culture.Competitive compensation with continuous learning opportunities.

  • Senior Data Architect

    4 days ago

    dindigul, India beBeeBigDataDeveloper Full time

    Job OverviewWe are seeking a seasoned Senior Big Data Developer to drive the development and implementation of big data solutions.Main Responsibilities:About The RoleThis is an exciting opportunity to join our organization as a key member of the team, responsible for architecting and developing big data solutions.The ideal candidate will have a strong...

  • Senior Azure Cloud Data Architect

    2 days ago

    dindigul, India beBeeData Full time

    Senior Data Architect for Azure ApplicationsSolution & data architect sought to design secure, scalable, and robust data architectures in Azure-based applications.Develop comprehensive strategies for data modeling with an emphasis on high-quality, well-documented, and maintainable structures.Collaborate with engineering and analytics teams to define data...

  • Principal Cloud Data Architect

    2 weeks ago

    dindigul, India beBeeDataEngineer Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team in building a modern data platform on AWS.You will play a key role in transitioning from legacy systems to a scalable, cloud-native architecture using technologies like Apache Iceberg, AWS Glue, Redshift, and Atlan for governance.Responsibilities:Design, develop, and optimize...

  • Pioneering Data Architect for Cloud Migration

    4 days ago

    dindigul, India beBeeDataArchitect Full time

    At the forefront of innovation, we seek a pioneering Data Architect to spearhead our data migration endeavors from on-premises environments to cloud platforms.This visionary role involves leading and executing data transformation initiatives, necessitating exceptional expertise in Databricks and deep knowledge of data engineering best practices.The ideal...

  • Data Systems Architect Position

    2 weeks ago

    dindigul, India beBeeDataSystemsDeveloper Full time

    Senior Data Systems DeveloperThe ideal candidate will lead the design, development, and optimization of large-scale data processing systems that support both batch and real-time analytics.Develop scalable, high-performance data pipelines using Azure Databricks, ADF, and Spark.Optimize Spark (Scala/PySpark) jobs for large-volume data processing and...

  • Senior Cloud Data Architect

    2 weeks ago

    dindigul, India beBeeData Full time

    Job Opportunity:We are seeking a seasoned data architect to design and implement scalable, high-performance data architectures that support our enterprise data initiatives.The ideal candidate should bring strong expertise in database management, data warehousing concepts, cloud-based technologies, especially Azure Synapse Analytics.Design end-to-end data...

  • Real-Time Data Solutions Architect

    2 weeks ago

    dindigul, India beBeeDataEngineering Full time

    Senior Data Engineer - Real-Time Data SolutionsAbout the RoleWe are seeking a highly skilled Senior Data Engineer to join our data engineering team. The ideal candidate will have extensive hands-on experience in building and optimizing data ingestion and transformation pipelines using Azure Data Platform, Databricks, Snowflake, and Kafka.You will be...

  • Senior Big Data Architect

    2 weeks ago

    dindigul, India beBeeDataEngineering Full time

    **Job Title:** Data Engineering Manager – Web Crawling**Job Description:As a Data Engineering Manager, you will lead and mentor data engineering and web crawling teams, ensuring high-quality delivery and adherence to best practices. You will architect, implement, and optimize scalable data pipelines that support high-volume data ingestion, transformation,...

  • Chief Data Architect

    2 weeks ago

    dindigul, India beBeeDataEngineering Full time

    Job DescriptionWe are seeking a skilled Data Engineer to join our team and drive innovation within our microservices architecture. The successful candidate will be responsible for leading the development, optimization, and maintenance of data pipelines and back-end services.The ideal candidate will have a strong understanding of microservices principles,...

  • Data Architect

    2 weeks ago

    dindigul, India beBeeData Full time

    Cloud Data ArchitectBuilding scalable, reliable data architectures is key to driving business growth and innovation. As a skilled Cloud Data Architect, you will design and implement cutting-edge cloud-based solutions that meet the evolving needs of our organization.Key Responsibilities:Designing cloud-based data systems with scalability and performance in...