Senior Data Pipeline Architect

1 week ago

agra, India beBeeData Full time

Advanced Data Scientist Role SummaryWe are looking for an experienced data professional to lead the development of cutting-edge data pipelines that fuel our AI and machine learning capabilities.The ideal candidate will be responsible for architecting, building, and maintaining robust, scalable, and automated ETL/ELT pipelines in Python for ingesting and processing large-scale text datasets.Key Responsibilities:Designing and implementing efficient data processing workflows using Apache Spark or Ray.Developing data quality strategies, including data cleaning, deduplication, filtering, and normalization.Transforming data to structure and format diverse datasets for consumption by AI and ML frameworks.Collaborating with cross-functional teams to understand data requirements, define metrics, and support model training lifecycle.Optimizing data processing workflows for speed, cost, and reliability.Requirements:8+ years of experience in data engineering, data processing, or backend software engineering.Expert-level proficiency in Python and its data ecosystem.Proven track record of building and maintaining large-scale data pipelines.Deep understanding of data structures, data modeling, and software engineering best practices.Experience handling and parsing diverse data formats at scale.Excellent problem-solving skills and attention to detail.Strong communication and collaboration skills.Preferred Qualifications:Hands-on experience with data preprocessing pipelines for AI and ML applications.Strong experience with big data frameworks like Apache Spark or Ray.Familiarity with ML frameworks like PyTorch or TensorFlow.Proficiency with cloud platforms and their data/storage services.

  • Senior Data Architect

    1 week ago

    agra, India beBeeData Full time

    We are seeking a Senior Data Architect to lead the design and delivery of enterprise data analytics solutions. The ideal candidate will own the architecture for ETL/ELT, data warehousing, analytics pipelines, data governance, and integrations with LMS/EdTech systems.The successful candidate will define end-to-end data architectures and roadmaps for...

  • Chief Data Pipeline Architect

    3 days ago

    agra, India beBeeDataEngineer Full time

    Job Opportunity: Senior Data EngineerElevate data management by designing, building, and optimizing high-performance data pipelines and systems.Develop scalable and reliable Extract, Transform, Load/Extract, Load, Transform (ETL/ELT) pipelines to ensure seamless data flow.Construct robust data models, marts, and warehouses to support business analytics and...

  • Enterprise Data Architect

    1 week ago

    agra, India beBeeData Full time

    Senior Data Architect RoleWe are seeking an experienced senior data architect to design and implement robust, scalable, and high-performance data architectures that support enterprise data initiatives.Lead the planning, execution, and delivery of multiple data projects ensuring alignment with business goals, timelines, and quality standards.Architect...

  • Data Pipeline Architect

    1 week ago

    agra, India beBeePlatform Full time

    Platform Engineer PositionWe are seeking a skilled and dedicated platform engineer to join our development and support center. This position offers an exciting opportunity to contribute to the growth of our organization.Develop scalable data pipelines and platform services using Python, Apache Spark, and Databricks.Design and manage notebook-based workflows...

  • Expert Data Pipeline Architect

    1 week ago

    agra, India beBeeDataEngineer Full time

    As a Freelance Data Engineer, you will play a pivotal role in shaping the data infrastructure of our organization.We are seeking an expert with extensive experience in Apache NiFi, SQL, and API integrations to design, implement, and optimize real-time data pipelines. Data Ingestion Expertise: Design and implement real-time data ingestion pipelines using...

  • Distinguished Data Solutions Architect

    2 days ago

    agra, India beBeeData Full time

    Senior Data Engineer Job DescriptionWe are seeking a seasoned Data Architect to lead the design, build and optimization of large-scale data pipelines and Delta Lake environments.Responsibilities include:Developing and maintaining complex ETL processes utilizing PySpark and DatabricksManaging and optimizing the performance of Delta Lake...

  • Senior Cloud Data Architect Position

    1 week ago

    agra, India beBeeCloud Full time

    Job DescriptionWe are seeking an experienced senior data architect to design and implement robust, scalable, and high-performance data architectures that support our enterprise data initiatives.Main Responsibilities:Architect end-to-end data solutions using modern cloud data platforms.Lead the planning and execution of multiple data projects.Define and...

  • Senior Data Pipeline Specialist

    1 week ago

    agra, India beBeeData Full time

    Data Engineering RoleOverview:We are seeking a seasoned Data Engineer to spearhead the design, development, and optimization of scalable data pipelines using Python. The ideal candidate will have hands-on experience with ETL/ELT pipeline development, data extraction, transformation, and loading into data lakes/warehouses, workflow orchestration, and...

  • Cloud-Native Data Architect

    1 week ago

    agra, India beBeeDataEngineer Full time

    Senior Data Engineer Job DescriptionWe are seeking a highly skilled Senior Data Engineer to lead the development of our cloud-native data platform on AWS. You will play a key role in transitioning from legacy systems to a scalable architecture using technologies like Apache Iceberg, AWS Glue, Redshift and Atlan for governance.Design and Develop Data...

  • Senior Data Platform Architect

    1 week ago

    agra, India beBeeDataEngineer Full time

    Data Engineering RoleWe're seeking a seasoned data engineer to join our team. As a key member, you'll be responsible for designing and implementing scalable data infrastructure, building ETL/ELT pipelines, and collaborating with senior-level engineers to ensure high-quality data platforms.Requirements: