Scalable Data Pipeline Architect

4 days ago

lucknow, India beBeePlatform Full time

Platform Engineer JobThis role offers a unique opportunity to contribute to the growth of a world-class development and support center. The position involves designing, developing, and maintaining scalable data pipelines and platform services using Python, Apache Spark, and Databricks.Key Responsibilities:Design and develop maintainable data integration workflows and reusable components for ingestion, transformation, and orchestration.Deploy and manage workloads on Kubernetes, ensuring scalability and reliability.Implement and maintain cloud-native solutions on AWS, GCP, or Azure.Collaborate with data science, application, and platform teams to deliver efficient and robust data services.Drive automation, observability, and CI/CD improvements across the platform.Required Skills and Qualifications:Strong experience in Python for data engineering, scripting, and automation.Solid understanding of Apache Spark and distributed data processing.Experience working with notebooks (Jupyter, Zeppelin, or Databricks).Hands-on experience with Kubernetes for container orchestration, workload deployments and scaling.Knowledge of RDBMS (PostgreSQL) and NoSQL databases.Ability to thrive in a fast-paced, distributed engineering environment.Benefits:Opportunity to work with cutting-edge technologies.Collaborative team environment.Education and Experience:Bachelor's or Master's degree (or foreign equivalent) in Computer Science, Engineering, or a related field.4+ years of progressive experience as a Software Engineer, Data Engineer, or Platform Engineer.

  • Enterprise Data Architect

    3 weeks ago

    Lucknow, India Aptus Data Labs Full time

    Company DescriptionAptus Data Labs is a leading Data and AI company specializing in Pharma, Manufacturing & Supply Chain, Banking & FinTech, and Technology domains. We offer innovative analytical solutions and consulting services to help businesses make quick, data-driven decisions essential for growth and sustainability in evolving industries. Leveraging...

  • Chief Data Pipeline Architect

    1 week ago

    lucknow, India beBeeDataEngineer Full time

    Key Role in Data SystemsData engineers play a crucial role in designing, building, and maintaining large-scale data systems that support business growth and strategic decision-making.As a key member of the data engineering team, you will be responsible for developing and implementing efficient data processing solutions using Palantir Foundry, Workshop,...

  • Data Architect Specialist

    1 week ago

    lucknow, India beBeeDataEngineering Full time

    Data Architect SpecialistWe seek a seasoned professional in data architecture and engineering to design, develop and optimize large-scale data pipelines using Python, SQL and Snowflake. Pipeline Design: Develop scalable and efficient data pipeline architectures utilizing Python, SQL and cloud-based services.Data Quality Assurance: Implement robust quality...

  • Data Pipeline Specialist

    1 week ago

    lucknow, India beBeeDataEngineer Full time

    Job Title: Data Pipeline SpecialistKey Responsibilities:• Design and implement a batch processing pipeline in a cloud-based environment (AWS).• Integrate image processing workflows and ML model deployment.• Ensure scalability, automation, and reliability through DevOps expertise.Requirements:• Experience with NextFlow is required for targeted...

  • Lead Data Architect

    4 days ago

    lucknow, India beBeeDataengineering Full time

    Data Engineer PositionAs a seasoned professional in the field of data engineering, you will be responsible for overseeing systems that drive our data-driven decisions.Key Responsibilities: Architect and maintain high-performance data pipelines and databases across platforms like MSSQL, Redshift, and Snowflake. Design and maintain scalable, efficient, and...

  • Lead Data Infrastructure Architect

    1 week ago

    lucknow, India beBeeDataEngineer Full time

    Job OpportunityAs a principal data engineer, you will have the responsibility of architecting and designing scalable data infrastructure from scratch.You will design, implement, and optimize robust pipelines to process large datasets efficiently.Key responsibilities include:Designing and building scalable data infrastructure.Implementing and optimizing...

  • Chief Data Architect

    4 days ago

    lucknow, India beBeeData Full time

    Job OverviewWe're seeking a seasoned data architect to lead the design and implementation of our cloud-based data infrastructure.The ideal candidate will possess in-depth knowledge of big data ecosystems, Python, SQL, and Snowflake, along with expertise in designing scalable data pipelines and ETL workflows.Key responsibilities include:Designing, building,...

  • Cloud Data Solutions Architect

    6 days ago

    lucknow, India beBeeDataarchitect Full time

    We are seeking a senior data architect to lead our enterprise data initiatives. This role requires expertise in SQL, ETL/ELT, Microsoft Fabric, Azure, and deep understanding of data warehousing concepts, medallion architecture, and data pipeline engineering.This position demands strong leadership skills to manage multiple data projects, provide technical...

  • Data Architect

    7 days ago

    Lucknow, India Epsilon Technologies Group Full time

    About Epsilon Technologies Group: Epsilon is a capital markets technology solutions and services firm helping financial institutions manage everything on their balance sheet with a scalable and innovative product line as well as our highly experienced and independent consulting services. Epsilon is looking for a hands-on Data Architect who will design,...

  • Advanced Data Architect

    6 days ago

    lucknow, India beBeeDataEngineer Full time

    Senior Oracle Data EngineerWe are seeking an experienced Senior Data Engineer to join our team. The successful candidate will be responsible for architecting robust data pipelines across on-prem and cloud Oracle ecosystems, automating ingestion from varied sources including APIs.Key Responsibilities:Design, develop, and optimize ETL/ELT data pipelines using...