Data Pipeline Architect

2 weeks ago

palakkad, India beBeePlatformEngineer Full time

As a Platform Engineer, you will play a pivotal role in the development and support of our data pipeline and platform services.This position offers an exciting opportunity to utilize your skills in Python, Apache Spark, and Databricks to design and develop scalable solutions.Data Pipeline Design and Development: Utilize Python, Apache Spark, and Databricks to design and develop scalable data pipelines and platform services.Notebook-Based Workflows: Develop and manage notebook-based workflows for data processing, analysis, and automation.Data Integration Workflows: Build and optimize data integration workflows and reusable components for ingestion, transformation, and orchestration.Kubernetes Deployment: Deploy and manage workloads on Kubernetes, ensuring scalability and reliability.Cloud-Native Solutions: Implement and maintain cloud-native solutions on AWS, GCP, or Azure.Collaboration and Delivery: Collaborate with data science, application, and platform teams to deliver efficient and robust data services.Automation and Observability: Drive automation, observability, and CI/CD improvements across the platform.

  • Enterprise Data Solutions Leader

    2 weeks ago

    palakkad, India beBeeData Architect Full time

    Lead Enterprise Data ArchitectWe're seeking a seasoned data architect to lead our enterprise data and analytics initiatives. This role requires hands-on experience with cloud data platforms, ETL/ELT pipelines, and strong design and operational experience.

  • Data Pipeline Architect

    2 weeks ago

    palakkad, India beBeeEngineering Full time

    About the RoleThe Palantir Foundry Engineer is responsible for designing, building, and maintaining scalable data pipelines within the Palantir ecosystem.

  • Senior Data Pipeline Architect

    4 days ago

    palakkad, India beBeeDataEngineer Full time

    Job OpportunityWe are seeking skilled professionals to join our data engineering teams.This role is ideal for experienced engineers who can design, build, and maintain scalable data pipelines using modern tools and frameworks.Data Ingestion: Develop ETL/ELT workflows for structured, semi-structured, and unstructured data sources.Data Processing: Implement...

  • Building Scalable Data Pipelines

    2 weeks ago

    palakkad, India beBeeDataEngineer Full time

    **Data Architect Role**Job Overview:We are seeking a skilled Data Engineer to design and build scalable data pipelines, ensure efficient data integration, and enable advanced analytics and reporting across the organization.Key Responsibilities:Design, develop, and optimize ETL/ELT pipelines using Python, PySpark, and AWS Glue.Implement data ingestion,...

  • Chief Data Infrastructure Specialist

    1 week ago

    palakkad, India beBeeData Architect Full time

    Key ResponsibilitiesDefine and execute a data strategy that aligns with business objectives and future growth needs.Design, architect, and implement cloud-based Data Lakes, Data Warehouses, and Data Lakehouses using modern technologies such as Snowflake and Databricks.Lead the modernization of data platforms by leveraging frameworks like Apache Spark for...

  • Ai engineer

    3 weeks ago

    Palakkad, India BeGig Full time

    Job Role- AI Engineer (Data Pipelines & RAG) Job Type- Full-time Work Mode- Remote(6 days working) We are looking for a hands-on AI/Data Engineer (4–7 years) to build and scale data pipelines powering Gen AI and agentic applications. You’ll architect data models, build ETL/ELT workflows, and integrate pipelines with RAG-based systems in a fast-paced...

  • Data Pipeline Specialist

    2 weeks ago

    palakkad, India beBeePipeline Full time

    Job Role:We are seeking a skilled Data Pipeline Specialist to enhance our technical capabilities. The ideal candidate will possess hands-on experience in ETL/Data Pipeline Testing, API Testing, and data flows.Main Responsibilities:Conduct comprehensive testing of ETL pipelines across cloud/on-prem environments.Validate source-to-target mappings, complex data...

  • Senior Data Architect

    2 weeks ago

    palakkad, India beBeeDataEngineer Full time

    Job OpportunityWe are seeking a highly skilled Data Engineer to join our team and play a pivotal role in driving innovation within our microservices architecture.This individual will be responsible for designing, developing, and deploying data engineering solutions and back-end services within a microservices environment. They will also architect and...

  • Expert Data Pipeline Specialist

    3 days ago

    palakkad, India beBeeDataSupportEngineer Full time

    Role DescriptionWe are seeking a skilled Data Support Engineer to serve as the escalation point for data ingestion, pipeline, and consumption issues.This role requires a professional with 8+ years of experience in SQL, Python, ETL/ELT pipelines, and cloud technologies such as Azure, Databricks, PySpark, ADF, ADLS, Azure Workbooks, KQL, and Grafana. The ideal...

  • Senior Data Architect

    4 days ago

    palakkad, India beBeeData Full time

    Job Title: Data Architect & EngineerThe RoleWe seek a seasoned Senior Data Engineer to architect, build and own the data pipelines that power our large language model development.As a senior individual contributor, you will be the team's expert on data ingestion, processing and quality for all AI training.Key Responsibilities Include:Designing, developing,...