Chief Data Pipeline Architect

8 hours ago

Palakkad, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

Data Engineer Role Overview

Seeking a skilled data engineer to design, develop, and maintain robust data pipelines. Responsibilities include extracting data from Oracle Symphony via APIs, processing and storing it in the Databricks Lakehouse platform, and integrating it into Oracle EPM.

Key Responsibilities:

  • Design and implement end-to-end data pipelines from Oracle Symphony (API extraction) into Databricks Lakehouse.
  • Develop efficient ETL/ELT processes in Databricks (PySpark, Delta Lake) to transform, cleanse, and enrich data.
  • Build and maintain data flows from Databricks into Oracle EPM to support reporting, forecasting, and planning.
  • Ensure data quality, consistency, and governance across Symphony, Databricks, and EPM.
  • Optimize pipeline performance, scalability, and reliability.
  • Collaborate with data architects, finance teams, and Oracle specialists to meet business needs.
  • Troubleshoot pipeline issues and provide production support for data integration processes.
  • Document architecture, pipeline logic, and integration workflows.
  • Stay current on Databricks, Oracle, and API integration best practices.

Required Skills & Qualifications:

  • Bachelor's or Master's degree in Computer Science, Data Engineering, or related field.
  • 5+ years of experience in data engineering, ETL/ELT, and data pipeline development.
  • Hands-on experience with Databricks (PySpark, Delta Lake, MLflow).
  • Strong experience with APIs (REST, SOAP, JSON, XML) for data extraction and integration.
  • Proficiency in SQL, Python, and Spark for data processing.
  • Experience with cloud platforms (Azure, AWS, or GCP) for hosting Databricks and related services.
  • Knowledge of data modeling, data governance, and performance tuning.
  • Strong problem-solving skills and ability to work in cross-functional teams.

Job Benefits:

The ideal candidate will enjoy working closely with stakeholders, architects, and analysts to ensure seamless data flow, transformation, and availability.

Professional Development:

Opportunities exist to grow professionally within the organization by developing expertise in emerging technologies.

  • Chief Data Pipeline Engineer

    6 days ago

    Palakkad, Kerala, India beBeeData Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    Key Responsibilities:We are seeking a skilled Data Architect to develop and maintain data pipelines using Python and AWS (S3, Redshift, Lambda, Glue).Develop scalable data architectures using AWS services.Implement and optimize ETL processes for large datasets using Python and AWS Glue.Collaborate with cross-functional teams to design and implement data...

  • Data Pipeline Architect

    1 week ago

    Palakkad, Kerala, India beBeeETLDeveloper Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    We are seeking a skilled professional to fill the role of an ETL Specialist with expertise in designing and optimizing complex data pipelines using Talend Open Studio.Key qualifications for this position include 8 to 10 years of experience working with large datasets, proficiency in SQL and Python programming languages, as well as hands-on experience with...

  • Chief Data Architect

    4 days ago

    Palakkad, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Unlock the full potential of data with a role that combines architecture, engineering, and analytics.Job DescriptionWe're seeking a visionary Architect to design and scale next-generation analytics platforms in Microsoft ecosystem. As a key member of our team, you'll define architecture, guide implementation, and enable data teams to deliver insights faster...

  • Chief Artificial Intelligence Architect

    17 hours ago

    Palakkad, Kerala, India beBeeArtificialintelligence Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    We are seeking an accomplished Chief Artificial Intelligence Architect to spearhead our AI/ML initiatives.Job OverviewThis is a pivotal role that requires expertise in designing and overseeing the overall architecture for our Large Language Model (LLM). The ideal candidate will be responsible for ensuring alignment with business objectives, developing...

  • Expert Data Pipeline Architect

    2 days ago

    Palakkad, Kerala, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 30,00,000

    Job Title:A Data Engineer is needed to design, build, and maintain large-scale data pipelines using Google Cloud Platform.Responsibilities:Develop, construct, test, and maintain data acquisition pipelines for structured and unstructured data in GCP.Create complex datasets based on business requirements.Construct 'big data' pipeline architecture.Identify...

  • Chief Cloud Data Architect

    7 days ago

    Palakkad, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Lead Data ArchitectAbout the OpportunityWe are seeking a seasoned data architect with extensive expertise in designing and implementing large-scale data systems. As a key member of our team, you will be responsible for leading the development of scalable data architectures and solutions that meet the evolving needs of our business.Key...

  • Data Systems Architect

    2 days ago

    Palakkad, Kerala, India beBeeData Full time ₹ 18,00,000 - ₹ 24,00,000

    Job Title: Data Systems ArchitectWe are seeking an experienced Data Systems Architect to join our team. As a Data Systems Architect, you will be responsible for designing, building, and maintaining efficient data pipelines.

  • Chief Data Solutions Architect

    2 days ago

    Palakkad, Kerala, India beBeeDataArchitect Full time ₹ 15,00,000 - ₹ 20,00,000

    We are seeking a data architect with expertise in cloud development.Key ResponsibilitiesCreate scalable data pipelines and products using cloud-native platforms.Develop and optimize ELT/ETL processes using various tools and technologies.Sustain data models that drive operational and analytical workloads.Build, deploy, and manage cloud-native data solutions...

  • Data Architect

    4 days ago

    Palakkad, Kerala, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job DescriptionAs a data architect, you will design and develop large-scale data pipelines for ingestion, transformation, and storage. Your focus will be on creating efficient data architectures that enable business stakeholders to make informed decisions.

  • Senior Data Architect

    6 days ago

    Palakkad, Kerala, India beBeeDataEngineer Full time US$ 1,80,000 - US$ 2,30,000

    Unlock the Potential of Data EngineeringWe are seeking a highly skilled Senior Data Engineer to join our team. As a key member of our data engineering group, you will play a critical role in designing, building, and maintaining high-performance data pipelines that support advanced analytics and machine learning.Key Responsibilities:Lead the optimization and...