Chief Data Pipeline Architect

3 days ago

Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

As a key member of our team, you will play a pivotal role in designing, developing and maintaining data pipelines that extract data from Oracle Symphony via APIs, process and store it in the Databricks Lakehouse platform.

The successful candidate will have deep expertise in data integration, ETL/ELT, APIs and Databricks. You will work closely with business stakeholders, architects and analysts to ensure seamless data flow, transformation and availability for financial planning, reporting and analytics.

Key Responsibilities
  • Design and implement end-to-end pipelines from Oracle Symphony (API extraction) into Databricks Lakehouse.
  • Develop efficient ETL/ELT processes in Databricks (PySpark, Delta Lake) to transform, cleanse and enrich data.
  • Build and maintain data flows from Databricks into Oracle EPM to support reporting, forecasting and planning.
  • Ensure data quality, consistency and governance across Symphony, Databricks and EPM.
  • Optimize pipeline performance, scalability and reliability.
  • Collaborate with data architects, finance teams and Oracle specialists to meet business needs.
  • Troubleshoot pipeline issues and provide production support for data integration processes.
Required Skills & Qualifications
  • Bachelor's or Master's degree in Computer Science, Data Engineering or related field.
  • 5+ years of experience in data engineering, ETL/ELT and data pipeline development.
  • Hands-on experience with Databricks (PySpark, Delta Lake, MLflow).
  • Strong experience with APIs (REST, SOAP, JSON, XML) for data extraction and integration.
  • Proficiency in SQL, Python and Spark for data processing.
  • Experience with cloud platforms (Azure, AWS or GCP) for hosting Databricks and related services.
  • Knowledge of data modeling, data governance and performance tuning.
  • Strong problem-solving skills and ability to work in cross-functional teams.

  • Chief Data Pipeline Architect

    1 week ago

    Pune, Maharashtra, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Lead Data Solutions ArchitectThe Role:This Senior Data Engineer position plays a pivotal role in the design, development, and maintenance of large-scale data pipelines using Azure services such as Databricks and Data Factory. The ideal candidate will possess proficiency in programming languages like SQL, Python, R, or Scala to create efficient data...

  • Chief Data Architect

    3 days ago

    Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 1,04,000 - ₹ 1,30,878

    Job DescriptionWe are seeking a highly skilled Chief Data Architect to join our team.The ideal candidate will have a strong background in data engineering and a proven track record of designing and implementing large-scale data systems.Main Responsibilities:Develop and maintain data pipelines, ELT processes, and workflow orchestration using Apache Airflow,...

  • Chief Data Architect

    5 days ago

    Pune, Maharashtra, India beBeeData Full time ₹ 15,00,000 - ₹ 28,00,000

    Job Title: Chief Data ArchitectWe are seeking a highly skilled and experienced Chief Data Architect to join our team. As a key member of our organization, you will be responsible for designing, building, and maintaining efficient, reusable, and reliable code.Key Responsibilities:Design and implement data architectures that meet business requirementsDevelop...

  • Chief Data Pipeline Architect

    7 days ago

    Pune, Maharashtra, India beBeeSnowflake Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Snowflake Data Engineer Job SummaryWe are seeking a highly skilled Snowflake data engineer with at least 5 years of experience in building and optimizing data pipelines, transforming data, and enabling advanced analytics solutions.

  • Chief Data Pipeline Architect

    10 hours ago

    Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 22,00,000

    Key Data Engineering RoleWe are seeking a skilled Data Engineer to lead the design and implementation of data pipelines, ensuring data quality and integrity.Design and implement data pipelines using Postgres SQL, including advanced query writing, CTEs, window functions, indexing, and optimization.Develop and maintain data models, including star schema,...

  • Chief Data Pipeline Architect

    3 days ago

    Pune, Maharashtra, India beBeeDataengineer Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    About This RoleWe are seeking a seasoned Data Engineer to drive the design and development of scalable data pipelines using Spark. The ideal candidate will leverage Azure Databricks and Datalake for efficient data processing and storage.Main Responsibilities

  • Data Pipeline Architect

    1 week ago

    Pune, Maharashtra, India beBeeData Full time ₹ 1,04,000 - ₹ 1,30,878

    Senior Big Data Engineer">This role will oversee a team of employees and contractors in their professional development. Key responsibilities include mentoring, problem resolution, and team building to ensure success. The position will also lead software engineering projects in developing high-quality, secure, scalable applications and pipelines based on...

  • Chief Data Pipeline Architect

    1 day ago

    Pune, Maharashtra, India beBeeDataEngineering Full time ₹ 1,20,00,000 - ₹ 2,50,00,000

    About the RoleThis is a Data Engineer position that requires 3 to 7 years of experience in designing, building, and managing robust data pipelines.The role focuses on developing efficient ETL/ELT workflows, ensuring data quality, security, and scalability to support AI/ML model training, inference, and intelligent decision-making processes in a cloud-native...

  • Data Pipeline Architect

    1 week ago

    Pune, Maharashtra, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Senior Data Engineer - AWS ExpertWe are seeking a seasoned professional to spearhead the design, development, and deployment of end-to-end data pipelines on AWS cloud infrastructure.Key Responsibilities:Design scalable data processing workflows using Apache Spark and SQL for analytics and reporting requirements.Build and maintain orchestration workflows to...

  • Chief Data Pipeline Architect

    2 days ago

    Pune, Maharashtra, India beBeeMachineLearning Full time ₹ 18,00,000 - ₹ 25,00,000

    Unlock the Power of Machine Learning OperationsWe are seeking a highly skilled MLOps Engineer to join our team and drive the development of scalable machine learning systems.Job Description: The successful candidate will be responsible for designing data pipelines and engineering infrastructure to support our clients' enterprise machine learning systems at...