Principal Data Architect

2 weeks ago

Chennai, Tamil Nadu, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000
Senior Data Engineer

We are seeking a highly skilled Senior Data Engineer to design, develop, and maintain data pipelines that extract data from Oracle Symphony via APIs, process and store it in the Databricks Lakehouse platform, and then integrate it into Oracle EPM (Enterprise Performance Management).

Key Responsibilities
  • Data Pipeline Design: Design and implement end-to-end pipelines from Oracle Symphony (API extraction) into Databricks Lakehouse.
  • ETL/ELT Process Development: Develop efficient ETL/ELT processes in Databricks (PySpark, Delta Lake) to transform, cleanse, and enrich data.
  • Data Flow Integration: Build and maintain data flows from Databricks into Oracle EPM to support reporting, forecasting, and planning.
  • Data Quality Assurance: Ensure data quality, consistency, and governance across Symphony, Databricks, and EPM.
  • Pipeline Optimization: Optimize pipeline performance, scalability, and reliability.
  • Cross-Functional Collaboration: Collaborate with data architects, finance teams, and Oracle specialists to meet business needs.
  • Troubleshooting and Support: Troubleshoot pipeline issues and provide production support for data integration processes.

Requirements and Qualifications

  • Bachelor's or Master's degree in Computer Science, Data Engineering, or related field.
  • 5+ years of experience in data engineering, ETL/ELT, and data pipeline development.
  • Hands-on experience with Databricks (PySpark, Delta Lake, MLflow).
  • Strong experience with APIs (REST, SOAP, JSON, XML) for data extraction and integration.
  • Proficiency in SQL, Python, and Spark for data processing.
  • Experience with cloud platforms (Azure, AWS, or GCP) for hosting Databricks and related services.
  • Knowledge of data modeling, data governance, and performance tuning.
  • Strong problem-solving skills and ability to work in cross-functional teams.

  • Data Architect

    2 weeks ago

    Chennai, Tamil Nadu, India Wavicle Data Solutions Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Job Title: Data Architect – AWS & GCP Experience: 11 Years Location: Remote / Hybrid Job Type: Full-timeAbout the Role:We are seeking an experienced Data Architect with deep expertise in AWS and Google Cloud Platform (GCP). The ideal candidate will have a proven track record in designing and implementing scalable, secure, and high-performance data...

  • Principal Software Architect

    2 weeks ago

    Chennai, Tamil Nadu, India beBeeSoftware Full time ₹ 1,80,00,000 - ₹ 2,40,00,000

    Job Title: Principal Software ArchitectWe seek an experienced Principal Software Architect to lead our team of developers and drive the design and implementation of web applications.The ideal candidate will have a strong background in software development, with expertise in JavaScript, React.js, and Java. They will be responsible for overseeing the...

  • Principal Data Engineer

    3 weeks ago

    Chennai, Tamil Nadu, India Citigroup Full time

    The RoleWe are looking for a hands-on Principal Data Engineer who is passionate about solving business problems through innovation and engineering practices As a Principal Data Engineer you will leverage your deep technical knowledge to drive the creation of high-quality software products You will also be expected to mentor other engineers share your...

  • Project Architect

    3 weeks ago

    Chennai, Tamil Nadu, India Modarchs Consultants Chennai (P) Ltd. Full time

    Do you want to be working directly under the two Principal Architects with a combined experience of 60 plus years ? Do you want to be involved in the design process? Then you should join Modarchs Consultants Chennai (MCC) which is a boutique design firm focusing silently on high quality design projects. The firm has designed a lot of landmarks in South India...

  • Project Architect

    2 weeks ago

    Chennai, Tamil Nadu, India Modarchs Consultants Chennai (P) Ltd. Full time

    Do you want to be working directly under the two Principal Architects with a combined experience of 60 plus years ? Do you want to be involved in the design process? Then you should join Modarchs Consultants Chennai (MCC) which is a boutique design firm focusing silently on high quality design projects. The firm has designed a lot of landmarks in South...

  • Project Architect

    2 weeks ago

    Chennai, Tamil Nadu, India Modarchs Consultants Chennai (P) Ltd. Full time

    Do you want to be working directly under the two Principal Architects with a combined experience of 60 plus years ? Do you want to be involved in the design process? Then you should join Modarchs Consultants Chennai (MCC) which is a boutique design firm focusing silently on high quality design projects. The firm has designed a lot of landmarks in South...

  • Strategic Data Solutions Architect

    2 weeks ago

    Chennai, Tamil Nadu, India beBeeDataProtection Full time ₹ 25,00,000 - ₹ 30,00,000

    Senior Principal Consultant OpportunityAs a Senior Principal Consultant, you will play a pivotal role in shaping the future of work by driving innovation in AI and digital technologies.We seek an experienced professional with expertise in AWS DataLake services to join our dynamic team. In this position, you will be responsible for designing and implementing...

  • Principal SW Engineer

    2 hours ago

    Chennai, Tamil Nadu, India Gigamon Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Gigamon provides an intelligent Visibility Fabric architecture for enterprises, data centers and service providers around the globe. Our technology empowers infrastructure architects, managers and operators with pervasive and dynamic intelligent visibility of traffic across both physical and virtual environments without affecting the performance or...

  • Awareness of Data Structure as a SQL Developer

    3 weeks ago

    Chennai, Tamil Nadu, India GS Infotech Full time

    Awareness of Data Structure as a SQL Developer Job Description Role/: Our data/-driven operations rely heavily on you as a SQL Developer. Writing queries isn't enough; you also need to be the principal architect who creates, develops, and optimises the databases that power our entire company. In order to guarantee the precision, functionality, and...

  • Principal Engineer, Director

    4 days ago

    Chennai, Tamil Nadu, India NatWest Group Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Join us as a Principal EngineerThis is a challenging role that will see you design and engineer software with the customer or user experience as the primary objectiveWith your software development background, you'll be working with architects to help define major components of the business-wide target architecture and roadmapYou'll gain valuable senior...