Senior Data Engineer

1 week ago

Nellore, Andhra Pradesh, India Mastek Full time

Role : Data Engineer – Databricks

Job Type: Full-Time

About the Role

We are seeking a highly skilled Data Engineer to design, develop, and maintain data pipelines that extract data from Oracle Symphony via APIs, process and store it in the Databricks Lakehouse platform, and then integrate it into Oracle EPM (Enterprise Performance Management). This role requires deep expertise in data integration, ETL/ELT, APIs, and Databricks. The candidate will work closely with business stakeholders, architects, and analysts to ensure seamless data flow, transformation, and availability for financial planning, reporting, and analytics.

Key Responsibilities

  • Design and implement end-to-end pipelines from Oracle Symphony (API extraction) into Databricks Lakehouse.
  • Develop efficient ETL/ELT processes in Databricks (PySpark, Delta Lake) to transform, cleanse, and enrich data.
  • Build and maintain data flows from Databricks into Oracle EPM to support reporting, forecasting, and planning.
  • Ensure data quality, consistency, and governance across Symphony, Databricks, and EPM.
  • Optimize pipeline performance, scalability, and reliability.
  • Collaborate with data architects, finance teams, and Oracle specialists to meet business needs.
  • Troubleshoot pipeline issues and provide production support for data integration processes.
  • Document architecture, pipeline logic, and integration workflows.
  • Stay current on Databricks, Oracle, and API integration best practices.

Required Skills & Qualifications

  • Bachelor's or Master's degree in Computer Science, Data Engineering, or related field.
  • 5+ years of experience in data engineering, ETL/ELT, and data pipeline development.
  • Hands-on experience with Databricks (PySpark, Delta Lake, MLflow).
  • Strong experience with APIs (REST, SOAP, JSON, XML) for data extraction and integration.
  • Proficiency in SQL, Python, and Spark for data processing.
  • Experience with cloud platforms (Azure, AWS, or GCP) for hosting Databricks and related services.
  • Knowledge of data modeling, data governance, and performance tuning.
  • Strong problem-solving skills and ability to work in cross-functional teams.

  • Senior Cloud Data Engineer

    1 week ago

    Nellore, Andhra Pradesh, India beBeeCloud Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Senior Cloud Data EngineerWe are seeking a seasoned Senior Cloud Data Engineer to spearhead the development of end-to-end data pipelines on cloud infrastructure.Key Responsibilities:Data Pipeline Development: Design, develop, and deploy scalable data pipelines using cloud services such as Amazon S3, AWS Glue, AWS Lambda, and Amazon Redshift.Data Processing...

  • Senior Financial Data Platform Engineer

    7 days ago

    Nellore, Andhra Pradesh, India beBeeEngineering Full time ₹ 18,00,000 - ₹ 24,00,000

    About this RoleThe Senior Engineer will be a key contributor in building and scaling modern financial data platforms.This role focuses on Snowflake, dbt, and financial systems integration to gain trusted insights and accurate financial reporting.As a Senior Engineer, you will work closely with other engineers, analysts, and Finance partners to design,...

  • Data Engineer

    6 days ago

    Nellore, Andhra Pradesh, India Coforge Full time

    Data Engineer - Informatica.Coforge Ltd. is seeking a Senior Data Engineer with a passion for crafting robust data pipelines to steer business strategies. If you excel in tackling intricate data hurdles and enjoy guiding others, this opportunity in Greater Noida could be your next career move. Job Location: Greater Noida Experience: 5 to 7 Years Send your CV...

  • Senior Data Engineer

    2 weeks ago

    Nellore, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Summary">We are seeking a highly skilled Data Architect with expertise in PostgreSQL and experience in building data warehouses and data lakes.The ideal candidate has a strong foundation in SQL engineering, cloud data architectures, and modern data pipelines.Key Responsibilities:Data Architecture: Design, build, and maintain a scalable PostgreSQL-based...

  • Senior Data Engineering Leader

    7 days ago

    Nellore, Andhra Pradesh, India beBeeData Full time ₹ 17,50,000 - ₹ 22,50,000

    About Us:At the heart of our organization is a commitment to innovation and customer satisfaction. We are currently seeking an experienced Senior Lead Engineer who will play a key role in developing and delivering cutting-edge data insights.Key Responsibilities:Lead initiatives with strategic focus and valueSolve complex technical problems, enabling team...

  • Cloud Data Engineer Leader

    4 days ago

    Nellore, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,40,00,000

    Senior Data EngineerWe are seeking a seasoned Senior Data Engineer to fill this key role. The ideal candidate will possess extensive experience in designing, building, and maintaining large-scale data pipelines on Google Cloud Platform.Key Responsibilities:Design and implement end-to-end data pipelines using GCP services such as BigQuery, Dataflow, Pub/Sub,...

  • Data Engineer

    2 weeks ago

    Nellore, Andhra Pradesh, India aQb Solutions Pvt Ltd Full time

    We are looking for a highly skilled Data Engineer with strong expertise in PostgreSQL and hands-on experience in building data warehouses and data lakes. In this role, you will design and implement a scalable PostgreSQL-based data warehouse and manage a data lake on AWS infrastructure, leveraging primarily open-source technologies.The ideal candidate has a...

  • Senior Data Engineer

    7 days ago

    Nellore, Andhra Pradesh, India beBeeData Full time ₹ 18,00,000 - ₹ 25,00,000

    Data Engineering Lead PositionWe are seeking a highly skilled Senior Data Engineer to design, develop and maintain robust ETL/ELT pipelines on AWS using Spark and PySpark.Design, develop and maintain scalable data pipelines on AWS using Apache Spark, PySpark, SQL and Python.Optimize large-scale data processing workflows for performance and reliability.Work...

  • Senior Backend Data Integration Engineer

    6 days ago

    Nellore, Andhra Pradesh, India beBeeBackend Full time ₹ 15,00,000 - ₹ 22,00,000

    Job Opportunity for Senior Backend EngineerWe are seeking a highly skilled backend engineer to develop and maintain our data integration pipelines.Pipeline Development: Design, build, and deploy scalable data fetching pipelines using Python and related technologies.Data Processing: Process job postings and CVs, eliminate duplicates, and implement...

  • Senior Data Engineering Expert

    1 week ago

    Nellore, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 18,00,000

    Job SummaryMain ResponsibilitiesConduct an assessment of the current data integration framework to identify areas for improvement and alignment with new requirements.Design and develop scalable Spark jobs using Scala to meet project needs, ensuring efficient execution and minimal latency.Analyze existing Spark jobs to enhance their performance,...