Optimum InfoSystem

1 week ago

Pune, Maharashtra, India optimum solutions Full time

Job Summary :

We are seeking a skilled and experienced Azure Databricks Engineer to join our growing data engineering team. The ideal candidate will have deep hands-on expertise in building scalable data pipelines and streaming architectures using Azure-native technologies. Prior experience in the banking or financial services domain is highly desirable, as you will be working with critical data assets and supporting regulatory, risk, and operational reporting use cases.

Key Responsibilities :

- Design, develop, and optimize data pipelines using Databricks (PySpark) for batch and real-time data processing.

- Implement CDC (Change Data Capture) and Delta Live Tables/Autoloader to support near-real-time ingestion.

- Integrate various structured and semi-structured data sources using ADF, ADLS, and Kafka (Confluent).

- Develop CI/CD pipelines for data engineering workflows using GitHub Actions or Azure DevOps.

- Write efficient and reusable SQL and Python code for data transformations and validations.

- Ensure data quality, lineage, governance, and security across all ingestion and transformation layers.

- Collaborate closely with business analysts, data scientists, and data stewards to support use cases in risk, finance, compliance, and operations.

- Participate in code reviews, architectural discussions, and documentation efforts.

Required Skills & Qualifications :

- Strong proficiency in SQL, Python, and PySpark.

- Proven experience with Azure Databricks, including notebooks, jobs, clusters, and Delta Lake.

- Experience with Azure Data Lake Storage (ADLS Gen2) and Azure Data Factory (ADF).

- Hands-on with Confluent Kafka for streaming data integration.

- Strong understanding of Autoloader, CDC mechanisms, and Delta Lake-based architecture.

- Experience implementing CI/CD pipelines using GitHub and/or Azure DevOps.

- Knowledge of data modeling, data warehousing, and data security best practices.

- Exposure to regulatory and risk data use cases in the banking/financial sector is a strong plus.

Preferred Qualifications :

- Azure certifications (e.g., Azure Data Engineer Associate).

- Experience with tools such as Delta Live Tables, Unity Catalog, and Lakehouse architecture.

- Familiarity with business glossaries, data lineage tools, and data governance frameworks.

- Understanding of financial data including GL, loan, customer, transaction, or market risk domains.

(ref:hirist.tech)

  • Data QA

    2 weeks ago

    Pune, Maharashtra, India Optimum Solutions Pte Ltd Full time US$ 90,000 - US$ 1,20,000 per year

    JOB DETAILS:Role:- Data QAClient– Xplor TechnologiesExperience Level- 6+ YearsLocation- Pune (Kharadi)4 Days work from OfficeLook for Immediate to 10 Days joineeMandatory Skills:-Strong testing background in Data warehouse, SSIS packages and reporting.Extensive experience in data migration and data warehouse.Comprehensive technical testing experience in...

  • Project Manager

    2 weeks ago

    Chennai, Pune, India Optimum Infosystem Full time US$ 90,000 - US$ 1,20,000 per year

    Qualifications12 years of experience in the Banking/ Fintech/IT sector with at-least 4 years of exposure to Mobile banking & Internet banking projects / programs with min 3 years of Banking sector experience.Good acquaintance to Project management tools and Mobile App release mechanisms.Deep expertise in Scrum, with exposure to one or more Agile...

  • Tech Lead React Native

    2 weeks ago

    Chennai, Pune, India Optimum Infosystem Full time US$ 90,000 - US$ 1,20,000 per year

    8+ years of experience in developing mobile apps using React Native frameworkExperience in Leading a team is Must.Strong knowledge of ES6, Typescript.Strong knowledge of Unit testing frameworks.Familiarity with push notifications, and cloud messaging application programming interfacesExperience of working with XML/JSON data models and integration with REST...

  • Software Developer

    2 weeks ago

    Bengaluru, Chennai, Pune, India Optimum Infosystem Full time US$ 90,000 - US$ 1,20,000 per year

    Roles and ResponsibilitiesDesign, develop, test, deploy, and maintain large-scale software applications using Java and Spring Boot.Collaborate with cross-functional teams to identify requirements and deliver high-quality solutions.Implement microservices architecture to improve scalability, reliability, and maintainability of the system.Participate in code...

  • React Native Developer

    2 weeks ago

    Bengaluru, Chennai, Pune, India Optimum Infosystem Full time US$ 90,000 - US$ 1,20,000 per year

    Roles and ResponsibilitiesDesign, develop, test, and maintain high-quality mobile applications using React Native.Collaborate with cross-functional teams to identify requirements and implement solutions.Ensure seamless integration of third-party libraries and APIs into the application.Troubleshoot issues related to app performance, memory leaks, and...