Java/Scala Connector SDK Developer/Lead

Job Title
: Java/Scala Connector SDK Developer/Lead

Location
: Chennai

Employment Type
: Full-Time/Contract

Joining
: Immediate [Preferred]

Tech Stack:
Java (JDK 8+) and Scala, Gradle/Maven, Public Connector SDKs, ODBC, REST, JDBC, PF4J, SLF4J, POI, Data Fabric

We are seeking an experienced
Java/Scala Developer
to design, develop, and optimize connectors using an open-source SDK framework. This role will address a comprehensive backlog of connector requirements, encompassing data cataloging, synchronization, management, and integrations for heterogeneous systems. The developer will contribute to an enterprise-grade framework that supports metadata extraction, real-time synchronization, and efficient data management, facilitating a marketplace for extensible connectors within data fabric environments.

Responsibilities

• Develop Connectors
  : Build and maintain SDK-based connectors for diverse data sources, ensuring robust support for data cataloging, synchronization, management, and integrations in data fabric architectures.
• Implement SDK Interfaces
  : Utilize the SDK's factory and connection patterns to create modular components for metadata ingestion, validation, synchronization, and resource management across the backlog, incorporating data fabric principles for hybrid data orchestration.
• Backlog Prioritization
  : Collaborate on resolving a portfolio of connector needs, including data catalog enhancements, synchronization workflows, and integration pipelines for 20+ systems, leveraging concepts from data fabrics and similar tools.
• Framework Enhancement
  : Abstract and generalize the SDK architecture to support versioning, CI/CD integration, plugin deployment, data management protocols, real-time synchronization mechanisms, and seamless integration with data fabric platforms.
• Logging and Monitoring
  : Integrate standard logging mechanisms (SLF4J) to facilitate debugging, performance tracking, and compliance in enterprise data environments, aligned with data fabric governance standards.
• Team Collaboration
  : Work within a multidisciplinary pod model, including data engineers and architects, to deliver solutions in iterative sprints focused on connector SDK development and data fabric compatibility.
• Documentation and Deployment
  : Package connectors for marketplace distribution, provide comprehensive documentation on data catalog integration, synchronization processes, management features, and data fabric orchestration.

Required Qualifications

• Experience
  : 3+ years in Java/Scala development, with proven expertise in API integrations, data synchronization, and metadata handling within data fabric or similar architectures.
• Technical Skills
  :
• Proficiency in Java (JDK 8+) and Scala, along with build tools like Gradle or Maven.
• Familiarity with file parsing libraries (Apache POI) and data access protocols (ODBC, REST, JDBC).
• Understanding of logging APIs (SLF4J) and plugin frameworks (PF4J) for modular development.
• Soft Skills
  : Strong analytical abilities, effective collaboration in team settings, and precise documentation skills.
• Education
  : Bachelor's degree in computer science, Information Technology, or a related field (or equivalent professional experience).

Preferred Qualifications

• SDK Expertise
  : Hands-on experience with open-source connector SDKs or similar plugin frameworks (PF4J), with a focus on connector SDK development for data catalogs and integrations in data fabric environments.
• Integration Knowledge
  : Background in data intelligence platforms, with exposure to hybrid environments and tools like Apache Camel or ETL frameworks for synchronization and management, including data fabric implementations.
• Enterprise Tools
  : Familiarity with metadata catalogs, governance practices, and real-time data processing in multi-source ecosystems, such as Data Fabric or comparable solutions (Microsoft Fabric, Denodo).
• Additional Skills
  : Proficiency in handling diverse data sources, including legacy systems and cloud APIs, emphasizing scalability, performance, and data management standards within unified data architectures.

Key Deliverables

• A suite of SDK-based connectors addressing the full backlog, with advanced metadata synchronization and management capabilities integrated into data fabric workflows.
• An abstracted framework design supporting plugin modularity, data catalog integration, marketplace deployment, and data fabric orchestration.
• Sprint-based outputs, including prototypes for high-priority integrations and a roadmap for ongoing enhancements in synchronization and management.
• Comprehensive testing and documentation to ensure reliability in enterprise deployments.

To Apply

Send your CV to

and a
Cover Letter [Important]
in the format below
.

Cover Letter:
[
To be Submitted along with the CV
]

1. Hands on Experience Self Rating Levels [ 1 to 5]:

• Java Development (JDK 8+)
• Scala Development
• Build Tools (Gradle or Maven)
• Data Access Protocols (ODBC, REST, JDBC)
• Open-Source Connector SDKs
• Plugin Frameworks and Logging APIs (PF4J, SLF4J)
• Data Fabric Experience
• Metadata Catalogs and Governance
• File Parsing Libraries & Real-Time Data Processing
• Handling Diverse Data Sources

2. Expectations:

• Current Location
• Current Organization
• Current CTC
• Expected CTC
• Availability to Join/Notice Period
• Open to come to Office Location [Chennai]

3. What is your understanding of the role and responsibilities?

4. Why do you think you are a fit for the role?

5. Hands-on Project Experience highlight details on above self-rating skills [If any]