SXM Deltalake Developer

3 weeks ago


india Marlabs LLC Full time

Description:

What you’ll do
• Spearhead the development of conceptual, logical, and physical data models, while
• implementing data marts/data warehouse/data lake/data lakehouse on Spark-based
• platforms
• Analyse existing models to identify variances/gaps and devise strategies to achieve
• alignment.
• Establish and enforce best practices and standards for data models.
• Generate Data Flow diagrams and relevant artifacts to depict data integrations within
• targeted systems.
• Collaborate closely with Data Owners to understand business data requirements and
• clarify terms and business rules.
• Facilitate walkthrough sessions with Data Owners and stakeholders to review and
• validate data models for accuracy.
• Demonstrate strong communication skills and effective engagement with delivery
• colleagues to ensure successful project outcomes.
• Comply with Data Architecture standards and guardrails.
• Proactively manage issues, risks, actions, and dependencies, escalating when
• necessary.

Experience:
Must have:
• Possess a minimum of 5+ years of Data Modelling experience in Data Lake/Delta
• Lakehouse/Data Warehouse on Spark based platforms on AWS
• Demonstrate a minimum of 1 year of experience working with/in Databricks.
• Mandatory experience of Data Modelling on Delta Lakehouse
• Knowledge in handling Spark streaming data over Delta Lakehouse.
• Hands-on experience with data modelling tools for performing reverse and forward
• engineering of as-is and to-be data models, in any of the industry leading data modelling
• tools such as Erwin/ ER/Studio etc.
• Utilize visual notations for expressing data logical and physical models, state transitions,
• transformations, and versioning. Familiarity with UML, DPMN, ERDs, etc. is ideal.



  • india Marlabs LLC Full time

    Description: What you’ll do • Spearhead the development of conceptual, logical, and physical data models, while • implementing data marts/data warehouse/data lake/data lakehouse on Spark-based • platforms • Analyse existing models to identify variances/gaps and devise strategies to achieve • alignment. • Establish and enforce best...

  • Senior Data Engineer

    2 months ago


    india Circuitry.ai Full time

    Job Description: Location: Hyderabad, India - Hybrid Remote (3 days a week in office preferred) Position Overview: As a Data Engineer focused on AI development, you will play a pivotal role in the design, development, and deployment of data infrastructure and pipelines that support artificial intelligence and machine learning initiatives within...


  • india o9 Solutions, Inc. Full time

    Be part of something revolutionary At o9 Solutions, our mission is clear: be the Most Valuable Platform (MVP) for enterprises. With our AI-driven platform — the o9 Digital Brain — we integrate global enterprises’ siloed planning capabilities, helping them capture millions and, in some cases, billions of dollars in value leakage. But our impact...