Fabric Data Engineer

7 days ago


Kota, India Thinkgrid Labs Full time

Thinkgrid Labs is at the forefront of innovation and technology. Our expert team of software engineers, architects, and UI/UX designers specialises in crafting bespoke web, mobile, cloud applications, data platforms along with AI solutions and intelligent bots. Thinkgrid Labs is expanding our data practice to stand up Microsoft Fabric for a US health insurer. This role unlocks fast, reliable Bronze-layer ingestion. You’ll own Fabric Mirroring from SQL Server and other sources into OneLake, manage CDC and schema drift at scale, and design resilient, high-volume ingestion pipelines that teams can trust.


Job Title: Fabric Data Engineer

Location: Remote

Working Hours: 2 PM IST to 11 PM IST

Experience Required: 6–10 years in data engineering; 2+ years on Azure data platforms with hands-on Microsoft Fabric (Mirroring/Lakehouse/Warehouse)

Education: Bachelor’s or Master’s degree in Computer Science, Health Informatics, or Business

Preferred certifications: DP-600, DP-203, DP-500


Who are you?

  • SQL & CDC Pro: Strong SQL Server/T-SQL; hands-on CDC or replication patterns for initial snapshot + incremental syncs, including delete handling.
  • Fabric Mirroring Practitioner: You’ve set up and tuned Fabric Mirroring to land data into OneLake/Lakehouse; comfortable with OneLake shortcuts and workspace/domain organisation.
  • Schema-Drift Aware: You detect, evolve, and communicate schema changes safely (contracts, tests, alerts), minimising downstream breakage.
  • High-Volume Ingestion Mindset: You design for throughput, resiliency, and backpressure—retries, idempotency, partitioning, and efficient file sizing.
  • Python/Scala/Spark Capable: You can build notebooks/ingestion frameworks for advanced scenarios and data quality checks.
  • Operationally Excellent: You add observability (logging/metrics/alerts), document runbooks, and partner well with platform, security, and analytics teams.
  • Data Security Conscious: You respect PII/PHI, apply least privilege, and align with RLS/CLS patterns and governance guardrails.


What you will be doing?

  • Stand Up Mirroring: Configure Fabric Mirroring from SQL Server (and other relational sources) into OneLake; tune schedules, snapshots, retention, and throughput.
  • Land to Bronze Cleanly: Define Lakehouse folder structures, naming/tagging conventions, and partitioning for fast, organised Bronze ingestion.
  • Handle Change at Scale: Implement CDC—including soft/hard deletes, late-arriving data, and backfills—using reliable watermarking and reconciliation checks.
  • Design Resilient Pipelines: Build ingestion with Fabric Data Factory and/or notebooks; add retries, dead-lettering, and circuit-breaker patterns for fault tolerance.
  • Manage Schema Drift: Automate drift detection and schema evolution; publish change notes and guardrails so downstream consumers aren’t surprised.
  • Performance & Cost Tuning: Optimise batch sizes, file counts, partitions, parallelism, and capacity usage to balance speed, reliability, and spend.
  • Observability & Quality: Instrument lineage, logs, metrics, and DQ tests (nulls, ranges, uniqueness); set up alerts and simple SLOs for ingestion health.
  • Collaboration & Documentation: Partner with the Fabric Platform Architect on domains, security, and workspaces; document pipelines, SLAs, and runbooks.


Must-have skills

  • SQL Server, T-SQL; CDC/replication fundamentals
  • Microsoft Fabric Mirroring; OneLake/Lakehouse; OneLake shortcuts
  • Schema drift detection/management and data contracts
  • Familiarity with large, complex relational databases
  • Python/Scala/Spark for ingestion and validation
  • Git-based workflow; basic CI/CD (Fabric deployment pipelines or Azure DevOps)


Benefits

  • 5 day work week
  • 100% remote setup with flexible work culture and international exposure
  • Opportunity to work on mission-critical healthcare projects impacting providers and patients globally



  • GCP Data Engineer

    4 weeks ago


    Kota, Rajasthan, India CustomerLabs 1P Data OPs Full time

    Position Overview:"Yesterday is history, tomorrow is a mystery, but today is a gift. That's why we call itthe present." - Master OogwayJoin CustomerLabs' dynamic data team as a Data Engineer and play a pivotal role intransforming raw marketing data into actionable insights that power our digitalmarketing platform. As a key member of our data infrastructure...

  • Data Engineer

    4 weeks ago


    Kota, Rajasthan, India R Systems Full time

    Job Title: Data EngineerContract Period: 12 MonthsLocation: Offshore candidates accepted (Singapore Based Company)Work Timing : 6.30 AM to 3.30 PM or 7.00 AM to 4.00 PM (IST - India timing)ExperienceMinimum 4+ years as a Data Engineer or similar role.(Please don't apply if less than 4 years exp in Data Engineer)Proven experience in Python, Spark, and PySpark...

  • Data Engineer

    2 weeks ago


    Kota, Rajasthan, India NAM Info Inc Full time

    Dear, Hope you are doing well. Please find the below job description. Kindly share the resume along with contact details and send it to NOTE: ALL 5 DAYS ONSITE. We need to start ASAP, within 2-3 weeks. 1 MONTH NOTICE CANDIDATES EXCUSE PLEASE. Job Title: Data Engineer with Strong AWS, Snowflake or with Azure & DB Location: 2nd Stage Banashankari,...


  • Kota, Rajasthan, India Black Dog Labs Full time

    Position : Lead Data Platform Engineer Location : Remote (collaboration across time zones), India or LATAM preferred Engagement Type : Contract Language : Fluent English Experience : 9+ years in Data Engineering / Backend Engineering / DevOps, including leadership of a team (or end-to-end ownership of large, multi-stakeholder projects) About the Role We're...

  • Senior Data Engineer

    3 weeks ago


    Kota, Rajasthan, India Visit Health Full time

    About usVisit Health is changing the face of employee health and wellness in India. 1 mn+ users across 200+ large Indian conglomerates to new age start-ups trust Visit as their Health and Wellness Partner, catering to the missing and unexplored Wellness Primary Healthcare needs.Traditionally, Employee Health Benefits were synonymous with...


  • Kota, India HappieHire Full time

    Role: SPM - Mechanical Design Engineer.Location: Bangalore.Employment type: Full-time.Experience required: 7-15 yearsBudget: 8-13 LPA (Based on experience)Working days: 6 working days (Mon-sat)Overall Purpose of the Role:Automation, Design of mechanical engineering components, design and development of SPM, Design review and Checking of 2D detail...


  • Kota, India Backgammon Galaxy Full time

    Company DescriptionBackgammon Galaxy is a leading web and mobile platform designed to offer exceptional backgammon features and thrilling game design. The software, developed by the best subject matter experts, ensures fast and aesthetically pleasing gameplay, server-based analysis, learning tools, ELO ratings, and leaderboards. The platform demonstrates...

  • Data & AI Architect

    3 weeks ago


    Kota, Rajasthan, India Delphi Consulting Middle East Full time

    Ready to embark on a journey where your growth is intertwined with our commitment to making a positive impact? Join the Delphi family - where Growth Meets Values.At Delphi Consulting Pvt. Ltd., we foster a thriving environment with a hybrid work model that lets you prioritize what matters most. Interviews and onboarding are conducted virtually, reflecting...


  • Kota, Rajasthan, India CYAN360 Full time

    Position: Senior AWS Data EngineerLocation: RemoteSalary: OpenWork Timings: 2:30 PM to 11:30 PM IST*** Need someone who can join immediately or in 15 days***Responsibilities:Design, develop, and deploy end-to-end data pipelines on AWS cloud infrastructure using services such as Amazon S3, AWS Glue, AWS Lambda, Amazon Redshift, etc.Implement data processing...


  • Kota, Rajasthan, India World Wide Technology Full time

    World Wide Technology Holding Co, LLC (WWT) is a privately held global technology integrator and supply chain solutions provider. Through our culture of innovation, we inspire, build and deliver business results, from idea to outcome.Based in St. Louis, WWT works closely with industry leaders such as Cisco, VMware, NetApp, Dell EMC, HPE and several others,...