Fabric data engineer
4 weeks ago
Thinkgrid Labs is at the forefront of innovation and technology. Our expert team of software engineers, architects, and UI/UX designers specialises in crafting bespoke web, mobile, cloud applications, data platforms along with AI solutions and intelligent bots. Thinkgrid Labs is expanding our data practice to stand up Microsoft Fabric for a US health insurer. This role unlocks fast, reliable Bronze-layer ingestion. You’ll own Fabric Mirroring from SQL Server and other sources into One Lake, manage CDC and schema drift at scale, and design resilient, high-volume ingestion pipelines that teams can trust.Job Title: Fabric Data EngineerLocation: RemoteWorking Hours: 2 PM IST to 11 PM ISTExperience Required: 6–10 years in data engineering; 2+ years on Azure data platforms with hands-on Microsoft Fabric (Mirroring/Lakehouse/Warehouse)Education: Bachelor’s or Master’s degree in Computer Science, Health Informatics, or BusinessPreferred certifications: DP-600, DP-203, DP-500Who are you?SQL & CDC Pro: Strong SQL Server/T-SQL; hands-on CDC or replication patterns for initial snapshot + incremental syncs, including delete handling.Fabric Mirroring Practitioner: You’ve set up and tuned Fabric Mirroring to land data into One Lake/Lakehouse; comfortable with One Lake shortcuts and workspace/domain organisation.Schema-Drift Aware: You detect, evolve, and communicate schema changes safely (contracts, tests, alerts), minimising downstream breakage.High-Volume Ingestion Mindset: You design for throughput, resiliency, and backpressure—retries, idempotency, partitioning, and efficient file sizing.Python/Scala/Spark Capable: You can build notebooks/ingestion frameworks for advanced scenarios and data quality checks.Operationally Excellent: You add observability (logging/metrics/alerts), document runbooks, and partner well with platform, security, and analytics teams.Data Security Conscious: You respect PII/PHI, apply least privilege, and align with RLS/CLS patterns and governance guardrails.What you will be doing?Stand Up Mirroring: Configure Fabric Mirroring from SQL Server (and other relational sources) into One Lake; tune schedules, snapshots, retention, and throughput.Land to Bronze Cleanly: Define Lakehouse folder structures, naming/tagging conventions, and partitioning for fast, organised Bronze ingestion.Handle Change at Scale: Implement CDC—including soft/hard deletes, late-arriving data, and backfills—using reliable watermarking and reconciliation checks.Design Resilient Pipelines: Build ingestion with Fabric Data Factory and/or notebooks; add retries, dead-lettering, and circuit-breaker patterns for fault tolerance.Manage Schema Drift: Automate drift detection and schema evolution; publish change notes and guardrails so downstream consumers aren’t surprised.Performance & Cost Tuning: Optimise batch sizes, file counts, partitions, parallelism, and capacity usage to balance speed, reliability, and spend.Observability & Quality: Instrument lineage, logs, metrics, and DQ tests (nulls, ranges, uniqueness); set up alerts and simple SLOs for ingestion health.Collaboration & Documentation: Partner with the Fabric Platform Architect on domains, security, and workspaces; document pipelines, SLAs, and runbooks.Must-have skillsSQL Server, T-SQL; CDC/replication fundamentalsMicrosoft Fabric Mirroring; One Lake/Lakehouse; One Lake shortcutsSchema drift detection/management and data contractsFamiliarity with large, complex relational databasesPython/Scala/Spark for ingestion and validationGit-based workflow; basic CI/CD (Fabric deployment pipelines or Azure Dev Ops)Benefits5 day work week100% remote setup with flexible work culture and international exposureOpportunity to work on mission-critical healthcare projects impacting providers and patients globally
-
Data Engineer
5 days ago
Solapur, India Jaipur Rugs Full timeOrganization Description: Jaipur Rugs is a social enterprise that connects rural craftsmanship with global markets through its luxurious handmade carpets. It is a family-run business that offers an exclusive range of hand-knotted and hand-woven rugs made using 2500 years old traditional art forms. The founder, Mr. Nand Kishore Chaudhary created a unique...
-
Data Engineer
4 days ago
Solapur, India Jaipur Rugs Full timeOrganization Description: Jaipur Rugs is a social enterprise that connects rural craftsmanship with global markets through its luxurious handmade carpets. It is a family-run business that offers an exclusive range of hand-knotted and hand-woven rugs made using 2500 years old traditional art forms. The founder, Mr. Nand Kishore Chaudhary created a unique...
-
15h Left! Senior Azure Data Engineer
1 week ago
Solapur, India Programmers.io Full timeJob Title: Senior Azure Data Engineer Job Location: Remote Skills Required: Azure Synapse, Azure Data Factory, Azure Databricks, and ADLS Gen2, PySpark, SQL,Microsoft Fabrics. Experience Range: 5 Years - 12 years Job Summary: We are seeking a highly skilled and experienced Senior Azure Data Engineer to join our team. The ideal candidate will have deep...
-
Data Engineer
2 weeks ago
Solapur, India IntraEdge Full timeWebsite-https://intraedge.com/ Job Title: Data Engineer Experience: 5+Years Location: [Remote] Senior Data Engineer The Senior Data Engineer will design, develop, monitor and maintain a robust and scalable data platform used by other data analyst and engineering teams to deliver powerful insights to both internal and external stakeholders Responsibilities...
-
Data Engineer
4 days ago
Solapur, India Insight Global Full timePosition: GCP Data Engineer Location: 100% Remote in IndiaDuration: 12 month contract + extensions + conversionsPackage: 10 LPA- 26 LPAInterview Process: 2 RoundsREQUIRED SKILLS AND EXPERIENCE6+ Years of experience as a Data Engineer Experience with GCP Data ie. Big Query, Cloud Storage, BigTable, Airflow, Dataproc, Dataflow Strong SQL experience (NoSQL,...
-
Data Engineer
5 days ago
Solapur, India Insight Global Full timePosition: GCP Data Engineer Location: 100% Remote in IndiaDuration: 12 month contract + extensions + conversionsPackage: 10 LPA- 26 LPAInterview Process: 2 RoundsREQUIRED SKILLS AND EXPERIENCE6+ Years of experience as a Data Engineer Experience with GCP Data ie. Big Query, Cloud Storage, BigTable, Airflow, Dataproc, Dataflow Strong SQL experience (NoSQL,...
-
Data Engineer
4 weeks ago
Solapur, India Rakuten Symphony Full timeDesignation: Data Engineer (4-8 Yrs Experience)Location: Bangalore, India (Hybrid)Why should you choose us? Rakuten Symphony is a Rakuten Group company, that provides global B2B services for the mobile telco industry and enables next-generation, cloud-based, international mobile services. Building on the technology Rakuten used to launch Japan’s newest...
-
Enterprise data
6 days ago
Solapur, India Nexora Tech Solutions Full timeJoin Nexora Tech as a Strategic Partner – Enterprise Data & Analytics ArchitectAbout Nexora Tech:Nexora Tech, founded by Aparna Kumar (Former CIO – SBI, HSBC, and leadership positions at HDFC Bank, Capgemini, Oracle and Citi), is a boutique technology advisory firm that partners with CXOs and Boards to deliver digital transformation, AI/ML strategy, IT...
-
Senior mechanical engineer
6 days ago
Solapur, India Lumilens Full timeABOUT LUMILENS At Lumilens we are building the critical photonics infrastructure that powers tomorrow’s AI supercomputing. From chip-to-chip optical interconnects to scalable photonic engines, Lumilens is unlocking a new era of computing - faster, cooler, and massively more efficient.We’re a well-funded startup backed by Mayfield and led by veterans...
-
▷ [3 Days Left] Data Engineer
3 weeks ago
Solapur, India Xebia Full time🚀 We’re Hiring: Data Engineer | Xebia 📍 Location: Any Xebia location (Hybrid, 3 days office per week) 🕒 Experience: 6+ years ⏳ Notice Period: Immediate to 2 weeks – only apply if you can join early We are seeking an experienced Data Engineer with strong expertise in Databricks, Python, SQL, and Postgres. The ideal candidate will also have...