
Fabric data engineer
4 days ago
Thinkgrid Labs is at the forefront of innovation and technology. Our expert team of software engineers, architects, and UI/UX designers specialises in crafting bespoke web, mobile, cloud applications, data platforms along with AI solutions and intelligent bots. Thinkgrid Labs is expanding our data practice to stand up Microsoft Fabric for a US health insurer. This role unlocks fast, reliable Bronze-layer ingestion. You’ll own Fabric Mirroring from SQL Server and other sources into One Lake, manage CDC and schema drift at scale, and design resilient, high-volume ingestion pipelines that teams can trust.Job Title: Fabric Data EngineerLocation: RemoteWorking Hours: 2 PM IST to 11 PM ISTExperience Required: 6–10 years in data engineering; 2+ years on Azure data platforms with hands-on Microsoft Fabric (Mirroring/Lakehouse/Warehouse)Education: Bachelor’s or Master’s degree in Computer Science, Health Informatics, or BusinessPreferred certifications: DP-600, DP-203, DP-500Who are you?SQL & CDC Pro: Strong SQL Server/T-SQL; hands-on CDC or replication patterns for initial snapshot + incremental syncs, including delete handling.Fabric Mirroring Practitioner: You’ve set up and tuned Fabric Mirroring to land data into One Lake/Lakehouse; comfortable with One Lake shortcuts and workspace/domain organisation.Schema-Drift Aware: You detect, evolve, and communicate schema changes safely (contracts, tests, alerts), minimising downstream breakage.High-Volume Ingestion Mindset: You design for throughput, resiliency, and backpressure—retries, idempotency, partitioning, and efficient file sizing.Python/Scala/Spark Capable: You can build notebooks/ingestion frameworks for advanced scenarios and data quality checks.Operationally Excellent: You add observability (logging/metrics/alerts), document runbooks, and partner well with platform, security, and analytics teams.Data Security Conscious: You respect PII/PHI, apply least privilege, and align with RLS/CLS patterns and governance guardrails.What you will be doing?Stand Up Mirroring: Configure Fabric Mirroring from SQL Server (and other relational sources) into One Lake; tune schedules, snapshots, retention, and throughput.Land to Bronze Cleanly: Define Lakehouse folder structures, naming/tagging conventions, and partitioning for fast, organised Bronze ingestion.Handle Change at Scale: Implement CDC—including soft/hard deletes, late-arriving data, and backfills—using reliable watermarking and reconciliation checks.Design Resilient Pipelines: Build ingestion with Fabric Data Factory and/or notebooks; add retries, dead-lettering, and circuit-breaker patterns for fault tolerance.Manage Schema Drift: Automate drift detection and schema evolution; publish change notes and guardrails so downstream consumers aren’t surprised.Performance & Cost Tuning: Optimise batch sizes, file counts, partitions, parallelism, and capacity usage to balance speed, reliability, and spend.Observability & Quality: Instrument lineage, logs, metrics, and DQ tests (nulls, ranges, uniqueness); set up alerts and simple SLOs for ingestion health.Collaboration & Documentation: Partner with the Fabric Platform Architect on domains, security, and workspaces; document pipelines, SLAs, and runbooks.Must-have skillsSQL Server, T-SQL; CDC/replication fundamentalsMicrosoft Fabric Mirroring; One Lake/Lakehouse; One Lake shortcutsSchema drift detection/management and data contractsFamiliarity with large, complex relational databasesPython/Scala/Spark for ingestion and validationGit-based workflow; basic CI/CD (Fabric deployment pipelines or Azure Dev Ops)Benefits5 day work week100% remote setup with flexible work culture and international exposureOpportunity to work on mission-critical healthcare projects impacting providers and patients globally
-
Microsoft Azure Data
4 weeks ago
Solapur, Maharashtra, India Technofocus Full timeOverviewWe are seeking a Subject Matter Expert (SME) in Azure Data & AI to drive the technical depth, accuracy, and instructional value of our training content. You'll lead the definition and review of presentations, labs, and real-world scenarios on Azure's modern data and AI stack, working closely with content creators to shape advanced,...
-
Data Engineer
3 weeks ago
Solapur, Maharashtra, India Talescope Full timeAbout the Role:We are looking for a highly experienced and hands-on Data Engineer (AdTech) to lead our analytics team. This role is ideal for someone with a strong background in log-level data handling, cross-platform data engineering, and a solid command of modern BI tools. You'll play a key role in building scalable data pipelines, leading analytics...
-
Data Engineer
3 weeks ago
Solapur, Maharashtra, India Sapaad Full timeWHO WE ARESapaad is a global leader in unified commerce platforms, delivering world-class software solutions for the food and beverage industry. Our flagship product, also named Sapaad, has achieved remarkable success over the past decade, empowering thousands of F&B businesses across 40+ countries—with many more coming onboard each day.Driven by a...
-
Data Engineer
6 days ago
Solapur, India Rakuten Symphony Full timeDesignation: Data Engineer (4-8 Yrs Experience)Location: Bangalore, India (Hybrid)Why should you choose us? Rakuten Symphony is a Rakuten Group company, that provides global B2B services for the mobile telco industry and enables next-generation, cloud-based, international mobile services. Building on the technology Rakuten used to launch Japan’s newest...
-
Data engineer
2 weeks ago
Solapur, India Randstad Enterprise Full timeRole : Data EngineerLocation : RemoteShift Timing : 2:00 Pm - 11:00 PmExperience : 2- 4 years relevant only ( this is a Junior position with us )Must have skillset :GCP - 2 years minimumPython and Pyspark - 2 yearsSQL - 2 yearsExcellent communicationWorked with global stakeholdersWho we are:Randstad Sourceright’s global talent solutions provides instant...
-
Data Engineer
2 weeks ago
Solapur, India Randstad Enterprise Full timeRole : Data EngineerLocation : RemoteShift Timing : 2:00 Pm - 11:00 PmExperience : 2- 4 years relevant only ( this is a Junior position with us )Must have skillset :GCP - 2 years minimum working Experience Python and Pyspark - 2 yearsSQL - 2 yearsExcellent communicationWorked with global stakeholdersWho we are:Randstad Sourceright’s global talent solutions...
-
Senior Data Engineer
3 weeks ago
Solapur, Maharashtra, India Celebal Technologies Full timeJob Description- Senior Data Engineer (Teradata Migration Specialist)About Us Celebal Technologies is a leading Solution Service company that provides services in the fields of Data Science, Big Data, Enterprise Cloud, and Automation. We are at the forefront of leveraging cutting-edge technologies to drive innovation and enhance our business processes. As...
-
Junior Data and AI/ML Engineer
4 weeks ago
Solapur, Maharashtra, India Manastu Space Full timeJunior Data and AI/ML EngineerManastu Space Technologies • Full time • Navi Mumbai, Maharashtra, IndiaAbout Manastu SpaceWe believe that due to limited resources on the planet, there is a need to look out for an alternative to solve our problems, and that another side is space. This option is viable only if we have low-cost and sustainable access to...
-
Quality Assurance Lead
3 weeks ago
Solapur, Maharashtra, India DATA POEM Full timeCompany DescriptionData Poem is a core AI company focused on uncovering true causation in data, going beyond correlation. We have developed the world's first Large Causal Architecture, enabling organizations to derive deep, actionable insights. Our flagship product, POEM365, is an enterprise-scale AI model that leverages a vast data universe to deliver...
-
AWS Senior Data Engineer
3 weeks ago
Solapur, Maharashtra, India InfoCepts Full timeKey Result Areas and Activities: Study existing technology landscape and understand current data integration framework and do impact assessment for the requirements.Develop spark jobs using Scala for new project requirements.Enhance existing spark jobs for any ongoing product enhancement.Performance tuning of spark jobs, stress testing etc.Create new data...