Senior Data Engineer

About the Company :

Headquartered in California, U.S.A., GSPANN provides consulting and IT services to global clients. We help clients transform how they deliver business value by helping them optimize their IT capabilities, practices, and operations with our experience in retail, high-technology, and manufacturing. With five global delivery centers and 1900+ employees, we provide the intimacy of a boutique consultancy with the capabilities of a large IT services firm.

Role:
Senior Data Engineer

Experience: 6 Yrs - 12 Yrs

Work Location:
Gurugram/Hyderabad

Skills:
ADF, Azure Databricks, Microsoft Fabric (OneLake, PySpark & SparkSQL, Delta Tables, JSON Processing, API Integration, Medallion Architecture, Large‑Scale Performance, Optimization, Multidimensional Modeling, Azure Analysis Services & Cubes, DevOps Collaboration

We are looking for an experienced Infrastructure Delivery Manager to lead and oversee Infrastructure Hosting. The ideal candidate will bring strong delivery management capabilities, excellent client-facing communication, and a track record of managing cross-functional teams in high-paced environments.

Role & responsibilities

• Azure Data Factory (ADF):
  design, develop and orchestrate scalable data pipelines
• Azure Databricks:
  build and manage Spark clusters, notebooks, and jobs
• Microsoft Fabric (OneLake):
  ingest, organize and transform data within the Fabric ecosystem
• PySpark & SparkSQL:
  author complex transformations and SQL queries for large‑scale data processing
• Delta Tables:
  create, optimize and maintain Delta Lake tables (VACUUM, ZORDER, OPTIMIZE)
• JSON Processing:
  parse, validate and transform semi‑structured JSON datasets
• API Integration:
  consume and build REST/OData services for custom data ingestion
• Medallion Architecture:
  implement bronze‑silver‑gold layers in data lakes for clean, reliable data
• Large‑Scale Performance Optimization:
  partitioning, caching, resource tuning to efficiently process high volumesof data
• Multidimensional Modeling:
  design star/snowflake schemas, fact and dimension tables for reporting use cases
• Azure Analysis Services & Cubes:
  understand tabular and OLAP cube structures to enable downstream BI
• DevOps Collaboration:
  partner with the DevOps team to define infrastructure, manage access/security, andautomate deployments

Preferred candidate profile

• SAP Integration via Data Sphere:
  ingest and harmonize data from SAP ECC/S4HANA systems
• CI/CD & DevOps Tooling:
  Git, Azure DevOps Pipelines, Terraform or ARM templates
• Data Observability & Monitoring:
  leverage Azure Monitor, Log Analytics, and data pipeline metrics
• Performance Troubleshooting:
  query diagnostics, bottleneck analysis, and root‑cause identification
• Data Governance & Cataloging:
  apply metadata management, data lineage, and compliance best practices
• Confluence:
  for documentation

Why choose GSPANN

"We GSPANNians" are at the heart of the technology that we pioneer. We do not service our customers, we co-create.

With the passion to explore solutions to the most challenging business problems, we support and mentor the technologist in everyone who is a part of our team. This translates into innovations that are path-breaking and inspirational for the marquee clients, we co-create a digital future with.

GSPANN is a work environment where you are constantly encouraged to sharpen your abilities and shape your growth path, We support you to become the best version of yourself by feeding your curiosity, providing a nurturing environment, and giving ample opportunities to take ownership, experiment, learn and succeed.

We're a close-knit family of more than 1400 people that supports one another and celebrates successes, big or small. We work together, socialize together, and actively serve the communities we live in.

We invite you to carry forward the baton of innovation in technology with us.

At GSPANN, we do not service. We Co-create.

Discover your inner technologist -
Explore and expand the boundaries of tech innovation without the fear of failure.

Accelerate your learning -
Shape your career while scripting the future of tech. Seize the ample learning opportunities to grow at a rapid pace

Feel included -
At GSPANN, everyone is welcome. Age, gender, culture, and nationality do not matter here, what matters is YOU

Inspire and Be Inspired -
When you work with the experts, you raise your game. At GSPANN, you're in the company of marquee clients and extremely talented colleagues

Enjoy Life -
We love to celebrate milestones and victories, big or small. Ever so often, we come together as one large GSPANN family

Give Back -
Together, we serve communities. We take steps, small and large so we can do good for the environment, weaving in sustainability and social change in our endeavors

We invite you to carry forward the baton of innovation in technology with us.

Let's Co-create.