Senior Data Engineer
2 weeks ago
Responsibilities
- ETL Development: Build and maintain ETL/ELT pipelines using Databricks & Apache Spark (PySpark/Scala).
- Data Warehousing: Design and implement Star Schema, Snowflake Schema, and Data Vault models.
- Databricks Optimization: Optimize Delta Lake storage, caching, and job execution to improve query performance.
- Databricks Optimization: Optimize Delta Lake storage, caching, and job execution to improve query performance.
- Data Ingestion & Processing: Develop scalable ingestion pipelines using Structured Streaming, Auto Loader, and Databricks Workflows.
- Data Governance & Security: Implement Unity Catalog, role-based access controls (RBAC), and compliance standards.
- Performance Tuning: Optimize Spark jobs, partitioning strategies, and query execution plans in Databricks.
- Collaboration: Work closely with Data Scientists, BI Analysts, and DevOps teams to enable seamless data workflows.
Requirements
- Education: Bachelor's/Master's degree in Computer Science, Data Engineering, or a related field.
- Programming: Strong expertise in Python (PySpark), SQL, and optionally Scala.
- Databricks Platform: Experience with Databricks SQL, Delta Live Tables (DLT), and MLflow integration.
- ETL & Orchestration: Hands-on experience with Apache Airflow, dbt (Data Build Tool), and Databricks Workflows.
- Data Warehousing: Strong understanding ofDimensional Modeling, Snowflake Schema, and Data Vault methodologies.
- Data Governance: Experience with Unity Catalog, Delta Sharing, and data lineage tracking.
- CI/CD & Version Control: Familiarity with Git, CI/CD pipelines for Databricks (Terraform, Databricks Repos).
- Real-time data streaming experience(Kafka, Event Hubs, or Pulsar).
- Databricks Certification (Data Engineer Associate or Professional)is a plus.
- Experience with monitoring and logging(Datadog, Prometheus, or Databricks Metrics).
This job was posted by Shubhankar Tomar from Wiom.
-
Senior/Lead Data Engineer
4 days ago
Gurgaon, Haryana, India Eucloid Data Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per yearRole: Senior Lead Data EngineerAbout The Role:Eucloid is looking for a senior/ lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which may include starting from up- stream and down-stream...
-
Senior Data Engineer
6 days ago
Gurgaon, Haryana, India Pacific Data Integrators Full time ₹ 12,00,000 - ₹ 36,00,000 per yearRole: Senior Data EngineerLocation: RemoteJob Type: Full-timeShift time: Open to work in EST shift (5PM to 2AM IST)Key ResponsibilitiesLead the design, development, and implementation of complex data integration solutions using Informatica Intelligent Data Management Cloud (IDMC).Develop, document, unit test, and maintain high-quality ETL applications that...
-
Senior Data Engineer
1 week ago
Gurgaon, Haryana, India Orange Business Full time ₹ 20,00,000 - ₹ 25,00,000 per yearCompany DescriptionAt Orange Business, our ambition is to become the leading European Network and Digital Integrator by leveraging our proven expertise in next-generation connectivity solutions, the cloud, and cybersecurity. Our 30,000 women and men are present in 65 countries, where every voice counts. Together, we are driven by the determination and team...
-
Senior Data Engineer
2 weeks ago
Gurgaon, Haryana, India Naukri Healthcare Jobs Full time ₹ 1,20,00,000 - ₹ 2,40,00,000 per yearWe are looking for a skilled Senior Data Engineer with 6-12 years of experience to join our team at Syneos Health, playing a crucial role in driving data-driven insights and strategic decision-making. The ideal candidate will have a strong background in designing and implementing large-scale data systems, ensuring data quality, and collaborating with...
-
Senior Data Engineer
1 week ago
Gurgaon, Haryana, India Khoj Information Technology Pvt Ltd Full time ₹ 12,00,000 - ₹ 24,00,000 per yearWe are seeking a Senior Data Engineer (Azure) who can seamlessly blend hands-on data engineering expertise with a solution design and architectural mindset. This role will be responsible for building scalable, high-performance data solutions on Azure leveraging Data Factory, Databricks, and Microsoft Fabric.The ideal candidate is a proactive technologist who...
-
Senior Data Engineer
7 days ago
Gurgaon, Haryana, India Mastercard Full time ₹ 10,00,000 - ₹ 25,00,000 per yearOur PurposeMastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we're helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships...
-
Senior Data Engineer
6 days ago
Gurgaon, Haryana, India Mastercard Full time ₹ 12,00,000 - ₹ 36,00,000 per yearOur PurposeMastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we're helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships...
-
Senior Data Engineer
7 days ago
Gurgaon, Haryana, India Netomi Full time ₹ 12,00,000 - ₹ 24,00,000 per yearAbout the Company:Netomi is the leading agentic AI platform for enterprise customer experience. We work with the largest global brands like Delta Airlines, MetLife, MGM, United, and others to enable agentic automation at scale across the entire customer journey. Our no-code platform delivers the fastest time to market, lowest total cost of ownership, and...
-
Senior Data Engineer
1 week ago
Gurgaon, Haryana, India WIN Home Inspection Full time ₹ 20,00,000 - ₹ 25,00,000 per yearABOUT WIN:Founded in 1993, WIN is a highly innovative PropTech company building new and disruptive software platforms and products for the massive real estate industry. We have the stability and brand recognition as a 30-year old company along with the curiosity and energy of a start-up. We are an Entrepreneur 500 company, Entrepreneur Fastest...
-
Senior Data Engineer
7 days ago
Gurgaon, Haryana, India Grant Thornton Bharat Llp Full time ₹ 8,00,000 - ₹ 24,00,000 per yearJob Role OverviewTitle: Senior Power BI DeveloperKey ResponsibilitiesDesign and maintain data pipelines using Microsoft Fabric Lakehouse, Pipelines, and Dataflows.Build analytics-ready datasets using SQL and PySpark.Develop dashboards and semantic models in Power BI.Integrate ERP and business systems into unified models.Ensure data quality, lineage, and...