
Senior Data Engineer
1 day ago
Responsibilities
- ETL Development: Build and maintain ETL/ELT pipelines using Databricks & Apache Spark (PySpark/Scala).
- Data Warehousing: Design and implement Star Schema, Snowflake Schema, and Data Vault models.
- Databricks Optimization: Optimize Delta Lake storage, caching, and job execution to improve query performance.
- Databricks Optimization: Optimize Delta Lake storage, caching, and job execution to improve query performance.
- Data Ingestion & Processing: Develop scalable ingestion pipelines using Structured Streaming, Auto Loader, and Databricks Workflows.
- Data Governance & Security: Implement Unity Catalog, role-based access controls (RBAC), and compliance standards.
- Performance Tuning: Optimize Spark jobs, partitioning strategies, and query execution plans in Databricks.
- Collaboration: Work closely with Data Scientists, BI Analysts, and DevOps teams to enable seamless data workflows.
Requirements
- Education: Bachelor's/Master's degree in Computer Science, Data Engineering, or a related field.
- Programming: Strong expertise in Python (PySpark), SQL, and optionally Scala.
- Databricks Platform: Experience with Databricks SQL, Delta Live Tables (DLT), and MLflow integration.
- ETL & Orchestration: Hands-on experience with Apache Airflow, dbt (Data Build Tool), and Databricks Workflows.
- Data Warehousing: Strong understanding ofDimensional Modeling, Snowflake Schema, and Data Vault methodologies.
- Data Governance: Experience with Unity Catalog, Delta Sharing, and data lineage tracking.
- CI/CD & Version Control: Familiarity with Git, CI/CD pipelines for Databricks (Terraform, Databricks Repos).
- Real-time data streaming experience(Kafka, Event Hubs, or Pulsar).
- Databricks Certification (Data Engineer Associate or Professional)is a plus.
- Experience with monitoring and logging(Datadog, Prometheus, or Databricks Metrics).
This job was posted by Shubhankar Tomar from Wiom.
-
Senior Web Developer and Data Engineer
1 day ago
Gurgaon, Haryana, India CoPoint Data Full time ₹ 20,00,000 - ₹ 25,00,000 per yearAbout CoPoint AICoPoint AI is a specialized consulting firm focused on transforming businesses through process improvement, data insights, and technology-driven innovation. We leverage AI technologies, Microsoft cloud platforms, and modern web development frameworks to deliver intelligent, scalable solutions that drive measurable impact for our clients. Our...
-
Senior Data Engineer
2 weeks ago
Gurgaon, Haryana, India Capgemini Full timeJob DescriptionJob DescriptionThis role involves the development and application of engineering practice and knowledge in defining, configuring and deploying industrial digital technologies (including but not limited to PLM and MES) for managing continuity of information across the engineering enterprise, including design, industrialization, manufacturing...
-
Senior Data Engineer
1 day ago
Gurgaon, Haryana, India Next Mantra Solution Private Limited Full time ₹ 1,04,000 - ₹ 1,30,878 per yearWe're Hiring: Senior Data Engineer (AWS | ETL | Data Warehousing) Location: [Add location/Remote] | Experience: 3–10 yearsWe're looking for aSenior Data Engineerto join our growing data team and help us buildscalable, secure, and high-performing data platformson AWS. If you are passionate about designing robust ETL pipelines and optimizing large-scale...
-
Deputy Manager – IT/IS
1 day ago
Gurgaon, Haryana, India Senior Full time ₹ 12,00,000 - ₹ 36,00,000 per yearCompany DescriptionSenior is a UK based MNC and has operations in 12 countries and has 26 operating businesses worldwide serving number of markets. Senior's experienced manpower support, effective use of raw material as well as high technology enable it to deliver optimized components within a short development time and at most competitive prices.Senior...
-
Senior Data Engineer
2 weeks ago
Gurgaon, Haryana, India Questhiring Full timeAbout the Role :We are hiring a Senior Data Engineer with strong expertise in batch and streaming data pipelines. This role is ideal for a driven professional with over 5 years of experience in data engineering, seeking to lead scalable data infrastructure efforts in a dynamic, data-first organization.Key Responsibilities :- Design, develop, and maintain...
-
Senior Data Engineer
3 weeks ago
Gurgaon, Haryana, India BLJ TECH GEEKS Full timeJob Description :- Minimum experience of working in projects as a Senior Azure Data Engineer.- Tech/B.E degree in Computer Science or Information Technology.- Experience with enterprise integration tools and ETL (extract, transform, load) tools like Data Bricks, Azure Data factory, and Talend/Informatica, etc.- Analyzing Data using python, Spark streaming,...
-
Data Engineer Advisor
1 week ago
Gurgaon, Haryana, India NTT DATA Full time ₹ 9,00,000 - ₹ 12,00,000 per yearReq ID: 338198NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer Advisor to join our team in Gurgaon, Haryāna (IN-HR), India (IN). Technical Support: Provide L1, L2...
-
Senior Data Engineer
6 days ago
Gurgaon, Haryana, India Weekday AI Full time ₹ 12,00,000 - ₹ 36,00,000 per yearThis role is for one of the Weekday's clientsMin Experience: 5 yearsLocation: GurgaonJobType: full-timeWe are seeking an experienced Senior Data Engineer with strong expertise in building and managing large-scale data pipelines within the AWS ecosystem. The ideal candidate will have a solid background in SQL, cloud-native data platforms, and orchestration...
-
Senior Data Engineer
6 days ago
Gurgaon, Haryana, India Weekday AI Full time ₹ 20,00,000 - ₹ 25,00,000 per yearThis role is for one of the Weekday's clientsMin Experience: 5 yearsLocation: GurgaonJobType: full-timeWe are seeking an experienced Senior Data Engineer with strong expertise in building and managing large-scale data pipelines within the AWS ecosystem. The ideal candidate will have a solid background in SQL, cloud-native data platforms, and orchestration...
-
Senior Data Engineer
2 weeks ago
Gurgaon, Haryana, India DGN INFOSOLUTION PVT. LTD. Full time ₹ 10,00,000 - ₹ 25,00,000 per yearSenior Data EngineerLocation: GurgaonEmployment Type: full-timeTeam: Data & InsightsAbout Blu Parrot:Blu Parrot is a leading innovator in the design and development of cutting-edge software solutions and products leveraging Data Science, Artificial Intelligence (AI), Large Language Models (LLM), and Generative AI technologies.With a passion for creating...