Senior/Lead Data Engineer

3 days ago

Gurgaon, Haryana, India SRIJAN TECHNOLOGIES Full time ₹ 12,00,000 - ₹ 36,00,000 per year
Job Description

See all the jobs at Srijan Technologies PVT LTD here:

Senior/Lead Data Engineer - Databricks

Location: Gurgaon
Team: Technology Team
Job Type: Full-time | Partially remote
Apply by: No close date

We are seeking a highly skilled and experienced Data Engineering Lead with a strong background in the retail domain and exceptional programming abilities. As a Lead, you will play a pivotal role in implementing and optimizing data architecture to support our retail business operations and analytics initiatives. Your expertise in Spark programming, optimization techniques, and familiarity with Databricks and CI/CD practices will be instrumental in ensuring the efficient and effective management of our data ecosystem.

Important Pointers (skills should be in the CV)
  • Data Platform (Data Engineers)
  • Data Lake: AWS S3 / Azure / Dell Cloud Data Lake with Delta Lake format
  • Data Warehouse: Databricks, IOMETE, Google BigQuery for analytical workloads
  • Batch Processing / Stream Processing: Batch/real-time processing of data pipelines
  • Database: PostgreSQL for transactional data, NoSQL (ex. MongoDB, Cassandra) for document storage
Responsibilities:
  • Design and develop data models, data integration processes, and data pipelines to capture, transform, and load structured and unstructured data from various retail sources.
  • Hands-on programming in Spark to develop and optimize data processing applications and analytics workflows.
  • Apply optimization techniques to enhance the performance and efficiency of data processing and analytical tasks.
  • Evaluate and implement appropriate tools and technologies, including Databricks, to streamline data operations and ensure scalability and reliability.
  • Work closely with other team members to ensure data integrity, consistency, and accessibility across the organization.
  • Define and enforce best practices for data governance and data management, including data quality, metadata management, and data security.
  • Collaborate with DevOps teams to establish and maintain CI/CD pipelines for data engineering and analytics workflows.
  • Peer review of team members' deliverables.
  • Stay updated with the latest advancements and trends in the retail domain, data architecture, and programming languages to drive continuous improvement.
Requirements:
  • At least 5 years of experience in the data engineering domain.
  • Proven experience as a senior Data Engineer / Lead, preferably within the retail industry.
  • Strong programming skills with expertise in PySpark programming and optimization techniques.
  • Hands-on experience with Databricks, Deltalake, and its components for data processing and analytics.
  • Hands-on experience in data modeling, data integration, and ETL/ELT processes.
  • Experience in working with Gitlab pipelines and an in-depth understanding of CI/CD pipeline designs.
  • Experience with data governance, data quality, and metadata management.
  • Strong analytical and problem-solving abilities with a detail-oriented mindset.
  • Excellent communication and collaboration skills to work effectively with cross-functional teams.
  • Ability to adapt to a fast-paced and evolving environment while managing multiple priorities.
  • Good to have experience in at least one of the Cloud Vendors (AWS / Azure / GCP).
  • Good to have experience with streaming technologies as well.

  • Senior Data Engineering Lead

    1 week ago

    Gurgaon, Haryana, India Workassist Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Description : Position : Senior Data Engineering Team Leader (Azure Focus) Work Level : Senior Leadership Industry Type : IT Services & ConsultingJob Summary : We are seeking a Disciplined and innovation-focused Senior Data Engineering Team Leader to lead a team in designing and implementing advanced data solutions on the Microsoft Azure cloud...

  • Data Engineer

    3 days ago

    Gurgaon, Haryana, India CoPoint Data Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Senior Data Engineer Location: India (Gurugram)About CoPointAIAI isn't coming — it's here. And we help enterprises make it real. At CoPointAI, we work inside the enterprise — not just around it — to turn AI potential into practical wins. From hands-on C-suite workshops (our AI Foundations series) to AI-native MVPs built in weeks, our team partners...

  • Senior/Lead Data Engineer

    2 days ago

    Gurgaon, Haryana, India Srijan Technologies PVT LTD Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Senior/Lead Data Engineer - Databricks We are seeking a highly skilled and experienced Data Engineering Lead with a strong background in the retail domain and exceptional programming abilities. As a Lead, you will play a pivotal role in implementing, and optimizing data architecture to support our retail business operations and analytics initiatives. Your...

  • Senior/Lead Data Engineer

    1 day ago

    Gurgaon, Haryana, India Srijan Technologies Pvt Ltd Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Senior/Lead Data Engineer - DatabricksWe are seeking a highly skilled and experienced Data Engineering Lead with a strong background in the retail domain and exceptional programming abilities. As a Lead, you will play a pivotal role in implementing, and optimizing data architecture to support our retail business operations and analytics initiatives. Your...

  • Senior Data Engineer

    2 weeks ago

    Gurgaon, Haryana, India EXL Service Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Senior Data Engineer We are looking for talented professionals to join our growing team in key position as Senior Data Engineer Skills: PySpark, SQL, Hadoop, AWS, Python, Spark, Scala, Hive, GCP, NoSQL database (Redis, Valkey, OpenSearch) Experience: 5-10 years To apply, share your profile.

  • Senior Data Engineer

    7 days ago

    Gurgaon, Haryana, India zyoin Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Description : We are seeking a Senior Data Engineer with 4+ years of experience in building scalable, distributed, and high-performance data systems. In this role, you will architect, develop, and optimize real-time pipelines and analytical systems that enable Amazon teams to extract actionable insights and power intelligent decision-making across the...

  • Lead Data Engineer

    2 weeks ago

    Gurgaon, Haryana, India EXL Service Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Lead Data Engineer Immediate Hiring Alert – Lead Data Engineer (5 days, Work from Office) - Expert in Azure, Databricks, PySpark & SQL with a passion for leading teams Total Experience: 8 yrs Must Have:3 yrs in Azure Data Engineering 2 yrs in Databricks & PySpark Strong SQL expertise Team leadership (5 members) Excellent...

  • Senior Data Engineer

    3 days ago

    Gurgaon, Haryana, India Blu Parrot Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    About Blu Parrot:Blu Parrot is a leading innovator in software solutions powered by Data Science, Artificial Intelligence (AI), Large Language Models (LLM), and Generative AI. With offices across four countries, we combine global expertise with cutting-edge technology to deliver transformative products and solutions. Join our team and help shape the future...

  • Senior Data Engineer

    1 week ago

    Gurgaon, Haryana, India DGN INFOSOLUTION PVT. LTD. Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    Senior Data EngineerLocation: GurgaonEmployment Type: full-timeTeam: Data & InsightsAbout Blu Parrot:Blu Parrot is a leading innovator in the design and development of cutting-edge software solutions and products leveraging Data Science, Artificial Intelligence (AI), Large Language Models (LLM), and Generative AI technologies.With a passion for creating...

  • Senior Data Engineer

    2 days ago

    Gurgaon, Haryana, India Boston Scientific Full time ₹ 1,20,000 - ₹ 2,60,000 per year

    Additional Locations:India-Haryana, GurgaonDiversity - Innovation - Caring - Global Collaboration - Winning Spirit - High PerformanceAt Boston Scientific, we'll give you the opportunity to harness all that's within you by working in teams of diverse and high-performing employees, tackling some of the most important health industry challenges. With access to...