Senior/Lead Data Engineer

2 days ago

Gurgaon, Haryana, India Srijan Technologies PVT LTD Full time ₹ 12,00,000 - ₹ 24,00,000 per year
Senior/Lead Data Engineer - Databricks 

We are seeking a highly skilled and experienced Data Engineering Lead with a strong background in the retail domain and exceptional programming abilities. As a Lead, you will play a pivotal role in implementing, and optimizing data architecture to support our retail business operations and analytics initiatives. Your expertise in Spark programming, optimization techniques, and familiarity with Databricks and CI/CD practices will be instrumental in ensuring the efficient and effective management of our data ecosystem.

Imp Pointers as below skills should be in the CV

Data Platform (Data Engineers)

  • Data Lake: AWS S3 / Azure / Dell Cloud Data Lake with Delta Lake format
  • Data Warehouse: Databricks, IOMETE, Google BigQuery for analytical workloads
  • Batch Processing /Stream Processing: Batch/real-time processing of data pipelines
  • Database: PostgreSQL for transactional data, NoSQL (ex. MongoDB, Cassendra) for document storage
Responsibilities:
  1. Design and develop data models, data integration processes, and data pipelines to capture, transform, and load structured and unstructured data from various retail sources.
  2. Hands-on programming in Spark to develop and optimize data processing applications and analytics workflows.
  3. Apply optimization techniques to enhance the performance and efficiency of data processing and analytical tasks.
  4. Evaluate and implement appropriate tools and technologies, including Databricks, to streamline data operations and ensure scalability and reliability.
  5. Work closely with other team members to ensure data integrity, consistency, and accessibility across the organization.
  6. Define and enforce best practices for data governance and data management, including data quality, metadata management, and data security.
  7. Collaborate with DevOps teams to establish and maintain CI/CD pipelines for data engineering and analytics workflows.
  8. Peer Review of team members' deliverables
  9. Stay updated with the latest advancements and trends in the retail domain, data architecture, and programming languages to drive continuous improvement.

 Requirements:

  1. At least 5+ years of experience in the data engineering domain.
  2. Proven experience as a senior Data Engineer /Lead, preferably within the retail industry.
  3. Strong programming skills with expertise in PySpark programming and optimization techniques.
  4. Hands-on experience with Databricks, Deltalake and its components for data processing and analytics.
  5. Hands-on experience in data modelling, data integration, and ETL/ELT processes.
  6. Experience in working with Gitlab pipelines and an in-depth understanding of CI/CD pipeline designs.
  7. Experience with data governance, data quality, and metadata management.
  8. Strong analytical and problem-solving abilities with a detail-oriented mindset.
  9. Excellent communication and collaboration skills to work effectively with cross-functional teams.
  10. Ability to adapt to a fast-paced and evolving environment while managing multiple priorities.
  11. Good to have experience in at least one of the Cloud Vendor (AWS / Azure / GCP)
  12. Good to have experience with streaming technologies as well

  • Senior Data Engineering Lead

    1 week ago

    Gurgaon, Haryana, India Workassist Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Description : Position : Senior Data Engineering Team Leader (Azure Focus) Work Level : Senior Leadership Industry Type : IT Services & ConsultingJob Summary : We are seeking a Disciplined and innovation-focused Senior Data Engineering Team Leader to lead a team in designing and implementing advanced data solutions on the Microsoft Azure cloud...

  • Data Engineer

    3 days ago

    Gurgaon, Haryana, India CoPoint Data Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Senior Data Engineer Location: India (Gurugram)About CoPointAIAI isn't coming — it's here. And we help enterprises make it real. At CoPointAI, we work inside the enterprise — not just around it — to turn AI potential into practical wins. From hands-on C-suite workshops (our AI Foundations series) to AI-native MVPs built in weeks, our team partners...

  • Senior/Lead Data Engineer

    3 days ago

    Gurgaon, Haryana, India SRIJAN TECHNOLOGIES Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Description See all the jobs at Srijan Technologies PVT LTD here:Senior/Lead Data Engineer - Databricks Location: GurgaonTeam: Technology TeamJob Type: Full-time | Partially remoteApply by: No close date We are seeking a highly skilled and experienced Data Engineering Lead with a strong background in the retail domain and exceptional programming...

  • Senior/Lead Data Engineer

    1 day ago

    Gurgaon, Haryana, India Srijan Technologies Pvt Ltd Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Senior/Lead Data Engineer - DatabricksWe are seeking a highly skilled and experienced Data Engineering Lead with a strong background in the retail domain and exceptional programming abilities. As a Lead, you will play a pivotal role in implementing, and optimizing data architecture to support our retail business operations and analytics initiatives. Your...

  • Senior Data Engineer

    2 weeks ago

    Gurgaon, Haryana, India EXL Service Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Senior Data Engineer We are looking for talented professionals to join our growing team in key position as Senior Data Engineer Skills: PySpark, SQL, Hadoop, AWS, Python, Spark, Scala, Hive, GCP, NoSQL database (Redis, Valkey, OpenSearch) Experience: 5-10 years To apply, share your profile.

  • Senior Data Engineer

    7 days ago

    Gurgaon, Haryana, India zyoin Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Description : We are seeking a Senior Data Engineer with 4+ years of experience in building scalable, distributed, and high-performance data systems. In this role, you will architect, develop, and optimize real-time pipelines and analytical systems that enable Amazon teams to extract actionable insights and power intelligent decision-making across the...

  • Lead Data Engineer

    2 weeks ago

    Gurgaon, Haryana, India EXL Service Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Lead Data Engineer Immediate Hiring Alert – Lead Data Engineer (5 days, Work from Office) - Expert in Azure, Databricks, PySpark & SQL with a passion for leading teams Total Experience: 8 yrs Must Have:3 yrs in Azure Data Engineering 2 yrs in Databricks & PySpark Strong SQL expertise Team leadership (5 members) Excellent...

  • Senior Data Engineer

    3 days ago

    Gurgaon, Haryana, India Blu Parrot Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    About Blu Parrot:Blu Parrot is a leading innovator in software solutions powered by Data Science, Artificial Intelligence (AI), Large Language Models (LLM), and Generative AI. With offices across four countries, we combine global expertise with cutting-edge technology to deliver transformative products and solutions. Join our team and help shape the future...

  • Senior Data Engineer

    1 week ago

    Gurgaon, Haryana, India DGN INFOSOLUTION PVT. LTD. Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    Senior Data EngineerLocation: GurgaonEmployment Type: full-timeTeam: Data & InsightsAbout Blu Parrot:Blu Parrot is a leading innovator in the design and development of cutting-edge software solutions and products leveraging Data Science, Artificial Intelligence (AI), Large Language Models (LLM), and Generative AI technologies.With a passion for creating...

  • Senior Data Engineer

    2 days ago

    Gurgaon, Haryana, India Boston Scientific Full time ₹ 1,20,000 - ₹ 2,60,000 per year

    Additional Locations:India-Haryana, GurgaonDiversity - Innovation - Caring - Global Collaboration - Winning Spirit - High PerformanceAt Boston Scientific, we'll give you the opportunity to harness all that's within you by working in teams of diverse and high-performing employees, tackling some of the most important health industry challenges. With access to...