Senior/Lead Data Engineer

5 hours ago

Gurgaon, Haryana, India Srijan Technologies Pvt Ltd Full time ₹ 12,00,000 - ₹ 36,00,000 per year
Senior/Lead Data Engineer - Databricks

We are seeking a highly skilled and experienced Data Engineering Lead with a strong background in the retail domain and exceptional programming abilities. As a Lead, you will play a pivotal role in implementing, and optimizing data architecture to support our retail business operations and analytics initiatives. Your expertise in Spark programming, optimization techniques, and familiarity with Databricks and CI/CD practices will be instrumental in ensuring the efficient and effective management of our data ecosystem.

Imp Pointers as below skills should be in the CV

Data Platform (Data Engineers)

  • Data Lake: AWS S3 / Azure / Dell Cloud Data Lake with Delta Lake format
  • Data Warehouse: Databricks, IOMETE, Google BigQuery for analytical workloads
  • Batch Processing /Stream Processing: Batch/real-time processing of data pipelines
  • Database: PostgreSQL for transactional data, NoSQL (ex. MongoDB, Cassendra) for document storage
Responsibilities:

  • Design and develop data models, data integration processes, and data pipelines to capture, transform, and load structured and unstructured data from various retail sources.

  • Hands-on programming in Spark to develop and optimize data processing applications and analytics workflows.

  • Apply optimization techniques to enhance the performance and efficiency of data processing and analytical tasks.

  • Evaluate and implement appropriate tools and technologies, including Databricks, to streamline data operations and ensure scalability and reliability.

  • Work closely with other team members to ensure data integrity, consistency, and accessibility across the organization.

  • Define and enforce best practices for data governance and data management, including data quality, metadata management, and data security.

  • Collaborate with DevOps teams to establish and maintain CI/CD pipelines for data engineering and analytics workflows.

  • Peer Review of team members' deliverables

  • Stay updated with the latest advancements and trends in the retail domain, data architecture, and programming languages to drive continuous improvement.

Requirements:

  • At least 5+ years of experience in the data engineering domain.

  • Proven experience as a senior Data Engineer /Lead, preferably within the retail industry.

  • Strong programming skills with expertise in PySpark programming and optimization techniques.

  • Hands-on experience with Databricks, Deltalake and its components for data processing and analytics.

  • Hands-on experience in data modelling, data integration, and ETL/ELT processes.

  • Experience in working with Gitlab pipelines and an in-depth understanding of CI/CD pipeline designs.

  • Experience with data governance, data quality, and metadata management.

  • Strong analytical and problem-solving abilities with a detail-oriented mindset.

  • Excellent communication and collaboration skills to work effectively with cross-functional teams.

  • Ability to adapt to a fast-paced and evolving environment while managing multiple priorities.

  • Good to have experience in at least one of the Cloud Vendor (AWS / Azure / GCP)

  • Good to have experience with streaming technologies as well

  • Senior/Lead Data Engineer

    8 hours ago

    Gurgaon, Haryana, India Srijan Technologies PVT LTD Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Senior/Lead Data Engineer - Databricks We are seeking a highly skilled and experienced Data Engineering Lead with a strong background in the retail domain and exceptional programming abilities. As a Lead, you will play a pivotal role in implementing, and optimizing data architecture to support our retail business operations and analytics initiatives. Your...

  • Lead Data Engineer

    1 week ago

    Gurgaon, Haryana, India Techno Wise Full time

    Senior Azure Data Engineer (Team Lead)Location : Gurgaon (Work from Office 5 Days a Week)Experience Required : 8+ YearsJob Overview : We are seeking a highly skilled and experienced Senior Azure Data Engineer to join our team in Gurgaon. This is a full-time, on-site role requiring a professional with a strong background in Azure Data Engineering,...

  • Lead Data Engineer

    1 week ago

    Gurgaon, Haryana, India Techno Wise Full time

    Senior Azure Data Engineer (Team Lead)Location : Gurgaon (Work from Office 5 Days a Week)Experience Required : 8+ YearsJob Overview : We are seeking a highly skilled and experienced Senior Azure Data Engineer to join our team in Gurgaon. This is a full-time, on-site role requiring a professional with a strong background in Azure Data Engineering,...

  • Senior/Lead Data Engineer

    2 weeks ago

    Gurgaon, Haryana, India Srijan Technologies Pvt Ltd Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    About US:-We turn customer challenges into growth opportunities.Material is a global strategy partner to the world's most recognizable brands and innovative companies. Our people around the globe thrive by helping organizations design and deliver rewarding customer experiences.We use deep human insights, design innovation and data to create experiences...

  • Senior Data Engineer

    1 week ago

    Gurgaon, Haryana, India Questhiring Full time

    About the Role :We are hiring a Senior Data Engineer with strong expertise in batch and streaming data pipelines. This role is ideal for a driven professional with over 5 years of experience in data engineering, seeking to lead scalable data infrastructure efforts in a dynamic, data-first organization.Key Responsibilities :- Design, develop, and maintain...

  • Senior Lead Engineer

    2 weeks ago

    Gurgaon, Haryana, India REA Full time

    About REA At REA we are shaping the future of real estate Our engineering teams are the architects behind the experiences that millions of property seekers rely on every day We use the latest technology to deliver best-in-class experiences to our customers About REA Group In 1995 in a garage in Melbourne Australia REA Group was born from a simple...

  • Senior Data Engineer

    1 week ago

    Gurgaon, Haryana, India Capgemini Full time

    Job DescriptionJob DescriptionThis role involves the development and application of engineering practice and knowledge in defining, configuring and deploying industrial digital technologies (including but not limited to PLM and MES) for managing continuity of information across the engineering enterprise, including design, industrialization, manufacturing...

  • Senior Lead Engineer

    2 weeks ago

    Gurgaon, Haryana, India REA Cyber City Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    About REA Group:In 1995 in a garage in Melbourne, Australia, REA Group was born from a simple question: Can we change the way the world experiences property?" Could we? Yes. Are we done? Never. Fast forward 30 years, REA Group is a market leader in online real estate in three continents and continuing to grow rapidly across the globe. The secret to our...

  • Senior Big Data Engineer

    2 weeks ago

    Gurgaon, Haryana, India dunnhumby Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    We're looking for a Senior Big Data Engineer who expects more from their career. It's chance to extend and improve dunnhumby's Data Engineering Team. It's an opportunity to work with a market-leading business to explore new opportunities for us and influence global retailers. What we expect from you • 5 years of experience in Information Technology...

  • Data Engineer Advisor

    2 days ago

    Gurgaon, Haryana, India NTT DATA Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Req ID: 338198NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer Advisor to join our team in Gurgaon, Haryāna (IN-HR), India (IN). Technical Support: Provide L1, L2...