Senior/Lead Data Engineer

3 hours ago

Gurgaon, Haryana, India Srijan Technologies Pvt Ltd Full time ₹ 12,00,000 - ₹ 36,00,000 per year

Senior/Lead Data Engineer - Databricks..

Location: Gurgaon,None,None

Senior/Lead Data Engineer - Databricks

We are seeking a highly skilled and experienced Data Engineering Lead with a strong background in the retail domain and exceptional programming abilities. As a Lead, you will play a pivotal role in implementing, and optimizing data architecture to support our retail business operations and analytics initiatives. Your expertise in Spark programming, optimization techniques, and familiarity with Databricks and CI/CD practices will be instrumental in ensuring the efficient and effective management of our data ecosystem.

Imp Pointers as below skills should be in the CV

Data Platform (Data Engineers)

  • Data Lake: AWS S3 / Azure / Dell Cloud Data Lake with Delta Lake format
  • Data Warehouse: Databricks, IOMETE, Google BigQuery for analytical workloads
  • Batch Processing /Stream Processing: Batch/real-time processing of data pipelines
  • Database: PostgreSQL for transactional data, NoSQL (ex. MongoDB, Cassendra) for document storage
Responsibilities:
  1. Design and develop data models, data integration processes, and data pipelines to capture, transform, and load structured and unstructured data from various retail sources.
  2. Hands-on programming in Spark to develop and optimize data processing applications and analytics workflows.
  3. Apply optimization techniques to enhance the performance and efficiency of data processing and analytical tasks.
  4. Evaluate and implement appropriate tools and technologies, including Databricks, to streamline data operations and ensure scalability and reliability.
  5. Work closely with other team members to ensure data integrity, consistency, and accessibility across the organization.
  6. Define and enforce best practices for data governance and data management, including data quality, metadata management, and data security.
  7. Collaborate with DevOps teams to establish and maintain CI/CD pipelines for data engineering and analytics workflows.
  8. Peer Review of team members' deliverables
  9. Stay updated with the latest advancements and trends in the retail domain, data architecture, and programming languages to drive continuous improvement.

Requirements:

  1. At least 5+ years of experience in the data engineering domain.
  2. Proven experience as a senior Data Engineer /Lead, preferably within the retail industry.
  3. Strong programming skills with expertise in PySpark programming and optimization techniques.
  4. Hands-on experience with Databricks, Deltalake and its components for data processing and analytics.
  5. Hands-on experience in data modelling, data integration, and ETL/ELT processes.
  6. Experience in working with Gitlab pipelines and an in-depth understanding of CI/CD pipeline designs.
  7. Experience with data governance, data quality, and metadata management.
  8. Strong analytical and problem-solving abilities with a detail-oriented mindset.
  9. Excellent communication and collaboration skills to work effectively with cross-functional teams.
  10. Ability to adapt to a fast-paced and evolving environment while managing multiple priorities.
  11. Good to have experience in at least one of the Cloud Vendor (AWS / Azure / GCP)
  12. Good to have experience with streaming technologies as well
Apply to this job Experience LevelSenior Level

  • Senior/Lead Data Engineer

    7 days ago

    Gurgaon, Haryana, India Srijan Technologies PVT LTD Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Senior/Lead Data Engineer - Databricks We are seeking a highly skilled and experienced Data Engineering Lead with a strong background in the retail domain and exceptional programming abilities. As a Lead, you will play a pivotal role in implementing, and optimizing data architecture to support our retail business operations and analytics initiatives. Your...

  • Senior/Lead Data Engineer

    7 days ago

    Gurgaon, Haryana, India Srijan Technologies Pvt Ltd Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Senior/Lead Data Engineer - DatabricksWe are seeking a highly skilled and experienced Data Engineering Lead with a strong background in the retail domain and exceptional programming abilities. As a Lead, you will play a pivotal role in implementing, and optimizing data architecture to support our retail business operations and analytics initiatives. Your...

  • Lead Data Engineer

    2 weeks ago

    Gurgaon, Haryana, India Techno Wise Full time

    Senior Azure Data Engineer (Team Lead)Location : Gurgaon (Work from Office 5 Days a Week)Experience Required : 8+ YearsJob Overview : We are seeking a highly skilled and experienced Senior Azure Data Engineer to join our team in Gurgaon. This is a full-time, on-site role requiring a professional with a strong background in Azure Data Engineering,...

  • Lead Data Engineer

    2 weeks ago

    Gurgaon, Haryana, India Techno Wise Full time

    Senior Azure Data Engineer (Team Lead)Location : Gurgaon (Work from Office 5 Days a Week)Experience Required : 8+ YearsJob Overview : We are seeking a highly skilled and experienced Senior Azure Data Engineer to join our team in Gurgaon. This is a full-time, on-site role requiring a professional with a strong background in Azure Data Engineering,...

  • Senior Web Developer and Data Engineer

    2 days ago

    Gurgaon, Haryana, India CoPoint Data Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    About CoPoint AICoPoint AI is a specialized consulting firm focused on transforming businesses through process improvement, data insights, and technology-driven innovation. We leverage AI technologies, Microsoft cloud platforms, and modern web development frameworks to deliver intelligent, scalable solutions that drive measurable impact for our clients. Our...

  • Senior/Lead Data Engineer

    5 hours ago

    Gurgaon, Haryana, India Srijan Technologies Pvt Ltd Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Senior/Lead Data Engineer - Snowflake & Kafka Location: gurgaon,None,None About US:- We turn customer challenges into growth opportunities. Material is a global strategy partner to the world's most recognizable brands and innovative companies. Our people around the globe thrive by helping organizations design and deliver rewarding customer...

  • Deputy Manager – IT/IS

    2 days ago

    Gurgaon, Haryana, India Senior Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Company DescriptionSenior is a UK based MNC and has operations in 12 countries and has 26 operating businesses worldwide serving number of markets. Senior's experienced manpower support, effective use of raw material as well as high technology enable it to deliver optimized components within a short development time and at most competitive prices.Senior...

  • Senior/Lead Data Engineer

    9 hours ago

    Gurgaon, Haryana, India Srijan Technologies PVT LTD Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About US:-We turn customer challenges into growth opportunities.Material is a global strategy partner to the world's most recognizable brands and innovative companies. Our people around the globe thrive by helping organizations design and deliver rewarding customer experiences.We use deep human insights, design innovation and data to create experiences...

  • Senior/Lead Data Engineer

    6 hours ago

    Gurgaon, Haryana, India Srijan Technologies Pvt Ltd Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About US:-We turn customer challenges into growth opportunities.Material is a global strategy partner to the world's most recognizable brands and innovative companies. Our people around the globe thrive by helping organizations design and deliver rewarding customer experiences.We use deep human insights, design innovation and data to create experiences...

  • Lead Data Engineer

    2 days ago

    Gurgaon, Haryana, India CBRE Full time ₹ 8,00,000 - ₹ 25,00,000 per year

    Gurgaon - Haryana - India, Hyderabad - Telangana - India, Noida - Uttar Pradesh - IndiaAbout The RoleAs a Senior Lead Data Engineer, you will play a crucial role in designing, building, and optimizing our data pipeline and infrastructure. You will work closely with stakeholders, analysts, and other to ensure data integrity, availability, and security. This...