Senior/Lead Data Engineer

22 hours ago

Gurgaon, Haryana, India Srijan Technologies Full time ₹ 12,00,000 - ₹ 24,00,000 per year

Senior/Lead Data Engineer - Databricks

We are seeking a highly skilled and experienced Data Engineering Lead with a strong background in the retail domain and exceptional programming abilities. As a Lead, you will play a pivotal role in implementing, and optimizing data architecture to support our retail business operations and analytics initiatives. Your expertise in Spark programming, optimization techniques, and familiarity with Databricks and CI/CD practices will be instrumental in ensuring the efficient and effective management of our data ecosystem.

Imp Pointers as below skills should be in the CV

Data Platform (Data Engineers)

  • Data Lake: AWS S3 / Azure / Dell Cloud Data Lake with Delta Lake format
  • Data Warehouse: Databricks, IOMETE, Google BigQuery for analytical workloads
  • Batch Processing /Stream Processing: Batch/real-time processing of data pipelines
  • Database: PostgreSQL for transactional data, NoSQL (ex. MongoDB, Cassendra) for document storage
Responsibilities:

  2. Design and develop data models, data integration processes, and data pipelines to capture, transform, and load structured and unstructured data from various retail sources.
  3. Hands-on programming in Spark to develop and optimize data processing applications and analytics workflows.
  4. Apply optimization techniques to enhance the performance and efficiency of data processing and analytical tasks.
  5. Evaluate and implement appropriate tools and technologies, including Databricks, to streamline data operations and ensure scalability and reliability.
  6. Work closely with other team members to ensure data integrity, consistency, and accessibility across the organization.
  7. Define and enforce best practices for data governance and data management, including data quality, metadata management, and data security.
  8. Collaborate with DevOps teams to establish and maintain CI/CD pipelines for data engineering and analytics workflows.
  9. Peer Review of team members' deliverables
  10. Stay updated with the latest advancements and trends in the retail domain, data architecture, and programming languages to drive continuous improvement.

 Requirements:


  2. At least 5+ years of experience in the data engineering domain.
  3. Proven experience as a senior Data Engineer /Lead, preferably within the retail industry.
  4. Strong programming skills with expertise in PySpark programming and optimization techniques.
  5. Hands-on experience with Databricks, Deltalake and its components for data processing and analytics.
  6. Hands-on experience in data modelling, data integration, and ETL/ELT processes.
  7. Experience in working with Gitlab pipelines and an in-depth understanding of CI/CD pipeline designs.
  8. Experience with data governance, data quality, and metadata management.
  9. Strong analytical and problem-solving abilities with a detail-oriented mindset.
  10. Excellent communication and collaboration skills to work effectively with cross-functional teams.
  11. Ability to adapt to a fast-paced and evolving environment while managing multiple priorities.
  12. Good to have experience in at least one of the Cloud Vendor (AWS / Azure / GCP)
  13. Good to have experience with streaming technologies as well

  • Senior/Lead Data Engineer

    1 week ago

    Gurgaon, Haryana, India Eucloid Data Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Role: Senior Lead Data EngineerAbout The Role:Eucloid is looking for a senior/ lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which may include starting from up- stream and down-stream...

  • Senior Data Engineer

    20 hours ago

    Gurgaon, Haryana, India Eucloid Data Solutions Full time ₹ 18,00,000 - ₹ 30,00,000 per year

    We are seeking a passionate and experienced Data Engineer/Senior Data Engineer to drive the design, development, and deployment of robust data solutions. The ideal candidate will lead technical initiatives, mentor team members, and collaborate with stakeholders to deliver scalable and efficient data systems.ResponsibilitiesUnderstand business requirements...

  • Senior Data Engineer

    2 weeks ago

    Gurgaon, Haryana, India Pacific Data Integrators Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Role: Senior Data EngineerLocation: RemoteJob Type: Full-timeShift time: Open to work in EST shift (5PM to 2AM IST)Key ResponsibilitiesLead the design, development, and implementation of complex data integration solutions using Informatica Intelligent Data Management Cloud (IDMC).Develop, document, unit test, and maintain high-quality ETL applications that...

  • Data Engineer

    3 days ago

    Gurgaon, Haryana, India CoPoint Data Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Senior Data Engineer Location: India (Gurugram)About CoPointAIAI isn't coming — it's here. And we help enterprises make it real. At CoPointAI, we work inside the enterprise — not just around it — to turn AI potential into practical wins. From hands-on C-suite workshops (our AI Foundations series) to AI-native MVPs built in weeks, our team partners...

  • Senior Data Engineer

    4 days ago

    Gurgaon, Haryana, India Talentmatics Full time ₹ 15,00,000 - ₹ 3,00,00,000 per year

    Senior GCP Big Data EngineerExperience - 6–12 yrsLocation:Bangalore / GurgaonRole SummaryLooking for aSenior GCP Big Data Engineerwith strong expertise in building scalable data pipelines, ETL workflows, and big data processing on Google Cloud. This role includes technical leadership, hands-on development, and driving best practices.ResponsibilitiesDesign...

  • Senior DevOps Engineer

    3 days ago

    Gurgaon, Haryana, India NTT DATA Full time ₹ 8,00,000 - ₹ 15,00,000 per year

    Req ID: 347832NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Senior DevOps Engineer - GCP Infrastructure & Networking to join our team in Chennai, Tamil Nādu (IN-TN), India (IN). ...

  • Senior/Lead Data Engineer

    15 hours ago

    Gurgaon, Haryana, India Srijan Technologies Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    About US:-We turn customer challenges into growth opportunities.Material is a global strategy partner to the world's most recognizable brands and innovative companies. Our people around the globe thrive by helping organizations design and deliver rewarding customer experiences.Srijan, a Material company, is a renowned global digital engineering firm with a...

  • Senior/Lead Data Scientist

    2 days ago

    Gurgaon, Haryana, India Srijan: Now Material Full time US$ 55,000 - US$ 90,000 per year

    See all the jobs at Srijan Technologies PVT LTD here:Senior/Lead Data ScientistLocation:GurgaonDepartment:Technology TeamEmployment Type:Full-time | Partially remoteApply by:No close dateAbout UsWe turn customer challenges into growth opportunities.Material is a global strategy partner to the worlds most recognizable brands and innovative companies. Our...

  • Senior Tableau Data Consultant

    2 weeks ago

    Gurgaon, Haryana, India Eucloid Data Solutions Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    We are looking for a high-energy individual for the role of Data Consultant – Tableau Expert at Eucloid. The candidate will collaborate with client stakeholders on multiple projects, primarily focusing on building impactful visualizations and dashboards that drive business decisions.The candidate is expected to lead the following work-streams: Partner...

  • Senior/Lead Data Scientist

    2 weeks ago

    Gurgaon, Haryana, India Srijan Technologies Pvt Ltd Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About US:-We turn customer challenges into growth opportunities.Material is a global strategy partner to the world's most recognizable brands and innovative companies. Our people around the globe thrive by helping organizations design and deliver rewarding customer experiences.We use deep human insights, design innovation and data to create experiences...