Data Engineer Lead

1 week ago

Thāne, Maharashtra, India beBeeDataEngineer Full time ₹ 1,20,00,000 - ₹ 2,00,00,000
Job Description

We are looking for a highly skilled professional to lead the design, construction, and optimization of large-scale data processing systems.

This role involves collaborating closely with data scientists, analysts, and other engineers to ensure the availability, reliability, and efficiency of our Databricks solution.

The ideal candidate will have expertise in designing, developing, and maintaining scalable and robust data pipelines that collect, process, and store large volumes of structured and unstructured data.

Key Responsibilities:
  • Design, develop, and maintain scalable and robust data pipelines that collect, process, and store large volumes of structured and unstructured data.
  • Architect and implement data warehouses, data lakes, and other storage solutions that support analytics and reporting needs.
  • Optimize data architectures and workflows for performance, scalability, and cost-efficiency.
  • Collaborate with data scientists and analysts to understand data requirements and ensure that data systems meet their needs.
  • Ensure data quality, integrity, and security by implementing best practices in data governance and management.
Requirements
  • Bachelor's or Master's degree in Computer Science, Information Systems, Engineering, or a related field.
  • 5+ years of experience in data engineering or related fields, with a focus on large-scale data systems
  • 3+ years of experience with Databricks
  • Proficiency in SQL and experience with databases such as MySQL, PostgreSQL, or NoSQL databases
  • Strong programming skills in languages such as Python, Java, or Scala.
  • Experience with ETL tools and frameworks and data pipeline orchestration.
  • Familiarity with big data technologies (e.g., Hadoop, Spark, Kafka) and cloud platforms (AWS, GCP, Azure).
Benefits
  • Remote work
  • Employment/Contract Type: Contract
  • Location: India
  • Duration: 1 year (with potential to be extended)
  • Hours per Week: 40 (Full-time)

  • Lead Data Engineer

    23 hours ago

    Thāne, Maharashtra, India The Right Hire Limited Full time

    Job Title: Lead Data EngineerLocation: Pune, IndiaType: Full-timeOverview:We are seeking a skilled Lead Data Engineer with strong expertise in SQL, big data processing, and modern data platforms. The ideal candidate will have hands-on experience with modern unified data platforms (e.g. Databricks, Snowflake) and exposure to Microsoft Azure...

  • Data Engineering Lead

    7 days ago

    Thāne, Maharashtra, India DMart - Avenue Supermarts Ltd Full time

    About the organization:DMart is one of India's leading retail chains, serving millions of customers across 425+ stores and e-commerce channels throughout India. Our core objective is to offer customers good products at great value. We focus on everyday low pricing, seamless shopping experiences, and data-driven decision making. As we scale our data analytics...

  • Data Engineering Lead

    7 days ago

    Thāne, Maharashtra, India DMart - Avenue Supermarts Ltd Full time

    About the organization: DMart is one of India's leading retail chains, serving millions of customers across 425+ stores and e-commerce channels throughout India. Our core objective is to offer customers good products at great value. We focus on everyday low pricing, seamless shopping experiences, and data-driven decision making. As we scale our data...

  • Data Engineering Lead

    4 days ago

    Thāne, Maharashtra, India DMart - Avenue Supermarts Ltd Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    About the organization:DMart is one of India's leading retail chains, serving millions of customers across 425+ stores and e-commerce channels throughout India. Our core objective is to offer customers good products at great value. We focus on everyday low pricing, seamless shopping experiences, and data-driven decision making. As we scale our data analytics...

  • Senior Data Engineer Lead

    1 week ago

    Thāne, Maharashtra, India beBeeData Full time ₹ 19,45,600 - ₹ 24,14,400

    Job Opportunity: Senior Data Engineer LeadAbout the RoleWe are seeking an experienced Senior Data Engineer Lead to join our team. As a key member of our engineering team, you will be responsible for designing and developing scalable data scraping solutions, leading and mentoring a team of developers, and implementing advanced blocking and captcha-solving...

  • Data Engineering Team Lead

    3 days ago

    Thāne, Maharashtra, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Description About Us We are a global ad tech company that focuses on creating a transparent and efficient path for advertiser budgets to become publisher revenue. Our proprietary contextual technology enhances programmatic buying, the latest industry standard in ad buying for digital platforms. The Media.net platform powers major global publishers and...

  • Lead Enterprise Data Engineer

    7 days ago

    Thāne, Maharashtra, India beBeeExpert Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Data Engineering ExpertAre you a seasoned data engineer with expertise in designing, building, and optimizing scalable data solutions? Do you have hands-on experience in developing robust data pipelines, implementing efficient data models, and ensuring performance optimization for enterprise-level analytics?We are seeking a skilled professional to work with...

  • High Salary: Data Engineering Lead

    1 week ago

    Thāne, Maharashtra, India DMart - Avenue Supermarts Ltd Full time

    About the organization:DMart is one of India's leading retail chains, serving millions of customers across 425+ stores and e-commerce channels throughout India. Our core objective is to offer customers good products at great value. We focus on everyday low pricing, seamless shopping experiences, and data-driven decision making. As we scale our data analytics...

  • Azure Data Engineering Test Lead

    6 days ago

    Thāne, Maharashtra, India beBeeTestLeader Full time ₹ 15,00,000 - ₹ 25,00,000

    Role Overview">This is a full-time remote opportunity for a Senior Test Lead/Manager in Azure Data Engineering.">The Senior Test Lead/Manager will oversee the entire testing lifecycle, developing test strategies, coordinating with various teams, managing test plans, and ensuring the quality of Azure Data solutions.">Responsibilities">Experience in Azure Data...

  • Distinguished Technical Lead in Data Engineering

    5 days ago

    Thāne, Maharashtra, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 24,00,000

    Job Description">We are seeking a skilled Senior Data Engineer to lead the design, development, and maintenance of data pipelines and data warehouse solutions on Google Cloud Platform (GCP).This role plays a critical part in ensuring seamless data flow across systems, enabling data-driven decision-making.The successful candidate will have expertise in GCP,...