Web Data Engineering Lead

2 days ago


hubballi, India beBeeDataEngineering Full time

Job Title: Web Data Engineering LeadOverview:The role of Web Data Engineering Lead involves overseeing the development and maintenance of large-scale data engineering systems, including web crawling infrastructure.Design and implement scalable data pipelines with expertise in Python and SQL.Collaborate with cross-functional teams to translate data requirements into technical solutions.Key Responsibilities:Lead and mentor high-performing data engineering and web crawling teams.Architect and implement robust data pipelines using modern frameworks and tools.Develop and maintain complex crawling systems for large datasets.Establish efficient pipeline orchestration using distributed processing technologies.Define and enforce data quality, validation, and security measures.Requirements:Proficiency in Python and SQL programming languages.Experience with cloud platforms like AWS, GCP, or Azure.Knowledge of AI-driven automation and workflow orchestration tools like Airflow or Celery.Strong leadership and collaboration skills.Benefits:This role offers a dynamic work environment with opportunities for growth and professional development.What We Offer:A competitive salary and benefits package, as well as a collaborative team environment.



  • hubballi, India beBeeData Full time

    We are seeking a talented Web Data Extraction Specialist to lead the development of robust web crawlers, ensuring data quality and integrity.The ideal candidate should possess strong Python programming skills, experience with web scraping frameworks like Scrapy, browser automation tools, and techniques for handling anti-scraping mechanisms.Maintain and...


  • hubballi, India beBeeDataEngineer Full time

    Job OverviewThe ideal candidate will lead the design, development and deployment of data engineering solutions and back-end services within a microservices environment.Key Responsibilities:Architect and implement scalable data pipelines for ingestion, processing and storage of data from various sources ensuring data quality and reliability.Design, code...


  • hubballi, India beBeefrontend Full time

    About Web DevelopmentAs a highly skilled Senior Frontend Developer, you will play a pivotal role in crafting high-performance web applications that reach millions of users daily.Key Responsibilities:Design and develop intuitive web experiences that meet the highest standards of speed, scalability, SEO, and accessibility.Collaborate with product managers and...


  • hubballi, India beBeeAutomation Full time

    Web-Form Automation EngineerWe are seeking a skilled Web-Form Automation Engineer to design, build, and maintain robust automation processes.Map structured JSON payloads onto unique web forms with varying layouts, validation rules, and anti-bot measures.Ensure consistent data submissions 24×7 with monitoring, retry mechanisms, and auditable logging.Develop...


  • hubballi, India beBeeDataScientist Full time

    Unlock Your Potential as a Data ScientistWe are seeking a highly skilled and experienced Data Scientist to join our team. As a key member of our organization, you will be responsible for developing and implementing data-driven solutions that drive business growth and improve customer experience.About the RoleThe ideal candidate will have a strong background...


  • hubballi, India beBeeData Full time

    Job Title:Data ArchitectWe are seeking a highly skilled Data Architect to lead our data engineering efforts and design large-scale database systems.About the Role:Lead the design, development, and implementation of complex database systems, including data warehouses and data pipelines.Collaborate with cross-functional teams to understand business...


  • hubballi, India beBeeAutomation Full time

    Job Title: Web Scraping Automation SpecialistWe are seeking a highly skilled Web Scraping Automation Specialist to join our team. As a key member of our data acquisition team, you will be responsible for designing and implementing high-scale automated scraping workflows for dynamic and protected websites.


  • hubballi, India beBeeWebDevelopment Full time

    Job OpportunityWe are seeking a skilled professional to lead the design, development and maintenance of robust web applications.Create scalable web solutions using PHP technology.Collaborate with cross-functional teams to define project requirements and deliver technical solutions.Ensure high performance, quality and scalability of applications.The ideal...


  • hubballi, India beBeeDataEngineer Full time

    As a Senior Data Engineer, you will be responsible for designing and developing data pipelines using PySpark and SQL to support our Sustainability project.This role involves:Developing ETL/ELT pipelines to integrate carbon footprint analytics from various sources.Building data models combining engineering (EBOM), manufacturing (MBOM), supplier, and factory...


  • hubballi, India beBeeIntegration Full time

    System Integration EngineerWe are seeking an experienced System Integration Engineer to lead the development of a middleware-based integration platform and a web-based Guest Personalization Software.Key Responsibilities:Design and develop a middleware integration layer connecting PMS/CRS systems, EMR/healthcare systems, or hospitality-tech platforms.Automate...