Senior Data Engineering Leader

12 hours ago

Palakkad, Kerala, India beBeeDataScraping Full time ₹ 12,00,000 - ₹ 18,00,000
Lead Data Scraping Engineer

A high-performing Lead Data Scraping Engineer is sought after to spearhead a team of 5+ developers in designing and implementing advanced data scraping solutions using Scrapy and Python libraries. This role demands expertise in leadership, technical proficiency, and problem-solving skills to drive the team towards success.

  • Design and develop scalable data scraping solutions
  • Lead and mentor a team of 5+ developers
  • Implement blocking and captcha-solving techniques
  • Conduct source code reverse engineering and automate web interactions
  • Manage proxies and IP rotation
  • Maintain and improve API integrations and data pipelines
Requirements
  • Minimum 4 years of experience in IT scraping industry
  • Minimum 2 years leading a team of 5+ developers
  • Expertise in Scrapy, Threading, requests, and web automation
Technical Skills
  • Advanced Python
  • Captcha solving and blocking handling
  • Source reverse engineering
  • Proxy management and IP rotation
  • App automation, SSL Unpin, Frida
  • API Management and Version Control Systems
Leadership Skills
  • Project management
  • Documentation
  • Team handling
  • Pressure management
  • Flexibility and adaptability
  • High accountability

  • Senior Data Leader

    5 days ago

    Palakkad, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior Director, Real World DataDescription:The Senior Director (Real World Data) is a senior leadership position within our organization. This role involves owning and managing a significant body of work, as well as providing support to the RWD team for other parts of the organization.Key responsibilities include leading a team of analysts who support the...

  • Data Engineering Leader

    1 week ago

    Palakkad, Kerala, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Senior Data EngineerAre you an expert data engineer looking to build large-scale data platforms on Google Cloud? We're seeking a talented professional with experience in designing and building robust data pipelines for ingestion, transformation, and analytics.Key Responsibilities:Design and develop efficient data pipelines using modern tools and...

  • Data Engineer Leader

    2 days ago

    Palakkad, Kerala, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Senior Data Engineering Specialist Job Title: Senior Data Engineering SpecialistExperience Level: 5+ YearsKey Responsibilities:Develop and optimize ETL/ELT pipelines using Azure Data Factory (ADF), Databricks, and Synapse Analytics.Design and implement scalable data architectures following Medallion Architecture and best practices.Perform data ingestion,...

  • Senior Hospitality Engineer Leader

    4 days ago

    Palakkad, Kerala, India beBeeEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Description:The Corporate Chief Engineer is a strategic leader responsible for overseeing engineering operations across all resorts. This role involves developing and standardizing engineering policies, leading capital expenditure projects, and setting benchmarks for property-level engineering teams.Key responsibilities include maintaining optimal...

  • Senior Data Engineering Leader

    7 days ago

    Palakkad, Kerala, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,20,00,000

    Engineering Manager RoleWe are seeking an experienced Engineering Manager to lead our team of data engineers in designing and delivering scalable data pipelines and analytics platforms.

  • Data Strategy Leader

    6 days ago

    Palakkad, Kerala, India beBeeDataStrategy Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Senior Data Strategy LeadWowjobs is seeking a seasoned data strategy professional to lead the development and implementation of strategic plans for delivering complex data projects.Key Responsibilities:Define and implement best practices and standards for data project execution.Monitor project health through key performance indicators (KPIs), metrics, and...

  • Senior Engineering Leader

    6 days ago

    Palakkad, Kerala, India beBeeEngineering Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Job Overview:Seeking a seasoned leader to oversee engineering teams and drive strategic product development.Drive product delivery and project commitments through effective team leadership.Contribute to product roadmap discussions, providing expertise on design, modeling, and architecture.Lead the development of innovative products, solutions, and...

  • Senior Data Engineer

    4 days ago

    Palakkad, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job OverviewAchieve success as a Senior Data Engineer with expertise in large-scale data processing and system design.Key Responsibilities:• Develop high-performance ETL workflows using Python and Pandas to handle complex supply chain operations and personalized customer experiences.• Implement data ingestion and transformation processes using Hive SQL...

  • Senior Data Engineer

    6 days ago

    Palakkad, Kerala, India beBeeDataEngineering Full time ₹ 1,00,00,000 - ₹ 1,50,00,000

    Job DescriptionAs a senior data engineering professional, you will design and implement large-scale data pipelines using Azure Databricks and Azure Data Lake. Your primary focus will be on building production-ready workflows for data ingestion, transformation, quality checks, lineage capture, access auditing, cost usage analysis, retention tracking, and...

  • Cloud Data Engineer Position

    17 hours ago

    Palakkad, Kerala, India beBeeDataEngineering Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    Senior Data Engineering SpecialistWe are seeking a skilled data engineer to join our team and lead the development of large-scale data processing systems on Google Cloud Platform.