Data Engineering Leader

2 weeks ago


kozhikode, India beBeeDataEngineering Full time

Data Engineering Manager - Web Crawling is a pivotal role that demands exceptional leadership and technical expertise.Job Description:We seek an experienced Data Engineering Manager to lead our web crawling and pipeline architecture initiatives. Your primary focus will be on designing, building, and optimizing scalable data pipelines that can handle high-volume data ingestion, transformation, and storage.Key Responsibilities:Lead and mentor data engineering and web crawling teams to ensure high-quality delivery and adherence to best practices.Develop and implement robust crawling systems using modern frameworks, incorporating IP rotation, throttling, and dynamic content extraction.Establish efficient pipeline orchestration using Airflow, Celery, or similar distributed processing technologies.Define and enforce data quality, validation, and security measures across all data flows and pipelines.Required Skills and Qualifications:Expertise in designing, building, and optimizing scalable data pipelines using workflow orchestration tools.Proficiency in Python and SQL for data extraction, transformation, processing, and storage.Strong leadership and mentoring skills to guide teams towards achieving excellence.What We Offer:A challenging and dynamic work environment that fosters growth and innovation.The opportunity to work with cutting-edge technologies and contribute to the development of industry-leading solutions.



  • kozhikode, India beBeeDataEngineering Full time

    Job Title: Data Engineering LeaderWe are seeking a seasoned data engineering professional to lead our data architecture and technology initiatives.Oversee the design, development, and deployment of large-scale data pipelines and cloud-based solutionsMentor junior engineers in designing efficient and reusable Python scripts for data processingDevelop complex...


  • kozhikode, India beBeeDataLeadership Full time

    Director of Data SolutionsAs a Director of Data Solutions, you will be responsible for leading regional data teams and establishing data governance.Establish regional standards for semantic models and unified data definitionsDeploy GenAI capabilities across multiple marketsMange Principal Analysts across APACCollaborate with global teams on data engineering...


  • kozhikode, India beBeeAnalytics Full time

    Lead Analytics SpecialistOur organization seeks an exceptional Lead Analytics Specialist to empower leaders in the Life Sciences with cutting-edge insights.Lead advanced analytics for US pharmaceutical brands, driving business growth through data-driven decision making.Develop forecasting models to project demand and revenue, ensuring accurate market...


  • kozhikode, India beBeeData Full time

    We are seeking a visionary leader to spearhead our data solutions strategy and drive business growth through innovative analytics and reporting.


  • kozhikode, India beBeeAutomation Full time

    Job OverviewThe Platform Automation Engineering Manager is a leadership role responsible for overseeing the development and implementation of test automation frameworks, tooling, and data management to enhance enterprise processes.ResponsibilitiesDesign and implement scalable testing environments and data solutions to ensure system reliability and...


  • kozhikode, India beBeeEngineering Full time

    Key Roles and ResponsibilitiesWe are expanding our product offerings and user base across various markets, including India. Our mission relies heavily on reliable products and systems to achieve our objectives.The selected candidate will lead a small group of engineers focusing on a particular facet of our products and infrastructure across the stack. This...

  • Cloud Data Engineer

    1 week ago


    kozhikode, India Lemongrass Full time

    About Lemongrass Lemongrass is a software-enabled services provider, synonymous with SAP on Cloud, focused on delivering superior, highly automated Managed Services to Enterprise customers. Our customers span multiple verticals and geographies across the Americas, EMEA and APAC. We partner with AWS, SAP, Microsoft and other global technology leaders. We are...


  • kozhikode, India Sutherland Full time

    We are accelerating our digital transformation by adopting AI, data engineering, and modern digital platforms to build intelligent, scalable, and integrated systems across the enterprise. As a Senior Data Engineer – API, you will serve as a technical leader responsible for designing and building high-performance data APIs, scalable backend services, and...


  • kozhikode, India beBeeDirector Full time

    Are you ready to take on a leadership role in shaping regional data standards?The ideal candidate will have over 7 years of experience in data solutions, analytics, BI, or data product roles.Key responsibilities include leading the deployment of GenAI capabilities, ensuring consistent data governance across multiple markets, and managing Principal Analysts...

  • Data Engineer

    2 weeks ago


    Kozhikode, India ShimentoX Technologies Full time

    Data Engineer (Strong with Building data connectors)Location: RemoteKey Skills: Python, Data Connectors, Metadata, API Integration-Rest/GraphQLJob Description:1. Must have proven background in building data connectors. 2. Experience software engineering in JAVA, Rust, GO, etc, but Python is desired3. Experience in coding agents in critical use4....