Data Pipeline Architect

1 week ago

mount, India beBeeAutomation Full time

Job Title: Automation SpecialistWe are seeking a skilled Automation Specialist to join our team. As an expert in web automation, you will design and implement scalable data pipelines to extract, transform, and load data from dynamic and protected websites.The ideal candidate will have hands-on experience with Python-based web scraping and automation tools such as Selenium, Playwright, and Puppeteer. They will also possess strong expertise in managing cookies, sessions, and local storage, as well as the ability to bypass authentication and anti-bot systems.Responsibilities:Develop and maintain high-scale automated scraping workflows for dynamic and protected websites.Implement browser automation solutions using advanced techniques such as CAPTCHA-solving services, proxy rotation systems, and anti-detection mechanisms.Design and build robust ETL-style data pipelines ensuring data quality, monitoring, retries, and error handling.Collaborate with AI, data engineering, and product teams to deliver reliable scraping datasets.Our ideal candidate will have 3–5 years of experience in Python-based web scraping and automation, as well as strong experience in Selenium, Playwright, Puppeteer, and browser automation. They will also be fluent in Python with experience using Requests, BeautifulSoup, Async frameworks, or Scrapy.Additional requirements include hands-on experience with proxy networks, fingerprinting, session handling, and anti-bot strategies, as well as understanding of SQL/NoSQL databases for structured data storage. Experience working with AWS/GCP/Azure is a plus. Strong debugging, analytical, and problem-solving skills are essential for this role.What We Are Looking For:Strong hands-on experience handling dynamic, JavaScript-heavy websites using Selenium, Playwright, or Puppeteer.Expertise in managing cookies, sessions, and local storage to maintain state and bypass authentication/anti-bot systems.Ability to solve CAPTCHAs programmatically using third-party or AI-based solutions.Proven experience in proxy rotation, IP management, and fingerprinting techniques to avoid detection and rate limits.

  • Cloud Data Pipeline Architect

    1 week ago

    mount, India beBeeDataEngineer Full time

    Cloud Data Engineer PositionAbout Lemongrass is a software-enabled services provider, synonymous with SAP on Cloud, focused on delivering superior, highly automated Managed Services to Enterprise customers. Our customers span multiple verticals and geographies across the Americas, EMEA and APAC. We partner with AWS, SAP, Microsoft and other global technology...

  • Senior Data Architect

    2 weeks ago

    mount, India beBeeSolution Full time

    Job DescriptionWe're seeking a seasoned data architect to lead the design and delivery of our enterprise data & analytics solutions. As a senior solution architect, you'll own the architecture for ETL/ELT, data warehousing, analytics pipelines, data governance, and integrations with various systems.You'll define end-to-end data architecture and roadmaps for...

  • Data Pipeline Engineer

    6 days ago

    mount, India beBeeDataEngineer Full time

    Unlock the power of robust data pipelines to drive nationwide analytics and fuel machine learning systems.Pipeline Development: Design, build, and maintain scalable ETL pipelines using Python (Pandas, PySpark) and SQL, orchestrated with Airflow.Data Lake Development: Develop and maintain the Data Lake/Lakehouse on AWS, ensuring quality, governance,...

  • Data Pipeline Specialist

    1 week ago

    mount, India beBeeData Full time

    Reliable Data Solutions EngineerWe are shaping the future of healthcare analytics. Our objective is to build pipelines that operate efficiently, effectively, and continuously improve in production.This is a fully remote role open to candidates based in Europe or India, with occasional team gatherings in Mountain View, California.Design and implement scalable...

  • Enterprise Data Architect

    2 weeks ago

    mount, India beBeeData Full time

    Senior Data Architect Job DescriptionWe're looking for a seasoned Senior Solutions Architect to lead the design and delivery of enterprise data analytics solutions.This role will own the architecture for ETL/ELT, data warehousing, analytics pipelines, data governance, and integrations with LMS/EdTech systems turning education data into actionable insights...

  • Chief Data Architect

    4 days ago

    mount, India beBeeData Full time

    Senior Data Engineer Job SummaryThis role is seeking a highly skilled Senior Data Engineer with expertise in Azure cloud, Big Data technologies, and distributed data processing frameworks.The ideal candidate will design, build, optimize, and manage large-scale data pipelines that support both batch and real-time analytics.Key Responsibilities:Design and...

  • High-Performance Data Architect

    2 weeks ago

    mount, India beBeeDataEngineer Full time

    Senior Data Engineer PositionWe are seeking an experienced Senior Data Engineer with hands-on mastery in Oracle Data Integrator (ODI) and deep understanding of ETL and ELT frameworks.This role centers on architecting robust data pipelines across on-prem and cloud Oracle ecosystems, automating ingestion from varied sources including APIs.Exposure to Oracle...

  • Data Architect Leader

    6 days ago

    mount, India beBeeBigData Full time

    Senior Big Data Developer PositionWe are seeking an experienced Senior Big Data Developer to join our team.The ideal candidate will have 6+ years of high-tech industry and/or IT work experience in data project hands-on development and solution engineering roles.Key Responsibilities:Analyze, organize and process raw data using big data technologies and...

  • Senior Cloud Data Architect

    2 weeks ago

    mount, India beBeeData Full time

    Role SummaryAzure Data Lead Architect is a pivotal position that oversees the strategic direction of our data engineering initiatives. This key role demands exceptional expertise in designing and implementing data pipelines, while fostering collaboration among cross-functional teams to ensure seamless data quality and security.Key ResponsibilitiesLead data...

  • Cloud Data Architect

    2 weeks ago

    mount, India beBeeSolution Full time

    Cloud Solution Architect Role OverviewThe role of a Cloud Solution Architect is a high-level position that requires expertise in designing and implementing cloud-based solutions for clients. In this capacity, you will be responsible for developing comprehensive data architectures that meet the needs of mission-critical public-facing transactional websites...