Senior Web Data Engineering Professional

1 week ago

Bengaluru, Karnataka, India beBeeWebScraping Full time ₹ 10,00,000 - ₹ 15,00,000
Job Title:

Web Scraping Solutions Architect

About the Role:

We are seeking a skilled Web Scraping Solutions Architect to design and implement high-throughput product data ingestion pipelines.

Key Responsibilities:
  • Design and implement end-to-end web scraping solutions using Python.
  • Owning the crawling/extraction layer: HTTP-first crawling with a Playwright fallback, per-domain learned selectors, and reliable PDF handling.
  • Drive automation around scheduling, retries, and monitoring so runs are hands-off and integrate vendor/public APIs (REST/GraphQL) to complement crawling.
Requirements:
  • 4+ years of experience in Python development, including 2+ years building production web crawlers at scale.
  • Strong experience with Scrapy or aiohttp/asyncio and Playwright (or Puppeteer) in production.
  • Practical proxy management, polite anti-bot tactics, and per-domain rate limiting.
  • Hands-on with ETag/Last-Modified, retries, backoff, and HTTP caching.
  • Confident with CSS/XPath, schema.org/JSON-LD, and HTML parsing.
  • APIs: consuming REST/GraphQL and building small internal services.
  • Automation/Orchestration: Airflow/Temporal/Celery for scheduled runs and monitoring.
  • PDF handling and file integrity checks.
  • Queues (Redis/Kafka), Docker, Linux basics; comfort with logs/metrics.
  • Clear communication and strong ownership.

  • Web Engineering Professional

    6 days ago

    Bengaluru, Karnataka, India beBeeWebEngineering Full time ₹ 6,00,000 - ₹ 8,00,000

    Job Title: Web Engineering ProfessionalWe are seeking an accomplished Web Engineering Professional to develop, deploy and maintain high-performance web applications using ReactJS on the front end and .NET technologies on the back end.Key Responsibilities:Design, implement and maintain frontend components utilizing React.js, Redux, TypeScript and modern...

  • Web Automation Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Capgemini Engineering Full time

    Position :- Web Test Automation Engineer – Cypress (Mandatory) Location: At Capgemini, we empower you to shape your career your way. Be part of a global community that supports, inspires, and collaborates to unlock the value of technology. Help leading organizations build sustainable, inclusive digital futures. As a Test Automation Engineer, you will lead...

  • Data Senior Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time US$ 80,000 - US$ 1,20,000 per year

    Req ID: 337669NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Senior Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: 8+ years of experience...

  • Digital Engineering Senior Consultant

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Req ID 291234NTT DATA Services strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Digital Engineering Senior Consultant to join our team in Bangalore Karn xc4 x81taka IN-KA India IN Front...

  • Senior Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 1,04,000 - ₹ 1,30,878

    Job Title: Senior Data Engineer About the RoleThis is an exciting opportunity to join our team as a senior data engineer. We are looking for a highly skilled and experienced professional who can design, develop, and implement large-scale data processing systems.

  • Senior Data Engineering Professional

    2 weeks ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 25,00,000 - ₹ 30,00,000

    About the RoleAs a senior data engineer, you will be responsible for designing and building scalable data pipelines using Google Cloud Platform technologies. You will lead a team of data engineers to deliver high-quality data solutions and collaborate with cross-functional teams to understand business requirements.

  • Senior Software Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Nanda Professional Services Private Limited Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    We are looking for a Senior Software Engineer with strong expertise in .NET Core and Web API development to join our dynamic engineering team. In this role, you will design, develop, and maintain scalable and high-performance web applications and APIs that power our platforms. You will work closely with cross-functional teams to deliver robust and efficient...

  • Senior, Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time US$ 1,04,000 - US$ 1,30,878 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Manager,...

  • Web Test Automation Engineer – Cypress

    2 weeks ago

    Bengaluru, Karnataka, India Capgemini Engineering Full time

    Position :- Web Test Automation Engineer – Cypress (Mandatory)Location: BengaluruAt Capgemini, we empower you to shape your career your way. Be part of a global community that supports, inspires, and collaborates to unlock the value of technology. Help leading organizations build sustainable, inclusive digital futures.Your RoleAs a Test Automation...

  • Web Test Automation Engineer – Cypress

    2 weeks ago

    Bengaluru, Karnataka, India Capgemini Engineering Full time

    Job DescriptionPosition :- Web Test Automation Engineer Cypress (Mandatory)Location: BengaluruAt Capgemini, we empower you to shape your career your way. Be part of a global community that supports, inspires, and collaborates to unlock the value of technology. Help leading organizations build sustainable, inclusive digital futures.Your RoleAs a Test...