Data Intelligence Developer

21 hours ago

Tiruchi, Tamil Nadu, India beBeeWebCrawler Full time ₹ 6,00,000 - ₹ 11,00,000
Job Description

We are seeking a highly skilled Web Crawling Engineer to join our team. In this role, you will be responsible for building and maintaining web crawlers that extract valuable insights from the web, ensuring data quality, and optimizing crawling efficiency.

The ideal candidate will have strong Python programming skills, experience with web scraping frameworks, browser automation tools, and knowledge of handling anti-scraping mechanisms.

Our company is a pioneer in AI-powered data extraction and automation. We transform complex, unstructured web and document data into clean, structured intelligence, combining web crawling, NLP, LLMs, and agentic AI.

Key Responsibilities:
  • Maintain and enhance existing web scraping and data crawling projects.
  • Develop and refine crawlers using Python-based tools and frameworks.
  • Utilize browser automation tools (e.g., Playwright, Selenium) to handle dynamic content.
  • Clean, validate, and integrate extracted data into downstream storage systems.
  • Implement and manage solutions for anti-bot measures (CAPTCHAs, IP rotation, etc.).
  • Optimize crawling efficiency and ensure compliance with web crawling best practices.
Required Skills & Qualifications:
  • Proficiency in Python and 2 years of work experience of web scraping frameworks (especially Scrapy).
  • Strong knowledge of browser automation tools such as Playwright or Selenium.
  • Solid understanding of HTML, CSS, and selector languages (XPath/CSS).
  • Experience in handling anti-scraping challenges and ensuring robust data extraction.
  • Familiarity with distributed scraping techniques and data pipelines.
  • Ability to troubleshoot and optimize web crawlers for performance and reliability.
  • Strong analytical and problem-solving skills with attention to detail.
  • Excellent communication and inter-personal skills.
Infrastructure Requirements
  • High-speed internet connectivity for video calls and efficient work.
  • Capable business-grade computer (e.g., modern processor, 8 GB+ of RAM, and no other obstacles to interrupted, efficient work).
  • Headphones with clear audio quality.
  • Stable power connection and backups in case of internet/power failure.

  • Data Intelligence Architect

    6 days ago

    Tiruchi, Tamil Nadu, India beBeeGenerative Full time ₹ 1,50,00,000 - ₹ 2,10,00,000

    About the PositionWe are seeking an accomplished Gen AI Engineer to join our team and drive the development of innovative data intelligence platforms that seamlessly integrate structured and unstructured data sources.Main Responsibilities:Design and implement scalable, high-performance data intelligence platforms that effortlessly merge structured and...

  • Business Intelligence Solutions Developer

    4 days ago

    Tiruchi, Tamil Nadu, India beBeeDataWarehouse Full time ₹ 12,00,000 - ₹ 25,00,000

    About the RoleCvent is a leading meetings, events, and hospitality technology provider with over 4,800 employees and ~22,000 customers worldwide. Our technology brings millions of people together at events around the globe.We value diverse perspectives and foster a culture that celebrates differences and builds on shared connections.The Data Warehouse...

  • Azure Data Engineer

    21 hours ago

    Tiruchi, Tamil Nadu, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Skywalk Global seeks to strengthen its Data Engineering team by hiring a skilled Azure & Data ETL Developer.The ideal candidate will have strong skills in Azure Functions, ADF, and SQL/T-SQL, as well as hands-on experience with Snowflake and transformation tools like dbt or equivalent frameworks.They will work on building ELT pipelines with ADF/Azure Data...

  • Senior Business Intelligence Developer

    16 hours ago

    Tiruchi, Tamil Nadu, India beBeeBusinessIntelligence Full time ₹ 10,00,000 - ₹ 15,00,000

    This is an exciting opportunity to join a forward-thinking organization as a Senior Business Intelligence Developer.As a key member of the team, you will be responsible for designing and building data solutions that meet the business's needs. This includes architecting, implementing, and maintaining warehouse and reporting solutions.You will work closely...

  • Principal Business Intelligence Developer

    5 days ago

    Tiruchi, Tamil Nadu, India beBeeBusinessIntelligence Full time ₹ 10,00,000 - ₹ 15,00,000

    Job Title: Power BI DeveloperGurgaon is the hub for our team, and we are seeking a talented Power BI Developer to join our ranks. As a key member of our analytics team, you will be responsible for developing reports and dashboards using Business Intelligence tools.Key Responsibilities:Design and develop reports and dashboards using Power BI Desktop and...

  • Intelligent Document Processing Expert

    1 hour ago

    Tiruchi, Tamil Nadu, India beBeeSpecialist Full time ₹ 18,00,000 - ₹ 25,20,000

    Job Title: Intelligent Document Processing SpecialistWe are seeking an experienced Intelligent Document Processing Specialist to join our team. The ideal candidate will have a strong background in technical areas such as digitization, OCR/ICR/OMR, LLM, classification methodologies, data extraction methodologies, machine learning, artificial intelligence,...

  • AI/ML Expert: Developing Intelligent Systems

    21 hours ago

    Tiruchi, Tamil Nadu, India beBeeArtificialIntelligence Full time ₹ 18,00,000 - ₹ 24,00,000

    Job Title: AI/ML EngineerWe are seeking a highly skilled and motivated professional to join our IT operations team in an Artificial Intelligence Operations (AIOps) role.The ideal candidate will leverage artificial intelligence and machine learning to enhance observability, automate incident detection and resolution, and optimize IT...

  • Business Intelligence Architect

    1 day ago

    Tiruchi, Tamil Nadu, India beBeeDataManagement Full time ₹ 15,00,000 - ₹ 20,10,000

    KMK is a global analytics and technology consulting firm empowering leaders across the Life Sciences industries to make informed, data-driven decisions.Our analytics and software platforms support data science, commercial operations, real-world evidence, and cloud information management solutions.We help optimize business strategy and operations by...

  • Artificial Intelligence Developer

    5 days ago

    Tiruchi, Tamil Nadu, India beBeeArtificialIntelligence Full time ₹ 25,00,000 - ₹ 40,00,000

    Job Title: Artificial Intelligence EngineerKey Responsibilities:Data Science & Machine Learning:Design, develop and deploy advanced machine learning models to solve complex business problems.Implement and optimize Large Language Models (LLMs) for real-world applications.Build agent-based AI systems with autonomous decision-making capabilities.Conduct...

  • Advanced Data Analyst

    5 days ago

    Tiruchi, Tamil Nadu, India beBeeDataAnalysis Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Business Intelligence AnalystWe are seeking a skilled Business Intelligence Analyst to join our team.Job Description:The ideal candidate will have a strong background in data analysis, business intelligence, and project management.Collaborate with cross-functional teams to identify business needs and develop data-driven solutions.Design, implement, and...