AI - Data Engineer - Web Scraping

1 week ago

India Taiyo Full time

Job Description :
About Taiyo

AI :
We empower the people who build the world.

Taiyo.
AI is the world's first infrastructure intelligence platform.

We are building the largest universal and industry standard database of opportunities (tenders, projects, news) and threats (economy, climate, geopolitics, finance, logistics, etc.) for real assets.

Taiyo.

AI has been instrumental in shaping how infrastructure companies (infra investors, engineering, procurement, construction, and infra insurers) benchmark new project development opportunities, get a panoramic and dynamic view of external risks, predict prices, identify drivers, and mitigate supply-side disruptions.

We are seeking a candidate that is willing to learn and contribute to emerging technology and policy.

About The Team :


We are looking for the head of cloud backend engineering to oversee backend ops for managing and monitoring the data, related predictive analysis, provide insight into infrastructure projects related project screening and dynamically evaluate external risks, with a strong focus on supporting automation, process design, and resource planning.


Key responsibilities :

  • Work on data sourcing
  • Use web scrapers (Beautifulsoup, selenium, etc.)
  • Manage the data normalization and standards validation
  • Parametrize and automate the scrapers
  • Develop and execute the processes for monitoring data sanity and checking for data availability and reliability
  • Understand the business drivers and build insights through data
  • Work with the stakeholders at all levels to establish current and ongoing data support and reporting needs
  • Ensure continuous data accuracy and recognize data discrepancies in systems that require immediate attention/escalation
  • Work and become an expert in the company's data warehouse and other data storage tools, understanding the definition, context, and proper use of all attributes and metrics
  • Create dashboards based on business requirements
  • Work on the distributed systems, scale, cloud, caching, CI/CD (continuous integration and deployment), distributed logging, data pipeline, REST API)

Who can apply :

  • Creativity & complex problem-solving skills
  • Exceptional and scalable web scraping skills
  • Passion and interest in doing ETL jobs
  • Good English speaking and communication skills
  • Ability to work with a global remote culture
  • Initiative and entrepreneurship skills
  • Experience with microservices architecture and writing REST APIs
  • Knowledge of Kubernetes, Docker and Airflow
  • Prior experience with Python, Django and Gunicorn
  • Independent work ethic with an ability to work in a fast-paced environment
We are looking for data engineers with Python scripting practices and scalable web scraping skills, including monitoring ingestion of data, adhering to data standards, and solid knowledge of data and cloud workflow orchestration
)

  • Web Scraping Engineer

    1 week ago

    India Stealth AI Startup Full time

    Web scraping engineer at stealth AI startup This stealth startup applies AI to help hardware manufacturers manage their supply chain. We are currently in "stealth mode" but will share more information during the first interview round. **If you would like to apply, please ensure your education and work experience is visible on your LinkedIn profile.**...

  • Data Scraping Specialist

    1 week ago

    India Techno Wise Full time

    Location : Ahmedabad (WFO) Job Description : The Data Scraping Specialist will be responsible to perform web-scraping & web-acquisition activities that enable efficient scraping of data from online sources. Build effective & sustainable data-scraping tasks to support continuous data acquisition. Collaborate with various teams to support building a...

  • Taiyo.AI - Data Engineer - Web Scraping

    2 months ago

    india Taiyo.AI Full time

    Job Description :About Taiyo.AI :We empower the people who build the world.Taiyo.AI is the world's first infrastructure intelligence platform. We are building the largest universal and industry standard database of opportunities (tenders, projects, news) and threats (economy, climate, geopolitics, finance, logistics, etc.) for real assets. Taiyo.AI has been...

  • Lead Python Web Scraping Developer

    1 week ago

    India Infiniti Research Ltd. Full time

    Designation: Lead Software Engineer Job Opportunity for Python + Web Scraping We are currently looking for Python Developer + Web Scraping with 5+ years of work experience with good communication and strong technical skills. Python, Shell scripting Web Scraping, Regex Good Experience RabbitMQ, AWS Message Queue any other Queue Systems MySQL, SQL HTML,CSS,JS...

  • Lead Python Web Scraping Developer

    3 weeks ago

    india Infiniti Research Ltd. Full time

    Designation: Lead Software Engineer Job Opportunity for Python + Web Scraping!! We are currently looking for Python Developer + Web Scraping with 5+ years of work experience with good communication and strong technical skills. Python, Shell scripting Web Scraping, Regex Good Experience RabbitMQ, AWS Message Queue any other Queue Systems MySQL, SQL...

  • Data Scraping Specialist

    3 weeks ago

    Anywhere in India/Multiple Locations Techno Wise Full time

    Location : Ahmedabad (WFO) Job Description : - The Data Scraping Specialist will be responsible to perform web-scraping & web-acquisition activities that enable efficient scraping of data from online sources. - Build effective & sustainable data-scraping tasks to support continuous data acquisition. - Collaborate with various teams to support building...

  • Data Scraping Specialist

    2 months ago

    Anywhere in India,Multiple Locations Techno Wise Full time

    Location : Ahmedabad (WFO) Job Description : - The Data Scraping Specialist will be responsible to perform web-scraping & web-acquisition activities that enable efficient scraping of data from online sources. - Build effective & sustainable data-scraping tasks to support continuous data acquisition. - Collaborate with various teams to support building...

  • Data Engineer

    4 weeks ago

    india Bloom AI Full time

    Company Summary Bloom AI is a modern intelligence layer that accelerates decision-making through AI-driven synthesized insights. We empower enterprises to unlock the value of data with human-like synthesis and decision intelligence at scale. Our proprietary tools and solutions are trusted by investment managers, insurance, private equity, and Fortune 1000...

  • Senior Python Developer

    1 month ago

    india ACID Technologies Full time

    Responsibilities and Duties Minimum 3 years of Experience as a Python Developer in Web Scrapping  Extensive working experiece in web scraping with a focus on using Scrapy, Requests, and Beautiful Soup, NumPy, etc framework Cybersecurity knowledge, such as network security, intrusion detection, and prevention is added advantage Excellent knowledge of web...

  • Taiyo.AI - Data Engineer - Web Scraping

    3 weeks ago

    Anywhere in India/Multiple Locations Taiyo.AI Full time

    Job Description :About Taiyo.AI :We empower the people who build the world.Taiyo.AI is the world's first infrastructure intelligence platform. We are building the largest universal and industry standard database of opportunities (tenders, projects, news) and threats (economy, climate, geopolitics, finance, logistics, etc.) for real assets. Taiyo.AI has...

  • Taiyo.AI - Data Engineer - Web Scraping

    2 months ago

    Anywhere in India/Multiple Locations Taiyo.AI Full time

    Job Description :About Taiyo.AI :We empower the people who build the world.Taiyo.AI is the world's first infrastructure intelligence platform. We are building the largest universal and industry standard database of opportunities (tenders, projects, news) and threats (economy, climate, geopolitics, finance, logistics, etc.) for real assets. Taiyo.AI has...

  • Web Specialist

    1 week ago

    India Foresiet Full time

    Web scraping specialist - Company DescriptionForesiet is an AI-enabled SaaS-based cybersecurity company that has developed an innovative One Click Digital Risk Protection platform. Our platform proactively detects, monitors, and secures identity, data, and asset threats from the surface, deep, and dark web. Combining human intelligence and applied research,...

  • Web Specialist

    3 weeks ago

    India Foresiet Full time

    Web scraping specialist -     Company Description   Foresiet is an AI-enabled SaaS-based cybersecurity company that has developed an innovative One Click Digital Risk Protection platform. Our platform proactively detects, monitors, and secures identity, data, and asset threats from the surface, deep, and dark web. Combining human intelligence and applied...

  • Web Specialist

    3 weeks ago

    India Foresiet Full time

    Web scraping specialist -  Company Description Foresiet is an AI-enabled SaaS-based cybersecurity company that has developed an innovative One Click Digital Risk Protection platform. Our platform proactively detects, monitors, and secures identity, data, and asset threats from the surface, deep, and dark web. Combining human intelligence and applied...

  • Web Specialist

    2 months ago

    India Foresiet Full time

    Web scraping specialist -     Company Description   Foresiet is an AI-enabled SaaS-based cybersecurity company that has developed an innovative One Click Digital Risk Protection platform. Our platform proactively detects, monitors, and secures identity, data, and asset threats from the surface, deep, and dark web. Combining human intelligence and applied...

  • Web Specialist

    2 months ago

    India Foresiet Full time

    Web scraping specialist -  Company Description Foresiet is an AI-enabled SaaS-based cybersecurity company that has developed an innovative One Click Digital Risk Protection platform. Our platform proactively detects, monitors, and secures identity, data, and asset threats from the surface, deep, and dark web. Combining human intelligence and applied...

  • AI Engineer

    4 weeks ago

    India Flavor AI Full time

    Company DescriptionFlavor AI is building a conventional intelligence assistant for enterprise business users, by gathering insights across the enterprise's private data stacks.Our co-founding team brings rich AI and data experiences from Microsoft, IIT-Madras, and Stanford.Role DescriptionThis is a full-time remote role for an AI Engineer. The AI Engineer...

  • AI Engineer

    3 weeks ago

    India Flavor AI Full time

    Company DescriptionFlavor AI is building a conventional intelligence assistant for enterprise business users, by gathering insights across the enterprise's private data stacks.Our co-founding team brings rich AI and data experiences from Microsoft, IIT-Madras, and Stanford.Role DescriptionThis is a full-time remote role for an AI Engineer. The AI Engineer...

  • AI Engineer

    3 weeks ago

    India Flavor AI Full time

    Company Description Flavor AI is building a conventional intelligence assistant for enterprise business users, by gathering insights across the enterprise's private data stacks. Our co-founding team brings rich AI and data experiences from Microsoft, IIT-Madras, and Stanford. Role Description This is a full-time remote role for an AI Engineer. The AI...

  • AI Engineer

    1 week ago

    India Flavor AI Full time

    Company Description Flavor AI is building a creative analytics AI assistant that helps gather deep insights into the effectiveness of creative decisions across marketing campaigns and channels. Ideal for growth and creative marketing teams working to optimize creatives at speed and scale. Our co-founding team brings rich AI, data and ad-tech experiences...