Data Engineer

Experience Level: Software Engineer- 3-5 years of relevant experience in data engineering.

About Forage AI: Forage AI is a pioneering AI-powered data extraction and automation company that transforms complex, unstructured web and document data into clean, structured intelligence. Our platform combines web crawling, NLP, LLMs, and agentic AI to deliver highly accurate firmographic and enterprise insights across numerous domains. Trusted by global clients in finance, real estate, and healthcare, Forage AI enables businesses to automate workflows, reduce manual rework, and access high-quality data at scale.

About the Role: We are seeking a talented and growth-minded Software Engineer who is passionate about building, scaling, and modernizing impactful business systems. In this full-time position, you'll work on a mix of new feature development, system enhancements, and platform modernization initiatives—while ensuring the stability and reliability of our core products. You'll have the chance to experiment with and implement GenAI-driven approaches, innovations, and new strategies as we continue to evolve our solutions. We value engineers who express their best technical talent, contribute innovative ideas to overall product development, and propose creative automation solutions across our engineering efforts. This is an opportunity to propose and lead technical improvements, contribute to architectural evolution, and make your mark on products used by real customers. Structured onboarding and domain training will be provided to set you upfor success.

Key Responsibilities:

• Design and develop new features and enhancements for our core platforms and services.
• Contribute to the modernization and refactoring of existing systems and code bases.
• Propose, experiment with, and implement GenAI-based innovations, tools, or workflows to solve business problems and create new value.
• Drive technical improvements, suggest and lead platform upgrades, and champion engineering best practices.
• Investigate, debug, and resolve production issues, to deliver robust solutions that improve performance and maintainability.
• Collaborate with product, engineering, and business teams to deliver impactful end-to end solutions.
• Help maintain the reliability, scalability, and security of our systems as we evolve our platform.

Technical Skills & Requirements:

• Python: Strong hands-on experience with core Python and its standard libraries
• Web Framework: Experience developing backend APIs and services using FastAPI/Flask.
• RabbitMQ: Proficiency in implementing message queues and task distribution.
• Docker & Docker Compose: Experience containerizing applications and managing services.
• WebScraping: Demonstrated expertise with webscraping tools and techniques.
• Playwright & Selenium: Practical experience with browser automation frameworks.
• PostgreSQL & SQLAlchemy: Proficient in SQL and ORM-based data access.
• MongoDB & PyMongo: Experience with NoSQLdata using PyMongo.
• Redis: Practical use for caching and lightweight messaging.
• AWS: Hands-on experience with services such as S3, Secrets Manager, and Auto Scaling Groups(using boto3).
• Linux/Unix: Comfort with command-line operations and scripting.
• Git: Proficient in version control and team collaboration.
• Concurrency: Experience with multithreading and asynchronous programming in Python.
• API Integrations: Familiarity with integrating third-party APIs, including authentication, data handling, and rate limiting.
• Good to have: Exposure to GenAI/LLMs (OpenAI, HuggingFace, etc.), prompt engineering, or integrating GenAI-powered features into products

Other Infrastructure Requirements

Since this is a completely work-from-home position, you will also require the following -

● High-speed internet connectivity for video calls and efficient work.

● Capable business-grade computer (e.g., modern processor, 8 GB+ of RAM, and

no other obstacles to interrupted, efficient work).

● Headphones with clear audio quality.

● Stable power connection and backups in case of internet/power failure.