Data engineer

Experience Level: Data Engineer- 3- 7 years of relevant experience in data engineering.About Forage AI: Forage AI is a pioneering AI-powered data extraction and automation company that transforms complex, unstructured web and document data into clean, structured intelligence. Our platform combines web crawling, NLP, LLMs, and agentic AI to deliver highly accurate firmographic and enterprise insights across numerous domains. Trusted by global clients in finance, real estate, and healthcare, Forage AI enables businesses to automate workflows, reduce manual rework, and access high-quality data at scale. About the Role: We are seeking a talented and growth-minded Data Engineer who is passionate about building, scaling, and modernizing impactful business systems. In this full-time position, you’ll work on a mix of new feature development, system enhancements, and platform modernization initiatives—while ensuring the stability and reliability of our core products. You’ll have the chance to experiment with and implement Gen AI-driven approaches, innovations, and new strategies as we continue to evolve our solutions. We value engineers who express their best technical talent, contribute innovative ideas to overall product development, and propose creative automation solutions across our engineering efforts. This is an opportunity to propose and lead technical improvements, contribute to architectural evolution, and make your mark on products used by real customers. Structured onboarding and domain training will be provided to set you upfor success. Key Responsibilities: Design and develop new features and enhancements for our core platforms and services. Contribute to the modernization and refactoring of existing systems and codebases.Propose,experiment with, and implement Gen AI-based innovations, tools, or workflows to solve business problems and create new value.Drive technical improvements, suggest and lead platform upgrades, and champion engineering best practices.Investigate, debug, and resolve production issues, delivering robust solutions that improve performance and maintainability.Collaborate with product, engineering, and business teams to deliver impactful end-to end solutions.Help maintain the reliability, scalability, and security of our systems as we evolve our platform.Technical Skills & Requirements: Python: Strong hands-on experience with core Python and its standard libraries.Web Framework: Experience developing backend APIs and services using Fast API/Flask. Rabbit MQ: Proficiency in implementing message queues and task distribution.Docker & Docker Compose: Experience containerizing applications and managing services. Web Scraping: Demonstrated expertise with web scraping tools and techniques. Playwright & Selenium: Practical experience with browser automation frameworks. Postgre SQL &SQLAlchemy: Proficient in SQL and ORM-based data access. Mongo DB & Py Mongo: Experience with No SQL data using Py Mongo.Redis: Practical use for caching and lightweight messaging.AWS: Hands-on experience with services such as S3, Secrets Manager, and Auto Scaling Groups(using boto3).Linux/Unix: Comfort with command-line operations and scripting.Git: Proficient in version control and team collaboration.Concurrency: Experience with multithreading and asynchronous programming in Python.API Integrations: Familiarity with integrating third-party APIs, including authentication, data handling, and rate limiting.Good to have: Exposure to Gen AI/LLMs (Open AI, Hugging Face, etc.), prompt engineering, or integrating Gen AI-powered features into products.What We Offer:High ownership and autonomy in shaping technical solutions and system architecture.Opportunities to learn modern technologies and propose technical initiatives— including Gen AI-based approaches.Collaborative, supportive, and growth-oriented engineering culture.Exposure to a broad set of business and technical problems.Structured onboarding and domain training. Work-from-Home Infrastructure. Requirements:Business-grade computer (modern processor-i7, i9 , 16 GB+ RAM) with no performance obstacles.Reliable high-speed internet for video calls and remote work. Quality headphones & camera for clear audio and video. Stable power supply and backup options incase of outages.