Tracxn - Senior Engineer - Web Crawling & Automation

Total Experience : 1 years

Mode of Hire : Permanent

Required Skills Set (Mandatory) : , Web Crawling (Puppeteer/Playwright), Strong knowledge of web technologies

Desired Skills (Good if you have) : HTML, Distributed Systems, Data pipelines, Proxy Management, Anti-bot Techniques

Job Responsibilities :

- Design scalable web crawling solutions using modern technologies like Puppeteer and Playwright.

- Develop optimal and cost-effective methods for efficiently crawling diverse websites at scale.

- Implement robust proxy management and sophisticated anti-bot techniques.

- Create comprehensive debugging and monitoring systems for crawler performance.

- Actively contribute to technical discussions and architectural decision-making processes.

Job Requirements :

- Experience in end-to-end management of large-scale distributed web crawling.

- Deep understanding of website internal mechanics, enabling innovative data extraction strategies.

- Expert-level proficiency in , web technologies, and anti-bot measures.

- Demonstrated ability to understand, adapt, and extend current system architectures.

- Strong collaborative skills with the ability to work effectively within existing technical frameworks.

Preferred Qualifications :

- Advanced system optimization skills.

- Proven experience with cloud platforms, databases, and distributed systems.

- Comprehensive knowledge of data pipelines and data warehousing concepts.

Culture :

- Work with performance-oriented teams driven by ownership and passion.

- Learn to design systems for high accuracy, efficiency, and scalability.

- No strict deadlines, focus on delivering quality work.

- Meritocracy-driven, candid culture. No politics.

- Very high visibility regarding which startups and markets are exciting globally.

About Tracxn :

Tracxn ) is a Bangalore-based product company providing a research and deal sourcing platform for Venture Capital, Private Equity, Corp Dev, and professionals working around the startup ecosystem.

We are a team of 600 working professionals serving customers across the globe. Our clients include Funds like Andreessen Horowitz, Matrix Partners, GGV Capital, and Large Corporations such as Citi, Embraer & Ferrero.

Founders :

- Neha Singh (ex-Sequoia, BCG | MBA - Stanford GSB)

- Abhishek Goyal (ex-Accel Partners, Amazon | BTech - IIT Kanpur)

About Technology Team :

Tracxn's Technology team is 50 members strong and growing. The technology team is subdivided into multiple smaller teams, each owning one or more services/components of the technology platform. Ours is a young team of motivated engineers with a minimal management structure where almost everyone is actively involved in technical development and design activities. We have a team-centric culture where the ownership and responsibility of a feature or module lie with a team compared to an individual.

We work on an array of technologies, including but not limited to ReactJS, , Storybook, Webpack, Node, Mongo, AWS Lambda, Spring, Elastic Stack, MySQL, Kafka, Redis, Ansible, etc. We value ownership, continuous learning, consistency, and discipline as a team.

Disclaimer :

Please be aware of fraudulent job postings and individuals impersonating Tracxn representatives. Tracxn conducts all hiring through official channels only - our careers page and verified job portals. We operate from a single official office location and do not request personal information or payments at any stage of the hiring process.

If you come across any suspicious communication claiming to be from Tracxn, we recommend reporting it to us immediately.