Software Development Engineer II
3 weeks ago
Job Summary:Data is the foundation of our business, and your work will ensure that we continue to deliver high-quality competitive intelligence at scale. Web platforms are constantly evolving, deploying sophisticated anti-bot measures—your job is to stay ahead of them. If you thrive on solving complex technical challenges and enjoy working with real-world data at an immense scale, this role is for you.We seek a Software Development Engineer with expertise in cloud infrastructure, Big Data and web crawling technologies. This role bridges system reliability engineering with scalable data extraction solutions, ensuring our infrastructure remains robust and capable of handling high-volume data collection. You will design resilient systems, optimize automation pipelines, and tackle challenges posed by advanced bot-detection mechanisms.Key Responsibilities:Architect, deploy, and manage scalable cloud environments (AWS/GCP/DO) to support distributed data processing solutions to handle terabyte-scale datasets and billions of records efficientlyAutomate infrastructure provisioning, monitoring, and disaster recovery using tools like Terraform, Kubernetes, and Prometheus.Optimize CI/CD pipelines to ensure seamless deployment of web scraping workflows and infrastructure updates.Develop and maintain stealthy web scrapers using Puppeteer, Playwright, and headless chromium browsers.Reverse-engineer bot-detection mechanisms (e.g., TLS fingerprinting, CAPTCHA solving) and implement evasion strategies.Monitor system health, troubleshoot bottlenecks, and ensure 99.99% uptime for data collection and processing pipelines.Implement security best practices for cloud infrastructure, including intrusion detection, data encryption, and compliance audits.Partner with data collection, ML and SaaS teams to align infrastructure scalability with evolving data needsQualifications & Experience:4–6 years of experience in site reliability engineering and cloud infrastructure management Proficiency in Python, JavaScript for scripting and automation . Hands-on experience with Puppeteer/Playwright, headless browsers, and anti-bot evasion techniques . Knowledge of networking protocols, TLS fingerprinting, and CAPTCHA-solving frameworks . Experience with monitoring and observability tools such as Grafana, Prometheus, Elasticsearch, and familiarity with monitoring and optimizing resource utilization in distributed systems.Experience with data lake architectures and optimizing storage using formats such as Parquet, Avro, or ORC.Strong proficiency in cloud platforms (AWS, GCP, or Azure) and containerization/orchestration (Docker, Kubernetes).Deep understanding of infrastructure-as-code tools (Terraform, Ansible) . Deep experience in designing resilient data systems with a focus on fault tolerance, data replication, and disaster recovery strategies in distributed environments.Experience implementing observability frameworks, distributed tracing, and real-time monitoring tools.Excellent problem-solving abilities, with a collaborative mindset and strong communication skills.
-
Software Engineer
3 weeks ago
Tiruchirappalli, India Catering Rewards Full timeJoin our mission to revolutionize the North American restaurant industry. Catering Rewards empowers restaurants to grow their catering business (“Food For Work”) through innovative reward systems, bypassing traditional commission-heavy platforms. We’re building a Gen AI-powered marketplace application that leverages advanced machine learning to...
-
Senior/Lead Software Engineer
3 weeks ago
Tiruchirappalli, India DDN Full timeDDN Storage is seeking great candidates to join our dynamic team of passionate customer-enabling technologists!This is an incredible opportunity to be part of a company that has been at the forefront of AI and high-performance data storage innovation for over two decades. DDN Storage is a global market leader renowned for powering many of the world's most...
-
Software Engineer Intern
2 weeks ago
Tiruchirappalli, India GetWebsite.dev Full timeCompany Description | GetWebsite.devJoin a dynamic, remote-first startup headquartered in San Francisco, building ambitious products at the intersection of the JavaScript and TypeScript ecosystem. We move quickly, value creativity, and empower engineers to directly shape core features and delivery.Role DescriptionThis is a internship, remote Software...
-
Highly Skilled Software Developer Wanted
1 week ago
tiruchirappalli, India beBeeBackend Full timeSoftware Engineering OpportunityWe are seeking a skilled Senior Backend Software Engineer to join our team and contribute to the development of highly efficient & scalable software as a service (SaaS) platforms.The successful candidate will be responsible for architecting and developing secured backend systems, designing, developing, and maintaining backend...
-
Welding Engineer
1 week ago
Tiruchirappalli, India SANMAR ENGINEERING TECHNOLOGIES LIMITED Full timeDear Candidate,Greetings from Sanmar Group!We have an opporutnity for Welding Engineer for our plant located in Viralimalai, Trichy.Looking for candidates with 8 -12 years of expereince in welding from valve background.Shall be an Engineer (B.E /B.Tech) having working knowledge in welding techniques like GTAW, GMAW, SMAW, etc.,Must having welding...
-
Welding Engineer
1 week ago
Tiruchirappalli, India SANMAR ENGINEERING TECHNOLOGIES LIMITED Full timeDear Candidate,Greetings from Sanmar Group!We have an opporutnity for Welding Engineer for our plant located in Viralimalai, Trichy.Looking for candidates with 8 -12 years of expereince in welding from valve background.Shall be an Engineer (B.E /B.Tech) having working knowledge in welding techniques like GTAW, GMAW, SMAW, etc.,Must having welding...
-
Welding Engineer
1 week ago
Tiruchirappalli, India SANMAR ENGINEERING TECHNOLOGIES LIMITED Full timeDear Candidate,Greetings from Sanmar Group!We have an opporutnity for Welding Engineer for our plant located in Viralimalai, Trichy.Looking for candidates with 8 -12 years of expereince in welding from valve background.Shall be an Engineer (B.E /B.Tech) having working knowledge in welding techniques like GTAW, GMAW, SMAW, etc.,Must having welding...
-
Welding Engineer
1 week ago
Tiruchirappalli, India SANMAR ENGINEERING TECHNOLOGIES LIMITED Full timeDear Candidate, Greetings from Sanmar Group! We have an opporutnity for Welding Engineer for our plant located in Viralimalai, Trichy . Looking for candidates with 8 -12 years of expereince in welding from valve background. Shall be an Engineer (B.E /B.Tech) having working knowledge in welding techniques like GTAW, GMAW, SMAW, etc., Must having welding...
-
Welding Engineer
1 week ago
Tiruchirappalli, India SANMAR ENGINEERING TECHNOLOGIES LIMITED Full timeDear Candidate, Greetings from Sanmar Group! We have an opporutnity for Welding Engineer for our plant located in Viralimalai, Trichy. Looking for candidates with 8 -12 years of expereince in welding from valve background. - Shall be an Engineer (B.E /B.Tech) having working knowledge in welding techniques like GTAW, GMAW, SMAW, etc., - Must having welding...
-
Welding Engineer
1 week ago
Tiruchirappalli, India SANMAR ENGINEERING TECHNOLOGIES LIMITED Full timeDear Candidate, Greetings from Sanmar Group! We have an opporutnity for Welding Engineer for our plant located in Viralimalai, Trichy . Looking for candidates with 8 -12 years of expereince in welding from valve background. Shall be an Engineer (B.E /B.Tech) having working knowledge in welding techniques like GTAW, GMAW, SMAW, etc., Must having welding...
