Software Development Engineer II
3 weeks ago
Job Summary: Data is the foundation of our business, and your work will ensure that we continue to deliver high-quality competitive intelligence at scale. Web platforms are constantly evolving, deploying sophisticated anti-bot measures—your job is to stay ahead of them. If you thrive on solving complex technical challenges and enjoy working with real-world data at an immense scale, this role is for you. We seek a Software Development Engineer with expertise in cloud infrastructure, Big Data and web crawling technologies. This role bridges system reliability engineering with scalable data extraction solutions, ensuring our infrastructure remains robust and capable of handling high-volume data collection. You will design resilient systems, optimize automation pipelines, and tackle challenges posed by advanced bot-detection mechanisms. Key Responsibilities: - Architect, deploy, and manage scalable cloud environments (AWS/GCP/DO) to support distributed data processing solutions to handle terabyte-scale datasets and billions of records efficiently - Automate infrastructure provisioning, monitoring, and disaster recovery using tools like Terraform, Kubernetes, and Prometheus. - Optimize CI/CD pipelines to ensure seamless deployment of web scraping workflows and infrastructure updates. - Develop and maintain stealthy web scrapers using Puppeteer, Playwright, and headless chromium browsers. - Reverse-engineer bot-detection mechanisms (e.g., TLS fingerprinting, CAPTCHA solving) and implement evasion strategies. - Monitor system health, troubleshoot bottlenecks, and ensure 99.99% uptime for data collection and processing pipelines. - Implement security best practices for cloud infrastructure, including intrusion detection, data encryption, and compliance audits. - Partner with data collection, ML and SaaS teams to align infrastructure scalability with evolving data needs Qualifications & Experience: - 4–6 years of experience in site reliability engineering and cloud infrastructure management - Proficiency in Python, JavaScript for scripting and automation . - Hands-on experience with Puppeteer/Playwright, headless browsers, and anti-bot evasion techniques . - Knowledge of networking protocols, TLS fingerprinting, and CAPTCHA-solving frameworks . - Experience with monitoring and observability tools such as Grafana, Prometheus, Elasticsearch, and familiarity with monitoring and optimizing resource utilization in distributed systems. - Experience with data lake architectures and optimizing storage using formats such as Parquet, Avro, or ORC. - Strong proficiency in cloud platforms (AWS, GCP, or Azure) and containerization/orchestration (Docker, Kubernetes). - Deep understanding of infrastructure-as-code tools (Terraform, Ansible) . - Deep experience in designing resilient data systems with a focus on fault tolerance, data replication, and disaster recovery strategies in distributed environments. - Experience implementing observability frameworks, distributed tracing, and real-time monitoring tools. - Excellent problem-solving abilities, with a collaborative mindset and strong communication skills.
-
Software Engineer II
2 weeks ago
India Upland Software Full time ₹ 6,00,000 - ₹ 18,00,000 per yearSoftware Engineer II- NetSuite developerJob DescriptionOpportunity Summary:We are looking for a NetSuite Developer to join our dynamic Business Systems team. This person will build and maintain code and functionality in our NetSuite environment to support the operations of the Finance and Accounting business units.The NetSuite developer plays an important...
-
Software Engineer II
4 weeks ago
India Microsoft Full timeJob Description Microsoft Teams is core to Microsoft's vision for intelligent communications and productivity pane into the modern workplace. We are fast becoming the hub for teamwork in Office 365, with hundreds of thousands of organizations and tens of millions of users across the globe using Teams. Microsoft Teams is the fastest growing business...
-
Software Engineer II
1 week ago
india Akamai Full timeDescriptionDo you want to build the next generation of Linode cloud storage?Work with an amazing global team of innovatorsJoin the Linode Storage Engineering Team.Our team is responsible for developing and maintaining Akamai's cloud storage platform for Linode. Our enterprise grade solution is an essential element to Akamai's Connected Cloud platform. We...
-
Software Engineer II
3 weeks ago
India Nike Full timeJob Description Software Engineer II, ITC Who Are We Looking For We are looking for a Software Engineer II as part of our Enterprise Insights & Experience Engineering team at Nike. The ideal candidate will have strong programming skills with exposure to automation frameworks, API-driven development and familiarity with GenAI and Agentic frameworks. What You...
-
Software Engineer II, ITC
4 weeks ago
India Nike Full timeJob Description Who You'll Work With You'll be joining a dynamic, fast-paced Global FPE (Foundational Platforms Engineering) team within Nike. Our mission is to build and scale world-class cloud-native platforms, enabling Nike's data-driven decision-making and intelligent automation capabilities. This role sits right into AI-driven innovation helping to...
-
Software Engineer II
4 weeks ago
India Nike Full timeJob Description Software Engineer II, Cloud Platform Engineering Who Are We Looking For We are looking for a Software Engineer II as part of our Cloud Platform Engineering teamat Nike. The ideal candidate will be bringing deep technical expertise in Cloud Engineering to solve complex engineering problems to enable Nike's pursuit to deliver state of the art...
-
Software Development Engineer
1 week ago
Hyderabad, India Amazon Full timeJob Description Description We are looking for a Software Development Engineer II to build the experience and technology for Amazonians to get support on their important life events. In this role you will drive and execute the technology vision to create 1-click employee experience, where employees can manage their professional and personal life events, and...
-
Software Development Engineer in Test II
1 day ago
india Akamai Full timeDescriptionWould you like to impact the digital experiences of millions of users?Do you enjoy solving large scale distributed systems problems?Join our Cloud Data Services QA teamThe team evaluates platforms, products, and technologies within Cloud Data Services Engineering. Automation infrastructure supports testing processes. Collaboration with engineering...
-
Software Engineer II
4 weeks ago
India Microsoft Full timeJob Description Microsoft is a company where passionate innovators come to collaborate, envision what can be and take their careers to levels they cannot achieve anywhere else. This is a world of more possibilities, more innovation, and more openness in a cloud-enabled world.The Business & Industry Copilots group is a rapidly growing organization that is...
-
Software Engineer Ii-automation
5 days ago
India JPMorgan Chase Full timeJob Category Software Engineering You re ready to gain the skills and experience needed to grow within your role and advance your career - and we have the perfect software engineering opportunity for you As a Software Engineer II at JPMorgan Chase within the Commercial Investment Bank Payments Technology team you will be part of an agile team dedicated to...
