Software Development Engineer II

3 weeks ago

Tirupati, India ClearDemand Full time

Job Summary:Data is the foundation of our business, and your work will ensure that we continue to deliver high-quality competitive intelligence at scale. Web platforms are constantly evolving, deploying sophisticated anti-bot measures—your job is to stay ahead of them. If you thrive on solving complex technical challenges and enjoy working with real-world data at an immense scale, this role is for you.We seek a Software Development Engineer with expertise in cloud infrastructure, Big Data and web crawling technologies. This role bridges system reliability engineering with scalable data extraction solutions, ensuring our infrastructure remains robust and capable of handling high-volume data collection. You will design resilient systems, optimize automation pipelines, and tackle challenges posed by advanced bot-detection mechanisms.Key Responsibilities:Architect, deploy, and manage scalable cloud environments (AWS/GCP/DO) to support distributed data processing solutions to handle terabyte-scale datasets and billions of records efficientlyAutomate infrastructure provisioning, monitoring, and disaster recovery using tools like Terraform, Kubernetes, and Prometheus.Optimize CI/CD pipelines to ensure seamless deployment of web scraping workflows and infrastructure updates.Develop and maintain stealthy web scrapers using Puppeteer, Playwright, and headless chromium browsers.Reverse-engineer bot-detection mechanisms (e.g., TLS fingerprinting, CAPTCHA solving) and implement evasion strategies.Monitor system health, troubleshoot bottlenecks, and ensure 99.99% uptime for data collection and processing pipelines.Implement security best practices for cloud infrastructure, including intrusion detection, data encryption, and compliance audits.Partner with data collection, ML and SaaS teams to align infrastructure scalability with evolving data needsQualifications & Experience:4–6 years of experience in site reliability engineering and cloud infrastructure management Proficiency in Python, JavaScript for scripting and automation . Hands-on experience with Puppeteer/Playwright, headless browsers, and anti-bot evasion techniques . Knowledge of networking protocols, TLS fingerprinting, and CAPTCHA-solving frameworks . Experience with monitoring and observability tools such as Grafana, Prometheus, Elasticsearch, and familiarity with monitoring and optimizing resource utilization in distributed systems.Experience with data lake architectures and optimizing storage using formats such as Parquet, Avro, or ORC.Strong proficiency in cloud platforms (AWS, GCP, or Azure) and containerization/orchestration (Docker, Kubernetes).Deep understanding of infrastructure-as-code tools (Terraform, Ansible) . Deep experience in designing resilient data systems with a focus on fault tolerance, data replication, and disaster recovery strategies in distributed environments.Experience implementing observability frameworks, distributed tracing, and real-time monitoring tools.Excellent problem-solving abilities, with a collaborative mindset and strong communication skills.

  • Software engineer backend

    3 weeks ago

    Tirupati, India Solvei8 Full time

    Job Title: Software Engineer II Solvei8 (pronounced solve-it) is a one-stop integrated factory cloud solutions provider for the apparel and footwear industry, under the parent company Buyogo AG. With innovation, agility, and customer-centricity at the core, Solvei8 is focused on providing solutions that optimize factory processes, increase visibility, and...

  • Junior Automotive Engineer – Vehicle Diagnostics

    4 days ago

    Tirupati, India CaRPM Full time

    Role Summary:We are looking for a Junior Automotive Engineer to support automotive research and diagnostics development, focusing on OBD-II systems, CAN data analysis, and improving car scanner functionality.Key ResponsibilitiesTest OBD-II scanner functions (DTCs, live data PIDs, resets, special functions).Check function support across different car brands...

  • Javascript Developer

    3 days ago

    Tirupati, India Computer Software Solutions LLC Full time

    Company DescriptionComputer Software Solutions LLC (CSS LLC) is a small yet innovative IT software development company committed to creating solutions that make life easier. Headquartered in Highlands Ranch, Colorado, with an additional office in Kolkata, CSS LLC specializes in developing niche products to meet diverse societal needs. We focus on practical,...

  • Javascript Developer

    2 days ago

    Tirupati, India Computer Software Solutions LLC Full time

    Company DescriptionComputer Software Solutions LLC (CSS LLC) is a small yet innovative IT software development company committed to creating solutions that make life easier. Headquartered in Highlands Ranch, Colorado, with an additional office in Kolkata, CSS LLC specializes in developing niche products to meet diverse societal needs. We focus on practical,...

  • Webflow Developer

    3 weeks ago

    Tirupati, India Emergence Software Full time

    Job Description: We are Emergence Software, a global B2B SaaS acquisition and growth engine. We are looking for a Webflow Developer who can implement a premium, data-driven website that supports our mission and engages SaaS founders, referrers, and partners.Responsibilities: Webflow Development Build fully functional website using Webflow CMS, animations,...

  • Visionary Software Developer

    7 days ago

    Tirupati, India beBeeSoftwareEngineer Full time

    Software Engineering ProfessionalThe role involves taking a domain and technical requirement, collaborating with business, technology, and process teams to find solutions for delivery from an engineering perspective. The purpose is to develop software that improves efficiency and productivity of people and ensures adequate risk and compliance measurement.Key...

  • Ai software engineer

    1 week ago

    Tirupati, India Taskify AI Full time

    AI Software Engineer Summary We are seeking a talented AI Software Engineer to join our engineering team and drive the design, development, and deployment of AI-powered solutions. This role is ideal for professionals passionate about artificial intelligence, machine learning, and software engineering who want to make a tangible impact on real-world...

  • Senior Salesforce Developer

    3 weeks ago

    Tirupati, India Digitrix Software LLP Full time

    About the role: Looking for a full time Senior Salesforce Developer to join the Sales Service and Corporate Engineering team. As a Senior Salesforce Engineer, you will be designing and developing the customized solutions within the Salesforce Platform. You will be responsible for writing Apex Classes, Triggers, Flows and LWC components to deliver new...

  • Software Engineer

    2 weeks ago

    Tirupati, India Care.fi Full time

    Today, an Indian hospital revenue is largely dominated by Insurance payers - Govt + Private. With 200+ payers in the mix, the overall revenue cycle management (RCM) in India is broken, opaque, and complex filled with unexpected shortfalls and delayed realizations.At Care.fi, we are building India’s first AI-led RCM platform for hospitals which will enable...

  • Lead Software Engineer

    1 week ago

    Tirupati, India Whatjobs IN C2 Full time

    Who We Are: Established in April 2017, Cimpress India is a strategic capability center for Cimpress plc., a global leader in mass customization established in 1994. With over 2,000+ talented professionals, Cimpress India supports several Cimpress businesses, providing expertise in software engineering, graphic design, prepress services, marketing & analytics...