Software Development Engineer II

4 days ago

Bharatpur, India ClearDemand Full time

Job Summary: Data is the foundation of our business, and your work will ensure that we continue to deliver high-quality competitive intelligence at scale. Web platforms are constantly evolving, deploying sophisticated anti-bot measures—your job is to stay ahead of them. If you thrive on solving complex technical challenges and enjoy working with real-world data at an immense scale, this role is for you. We seek a Software Development Engineer with expertise in cloud infrastructure, Big Data and web crawling technologies. This role bridges system reliability engineering with scalable data extraction solutions, ensuring our infrastructure remains robust and capable of handling high-volume data collection. You will design resilient systems, optimize automation pipelines, and tackle challenges posed by advanced bot-detection mechanisms. Key Responsibilities: Architect, deploy, and manage scalable cloud environments (AWS/GCP/DO) to support distributed data processing solutions to handle terabyte-scale datasets and billions of records efficiently Automate infrastructure provisioning, monitoring, and disaster recovery using tools like Terraform, Kubernetes, and Prometheus. Optimize CI/CD pipelines to ensure seamless deployment of web scraping workflows and infrastructure updates. Develop and maintain stealthy web scrapers using Puppeteer, Playwright, and headless chromium browsers. Reverse-engineer bot-detection mechanisms (e.g., TLS fingerprinting, CAPTCHA solving) and implement evasion strategies. Monitor system health, troubleshoot bottlenecks, and ensure 99.99% uptime for data collection and processing pipelines. Implement security best practices for cloud infrastructure, including intrusion detection, data encryption, and compliance audits. Partner with data collection, ML and SaaS teams to align infrastructure scalability with evolving data needs Qualifications & Experience: 4–6 years of experience in site reliability engineering and cloud infrastructure management Proficiency in Python, JavaScript for scripting and automation . Hands-on experience with Puppeteer/Playwright, headless browsers, and anti-bot evasion techniques . Knowledge of networking protocols, TLS fingerprinting, and CAPTCHA-solving frameworks . Experience with monitoring and observability tools such as Grafana, Prometheus, Elasticsearch, and familiarity with monitoring and optimizing resource utilization in distributed systems. Experience with data lake architectures and optimizing storage using formats such as Parquet, Avro, or ORC. Strong proficiency in cloud platforms (AWS, GCP, or Azure) and containerization/orchestration (Docker, Kubernetes). Deep understanding of infrastructure-as-code tools (Terraform, Ansible) . Deep experience in designing resilient data systems with a focus on fault tolerance, data replication, and disaster recovery strategies in distributed environments. Experience implementing observability frameworks, distributed tracing, and real-time monitoring tools. Excellent problem-solving abilities, with a collaborative mindset and strong communication skills.

  • Caesar II Instructor

    2 weeks ago

    Bharatpur, India Augmintech Education Pvt. Ltd. Full time

    We’re Hiring: Caesar II Instructor (Remote | Part-Time)Are you an expert in Pipe Stress Analysis with a passion for teaching and mentoring aspiring engineers?Join Augmintech Education Pvt. Ltd., a leader in Building Services and Plant Design education, and an Autodesk Authorized Learning Partner, to empower the next generation of mechanical design...

  • Caesar II Instructor

    2 weeks ago

    Bharatpur, India Augmintech Education Pvt. Ltd. Full time

    We’re Hiring: Caesar II Instructor (Remote | Part-Time)Are you an expert in Pipe Stress Analysis with a passion for teaching and mentoring aspiring engineers?Join Augmintech Education Pvt. Ltd., a leader in Building Services and Plant Design education, and an Autodesk Authorized Learning Partner, to empower the next generation of mechanical design...

  • Data Engineer Ii

    3 days ago

    Bharatpur, India Whatjobs IN C2 Full time

    Job Summary: Building on the foundation of the SDE-I role, the DE- II position takes on a greater level of responsibility and leadership. You'll play a crucial role in driving the evolution and efficiency of our data collection and analytics platform, capable of handling terabyte-scale data and billions of data points. Key Responsibilities Lead the design,...

  • Software Engineer

    3 weeks ago

    Bharatpur, India Tekki Full time

    Job Title: Software Engineer Company: Tekki Location: Remote (India) Employment Type: Full-time About Tekki: Tekki delivers robust IT infrastructure and managed services tailored for data center, cloud, and end-user environments — serving mid-market and enterprise organizations globally. We believe in innovation, automation, and high-performance...

  • Fullstack Engineer

    4 days ago

    Bharatpur, India Sonata Software Full time

    GreetingsWe are hiring Fullstack Dotnet Developers. Please find below the JD and send your profile to ramesh@sonata-software.com/Gladwyn.Samuel@sonata-software.com.Sonata Software Overview:In today's market, there is a unique duality in technology adoption. On one side, extreme focus on cost containment by clients, and on the other, deep motivation to...

  • Senior Software Developer

    4 weeks ago

    Bharatpur, India dSPACE Full time

    Identifier: INST-SSD-XT Location: Trivandrum For our office in Trivandrum, dSPACE is looking for creative and motivated professionals. You will work on exciting and technologically cutting-edge product development projects, in the areas of control prototyping and Hardware-In-the-Loop (HIL) simulation. We are offering a position as a Senior Software Developer...

  • founding software engineer

    2 weeks ago

    Bharatpur, India Festiva Capital Full time

    Founding Software Engineer (AI-Accelerated Integrations)About Festiva Capital.Guided by a global perspective and entrepreneurial spirit, we aspire to invest in forward-looking businesses that shape the future of industries and communities. At Festiva Capital, we believe in unlocking new horizons - partnering with companies that transform the ordinary into...

  • internal listing-equipment operator ii

    3 days ago

    Bharatpur, Rajasthan, India City of Tulsa Full time ₹ 2,00,000 - ₹ 4,00,000 per year

    QualificationsGraduation from high school or possession of a General Educational Development Certificate (GED), and four (4) years of experience in the operation of larger trucks and heavy equipment; or an equivalent combination of training and experience per Personnel Policies and Procedures, Section 128. Two (2) years of experience can be substituted by...

  • Senior Python Software Engineer

    4 days ago

    Bharatpur, India Innefu Labs Full time

    Company Description (www.innefu.com) We are a Series A Funded New Age Information Security & Data Analytics Company and we take pride in the fact that we have been delivering value to our customers with our innovative offerings and helping them adopt a variety of our security solutions that are based on cutting edge technologies like Artificial Intelligence,...

  • Software Engineer

    4 weeks ago

    Bharatpur, India Spiral Kite Labs Full time

    About the role:We’re seeking a talented Software Engineer (1 to 3 years of experience) to join our team, where you’ll work with an early stage fintech AI startup building innovative products at the intersection of finance and artificial intelligence.This is a hands-on engineering role focused on backend architecture and data-driven systems, with...