Software Engineer

1 month ago

india ELife Full time

Our Company:

A fast-growing start-up headquartered in San Francisco, CA, USA in the heart of Silicon Valley. We recruit worldwide as our customer base is global. Reliable ground transportation provider, any type of vehicle globally.


Vision: Reliable ground transportation services globally with all types of vehicles.​


Mission: Empower high quality local fleets​


Coorporate Culture: team first

  • Partner-centric​
  • Team collaboration,​
  • Never "not my job", end-to-end ownership,​
  • Continuous learning and improvement,​
  • Hard-working and pragmatic,​
  • Don’t be a middleman,​
  • Result-driven​



Job title: Crawler Engineer


A Crawler Engineer is primarily responsible for designing and developing web crawler systems to scrape, clean, and analyze data from various platforms. This position requires a deep understanding of how web crawlers work, familiarity with common anti-crawling techniques and countermeasures, and the ability to handle large-scale data processing.


**Primary Responsibilities**

  • Design and develop efficient web crawler systems to meet business data scraping requirements.
  • Conduct scraping strategy analysis on target websites and formulate optimal scraping plans.
  • Maintain and optimize existing crawler systems to improve data scraping speed and accuracy.
  • Clean and process scraped data to ensure data quality and availability.
  • Keep track of and research the latest crawler technologies and anti-crawling mechanisms to continuously enhance the performance of crawler systems.


**Requirements**

  • 5 years experience in similar positions
  • Bachelor's degree or above in Computer Science or a related field, with a solid foundation in computer science.
  • Proficient in Python programming, familiar with commonly used crawler frameworks (such as Scrapy, PySpider, etc.) and information extraction techniques (such as regular expressions).
  • Familiar with HTTP/HTTPS protocols, Cookie mechanisms, and web scraping principles.
  • Proficient in JavaScript, XPath.
  • Proficient in databases such as MySQL and BigQuery.
  • Have knowledge of common anti-crawling techniques and countermeasures, able to tackle various anti-crawling challenges.
  • Experience in designing and developing distributed systems, familiar with multithreading, asynchronous programming, and other technologies.
  • Have good problem-solving skills and a strong teamwork spirit, able to work under pressure.
  • Preference will be given to candidates with experience in scraping data from large platforms and handling massive datasets.

  • Software Engineer

    2 weeks ago

    India PRT Software Solutions Full time

    Job Overview:We are looking for a motivated Software Engineer to join our team. You will work on designing, developing, and maintaining software applications, ensuring high-quality code and collaborating with cross-functional teams to deliver solutions.Responsibilities:Design, develop, and test software applications.Write clean, efficient, and maintainable...

  • Software Engineer

    2 weeks ago

    India PRT Software Solutions Full time

    Job Overview : We are looking for a motivated Software Engineer to join our team. You will work on designing, developing, and maintaining software applications, ensuring high-quality code and collaborating with cross-functional teams to deliver solutions. Responsibilities : Design, develop, and test software applications. Write clean,...

  • Sr. Software Engineer

    2 months ago

    india BQE Software Full time

    Job Overview:We are looking for a highly skilled and experienced Senior .NET Developer to join our team. The ideal candidate should have at least 5 years of hands-on experience in software development using .NET technologies, strong expertise in C#, and solid knowledge of SQL Server. You will play a key role in designing, developing, and maintaining...

  • Sr. Software Engineer

    2 months ago

    india BQE Software Full time

    Job Overview: We are looking for a highly skilled and experienced Senior .NET Developer to join our team. The ideal candidate should have at least 5 years of hands-on experience in software development using .NET technologies , strong expertise in C# , and solid knowledge of SQL Server . You will play a key role in designing, developing, and maintaining...

  • PRT Software Solutions | Software Engineer | india

    3 weeks ago

    india PRT Software Solutions Full time

    Job Overview : We are looking for a motivated Software Engineer to join our team. You will work on designing, developing, and maintaining software applications, ensuring high-quality code and collaborating with cross-functional teams to deliver solutions. Responsibilities : Design, develop, and test software applications. Write clean, efficient, and...

  • Java Software Engineer

    1 week ago

    India PRT Software Solutions Full time

    We are looking for a skilled Java Engineer to join our development team. The ideal candidate will have experience in designing, developing, and maintaining Java applications. You will work on building scalable and efficient software solutions, collaborating with cross-functional teams, and ensuring high-quality code.Responsibilities:Develop and maintain...

  • Java Software Engineer

    1 week ago

    India PRT Software Solutions Full time

    We are looking for a skilled Java Engineer to join our development team. The ideal candidate will have experience in designing, developing, and maintaining Java applications. You will work on building scalable and efficient software solutions, collaborating with cross-functional teams, and ensuring high-quality code. Responsibilities: Develop and...

  • Senior Software Architect

    4 days ago

    India Aspect Software Full time

    About the RoleAt Aspect Software, we are seeking a highly skilled and experienced Senior Software Architect to join our team. As a key member of our engineering team, you will be responsible for designing, developing, and maintaining complex software systems.Key ResponsibilitiesDesign and develop software components using industry-leading technologies such...

  • Software Development Expert

    4 weeks ago

    India Rocket Software Full time

    Rocket Software Career OpportunityJob Title: Software Engineer II (Java Full Stack)We are looking for experienced Software Engineers to join our team at Rocket Software. As a Software Engineer II, you will be responsible for designing, developing, and troubleshooting software programs for software enhancements and new products.Key Responsibilities:Develop...

  • PRT Software Solutions | Java Software Engineer | india

    1 week ago

    india PRT Software Solutions Full time

    We are looking for a skilled Java Engineer to join our development team. The ideal candidate will have experience in designing, developing, and maintaining Java applications. You will work on building scalable and efficient software solutions, collaborating with cross-functional teams, and ensuring high-quality code.Responsibilities:Develop and maintain...

  • Vice President of Software Engineering

    3 months ago

    India Belzabar Software Design India Private Limited Full time

    VP Technology / Engineering Role Overview: Position: Vice President of Technology/Engineering Reporting to: Senior Vice President of Technology Primary Responsibility: Oversee the architecture, design, and development of scalable technology solutions, while mentoring and managing a team of technical leads, full-stack engineers, and architects. Key...

  • Principal Engineer

    2 months ago

    india Aspect Software Full time

    PRIMARY ROLE & RESPONSIBILITIES Analyzes, designs, programs, debugs, and does ongoing modification of software components. Code may be used in commercial end-user applications, prototypes, or in test tools or other supporting programs. Using the required programming languages and other technologies, writes code, completes programming, and performs testing...

  • Industrial IOT Software Consultants | Test Automation Engineer | india

    3 days ago

    india Industrial IOT Software Consultants Full time

    Company DescriptionIndustrial IOT Software Consultants specializes in transforming industrial processes through cutting-edge IoT solutions. They empower industries with intelligent connectivity to drive efficiency, productivity, and innovation. With tailored software solutions that seamlessly integrate with existing systems, the company ensures minimal...

  • Senior Software Quality Assurance Specialist

    1 month ago

    India Aspect Software Full time

    About this RoleWe are seeking a highly skilled Senior Quality Assurance Engineer to join our team at Aspect Software.Key ResponsibilitiesWork closely with Developers in the Scrum Team to design and execute test approaches that support software application development.Participate in sprint standups, retrospectives, and planning meetings as a productive team...

  • Principal Engineer

    2 months ago

    India Aspect Software Full time

    PRIMARY ROLE & RESPONSIBILITIES Analyzes, designs, programs, debugs, and does ongoing modification of software components. Code may be used in commercial end-user applications, prototypes, or in test tools or other supporting programs. Using the required programming languages and other technologies, writes code, completes programming, and performs testing...

  • Principal Engineer

    2 months ago

    India Aspect Software Full time

    PRIMARY ROLE & RESPONSIBILITIES Analyzes, designs, programs, debugs, and does ongoing modification of software components. Code may be used in commercial end-user applications, prototypes, or in test tools or other supporting programs. Using the required programming languages and other technologies, writes code, completes programming, and performs...

  • Algorithms Software Pvt Ltd | Engineering Lead Dot Net | india

    1 week ago

    india Algorithms Software Pvt Ltd Full time

    Job Description: Engineering Lead (Dot Net)Location: Mumbai ( CST ) Work from OfficeExperience - 10 Plus YearsExpertise in .NET Core, ASP.NET MVC, Web API, Entity Framework, and other relevant .NET technologies.Job Overview:We are looking for an experienced Engineering Lead with expertise in the .NET framework to guide a team of developers, deliver...

  • Algorithms Software Pvt Ltd | Engineering Lead Dot Net | india

    7 days ago

    india Algorithms Software Pvt Ltd Full time

    Job Description: Engineering Lead (Dot Net) Location : Mumbai ( CST ) Work from Office Experience - 10 Plus Years Expertise in .NET Core, ASP.NET MVC, Web API, Entity Framework, and other relevant .NET technologies. Job Overview: We are looking for an experienced Engineering Lead with expertise in the .NET framework to guide a team of developers,...

  • Industrial IOT Software Consultants | DevOps Engineer

    3 weeks ago

    india Industrial IOT Software Consultants Full time

    Company Description Industrial IOT Software Consultants specializes in transforming industrial processes through cutting-edge IoT solutions. They empower industries with intelligent connectivity, driving efficiency, productivity, and innovation. The team brings extensive experience in industrial automation, software development, and IoT technologies to...

  • Industrial IOT Software Consultants | DevOps Engineer

    3 weeks ago

    india Industrial IOT Software Consultants Full time

    Company Description Industrial IOT Software Consultants specializes in transforming industrial processes through cutting-edge IoT solutions. They empower industries with intelligent connectivity, driving efficiency, productivity, and innovation. The team brings extensive experience in industrial automation, software development, and IoT technologies to...