Software Engineer
2 months ago
Our Company:
A fast-growing start-up headquartered in San Francisco, CA, USA in the heart of Silicon Valley. We recruit worldwide as our customer base is global. Reliable ground transportation provider, any type of vehicle globally.
Vision: Reliable ground transportation services globally with all types of vehicles.
Mission: Empower high quality local fleets
Coorporate Culture: team first
- Partner-centric
- Team collaboration,
- Never "not my job", end-to-end ownership,
- Continuous learning and improvement,
- Hard-working and pragmatic,
- Don’t be a middleman,
- Result-driven
Job title: Crawler Engineer
A Crawler Engineer is primarily responsible for designing and developing web crawler systems to scrape, clean, and analyze data from various platforms. This position requires a deep understanding of how web crawlers work, familiarity with common anti-crawling techniques and countermeasures, and the ability to handle large-scale data processing.
**Primary Responsibilities**
- Design and develop efficient web crawler systems to meet business data scraping requirements.
- Conduct scraping strategy analysis on target websites and formulate optimal scraping plans.
- Maintain and optimize existing crawler systems to improve data scraping speed and accuracy.
- Clean and process scraped data to ensure data quality and availability.
- Keep track of and research the latest crawler technologies and anti-crawling mechanisms to continuously enhance the performance of crawler systems.
**Requirements**
- 5 years experience in similar positions
- Bachelor's degree or above in Computer Science or a related field, with a solid foundation in computer science.
- Proficient in Python programming, familiar with commonly used crawler frameworks (such as Scrapy, PySpider, etc.) and information extraction techniques (such as regular expressions).
- Familiar with HTTP/HTTPS protocols, Cookie mechanisms, and web scraping principles.
- Proficient in JavaScript, XPath.
- Proficient in databases such as MySQL and BigQuery.
- Have knowledge of common anti-crawling techniques and countermeasures, able to tackle various anti-crawling challenges.
- Experience in designing and developing distributed systems, familiar with multithreading, asynchronous programming, and other technologies.
- Have good problem-solving skills and a strong teamwork spirit, able to work under pressure.
- Preference will be given to candidates with experience in scraping data from large platforms and handling massive datasets.
-
Software Engineer
1 month ago
Tirupati, India topjobs.india Full timePosition: Remote Software Engineer (m/f/d)Location: Work from Anywhere in IndiaCompensation: ₹3,000–₹4,000 per hour (based on experience)About Us:We are a leading global technology company dedicated to building innovative solutions for real-world challenges. As part of our team, you will have the flexibility to work remotely while earning one of the...
-
Software Engineer Intern
4 months ago
Tirupati, India Enigma Genomics Full timeCompany DescriptionENIGMA GENOMICS is a global leader in next-generation sequencing solutions. As one of the first genetic laboratories in the Middle East and worldwide to use advanced artificial intelligence tools, we decode the human genome and provide personalized genetic insights. Our sequencing platform leverages cutting-edge technologies and analysis...
-
Senior Software Engineer
3 weeks ago
Tirupati, Andhra Pradesh, India DeepConverse Full timeRole OverviewAt DeepConverse, we are seeking a highly skilled Senior Software Engineer to lead our development team in creating innovative software solutions. This is a key leadership position that requires strong technical expertise, excellent communication skills, and the ability to motivate a team.ResponsibilitiesTechnical LeadershipSoftware...
-
Software Functional Safety Engineer
3 weeks ago
Tirupati, India Satyam Venture Engineering Services Full timeThis role is 100% remoteAs a Software Functional Safety Engineer working in the Electric Power Conversion group, you will be responsible for performing functional safety base and application software safety development for power electronics components and Drive Unit systems.Core responsibilities for this role are:Perform software safety analysis of the...
-
Senior Software Engineer
1 week ago
Tirupati, Andhra Pradesh, India Qrestik Technologies Full timeJob Title: Senior Software Engineer - Microsoft TechnologiesOverview of the Role:We are seeking a highly skilled Senior Software Engineer to join our team at Qrestik Technologies. As a key member of our development team, you will be responsible for designing, developing, and maintaining software solutions based on Microsoft technologies.About the Job:This is...
-
Software Engineer Teamcenter Development
1 week ago
Tirupati, Andhra Pradesh, India Phoenix Contact Full timeAbout this role:">">We are seeking a highly skilled Software Engineer to join our Phoenix Contact team in Faridabad.">">Job Summary:">The successful candidate will be responsible for the development and configuration of Siemens Teamcenter, with a focus on creating custom solutions and integrating it with other systems.">Responsibilities:">
-
Software Engineer
3 weeks ago
Tirupati, India RRD GO Creative Full timeJob DescriptionAbout us: RRD GO CreativeTM, with more than three decades of expertise in business communications,marketing solutions, and digital productivity solutions, we successfully help reimagine customer experiences forcompanies. Our three pillars of Global Brand Solutions, Smart Work Solutions, and Technology & InnovationServices transform the way...
-
Software Engineering Infrastructure Director
1 week ago
Tirupati, Andhra Pradesh, India LinkedIn Full timeJob DescriptionThis is a Senior Software Engineering Manager role at LinkedIn, the world's largest professional network.About Us:We're a global company with a mission to create economic opportunity for every member of the global workforce. Our products help people make powerful connections, discover exciting opportunities, build necessary skills, and gain...
-
Senior Software Development Engineer
2 weeks ago
Tirupati, Andhra Pradesh, India Gruve Full timeAbout the Role:">Gruve is an innovative software services startup dedicated to empowering enterprise customers in managing their data life cycle. We specialize in cyber security, customer experience, infrastructure, and advanced technologies such as machine learning and artificial intelligence.">Our Mission:">We assist our customers in their business...
-
Senior Software Engineer
4 weeks ago
Tirupati, India TransPerfect Solutions India Pvt. Ltd. Full timeDESCRIPTIONPosition responsibilities:Work as part of global engineering team, reporting directly to the manager based in California.Design, develop and test cloud based eDiscovery management product named ReefReviewBe able to understand the requirements given as product backlog, split the tasks to add into sprint backlog with approximately accurate...
-
tirupati, India Metalsmining Business Outlook Full timeCompany Description Stay ahead in the metals and mining industry with expert insights and strategic analysis. Explore trends shaping the future of the sector. Role Description This is a full-time remote role for a Junior Software Engineer at Metalsmining Business Outlook. The role involves tasks related to computer science, back-end web development, software...
-
Senior Front End and Back End Software Engineer
1 month ago
Tirupati, Andhra Pradesh, India Jio Full timeJob Description:Jio is seeking a skilled Senior Front End and Back End Software Engineer to join our team. We are looking for a candidate with strong proficiency in both front-end and back-end technologies, particularly React and Spring Boot.Key Responsibilities:Design, develop, and maintain web applications using React for the front end and Spring Boot for...
-
Senior Software Engineer
1 week ago
Tirupati, Andhra Pradesh, India Phoenix Contact Full timeWe are seeking a highly skilled Senior Software Engineer to join our Phoenix Contact team in Faridabad. The successful candidate will be responsible for developing and maintaining our Teamcenter solutions, ensuring seamless integration with PIM-, Web-, ERP- and other systems.Job SummaryThe ideal candidate will have at least 2-4 years of experience in...
-
Senior Software Engineer
4 weeks ago
Tirupati, India Info Services Full timeTitle: Senior Software Engineer - Typescript and React JSLocation: Hyderabad Office - Hybrid RoleType: FulltimeShift Timings: 1:00pm - 10:00pm ISTRequirement:Strong TypeScript experience (not JavaScript)Minimum 6 Years Of Experience.React Native experienceAWS Cognito experience (should know how OIDC works)Expo experienceStrong communication skillsExperience...
-
Power Sector Analytics Expert
6 days ago
Tirupati, Andhra Pradesh, India Srinivasan Software Solutions Pvt Ltd Full timeMachine Learning Expert for Power SectorSalary: ₹1,500,000 - ₹3,000,000 per annum. We're seeking an experienced Machine Learning Engineer with 3+ years of experience in the Power Sector to join our dynamic team.As a Machine Learning Engineer at Srinivasan Software Solutions Pvt Ltd, you will design and develop innovative machine learning models to solve...
-
Regular C++ Software Developer
1 week ago
Tirupati, India Luxoft Full timeProject descriptionThe Luxoft team is responsible for the integration of system function modules/system functions into the family of autonomous driving ECUs.We have been supporting the client since 2018 in ensuring that the Software Components, System Functions, adaptive AUTOSAR, and other components work together smoothly.Existing Software Components that...
-
Senior DevOps Engineer Hyderabad
1 week ago
Tirupati, Andhra Pradesh, India NCR Voyix Full timeJob Title: Senior DevOps Engineer HyderabadCompany OverviewNCR Voyix is a leading company in the technology industry, seeking a highly skilled and experienced DevOps Engineer to join our team. As a DevOps Engineer, you will play a crucial role in ensuring the smooth operation of our software systems, from development to deployment.SalaryThe estimated salary...
-
Turnaround Engineer
1 week ago
Tirupati, India Sofomation Full timeOPENING FOR A WELL KNOWN OIL AND GAS COMPANY In MIDDLE EAST:Position: Turnaround EngineerExperience: Minimum of 15 years of related experience in Oil&Gas Industry.Minimum Requirement:Bachelor’s degree in Engineering from a recognized and approved program. A Mechanical Engineering Degree is preferred.15 years-experience in Turnaround Management including...
-
Tirupati, Andhra Pradesh, India Evernorth Health Services Full timeAbout Evernorth Health ServicesWe create innovative solutions to improve health and increase vitality.Position OverviewThe Evernorth Core Platform Engineering team is seeking a Senior Data Engineer to design, develop, and implement robust data pipelines for Packaged Business Capabilities (PBCs).This role acts as a bridge between software development and the...
-
Senior Java Developer
3 weeks ago
Tirupati, Andhra Pradesh, India MakeMyTrip Full timeAbout the Role:We are seeking a highly skilled Senior Java Developer to join our team at MakeMyTrip. As a key member of our software development team, you will be responsible for designing, developing, and delivering high-quality software solutions.Key Responsibilities:To participate in the full software development life cycle, ensuring timely delivery of...