Senior Web Data Specialist
5 days ago
We're seeking a highly motivated and entrepreneurial Data Engineer to join our team.
This is an excellent opportunity for someone who is eager to own the entire tech stack, thrives on early-stage challenges, and loves building innovative, scalable solutions from day zero.
- Web Scraping & Crawling: Develop automated scrapers to extract structured and unstructured data from websites, APIs, and public datasets.
- Scalable Scraping Systems: Design multi-threaded, distributed crawlers capable of handling high-volume data collection without interruptions.
- Data Parsing & Cleaning: Normalize scraped data, remove noise, and ensure consistency before passing to data pipelines.
- Anti-bot & Evasion Tactics: Implement proxy rotation, captcha solving, and request throttling techniques to handle scraping restrictions.
- Integration with Pipelines: Deliver clean, structured datasets into NoSQL stores and ETL pipelines for further enrichment and graph-based storage.
- Data Quality & Validation: Ensure data accuracy, deduplicate records, and maintain a trust scoring system for data confidence.
- Documentation & Maintenance: Keep scrapers updated when websites change, and document scraping logic for reproducibility.
- Data Quality & Validation: Ensure data accuracy, deduplicate records, and maintain a trust scoring system for data confidence.
- Integration with Pipelines: Deliver clean, structured datasets into NoSQL stores and ETL pipelines for further enrichment and graph-based storage.
- Anti-bot & Evasion Tactics: Implement proxy rotation, captcha solving, and request throttling techniques to handle scraping restrictions.
- Data Parsing & Cleaning: Normalize scraped data, remove noise, and ensure consistency before passing to data pipelines.
- Scalable Scraping Systems: Design multi-threaded, distributed crawlers capable of handling high-volume data collection without interruptions.
Technical Skills:
- 2+ years of experience in web scraping, crawling, or data collection.
- Strong proficiency in Python (libraries like BeautifulSoup, Scrapy, Selenium, Playwright, Requests).
- Familiarity with NoSQL databases (MongoDB, DynamoDB) and data serialization formats (JSON, CSV, Parquet).
- Experience in handling large-scale scraping with proxy management and rate-limiting.
- Basic knowledge of ETL processes and integration with data pipelines.
- Exposure to graph databases (Neo4j) is a plus.
Soft Skills:
- Detail-oriented, ensuring accuracy and reliability of collected data.
- Strong problem-solving skills, particularly in adapting scrapers to evolving web structures.
- Curious mindset with a drive to discover new data sources.
- Comfortable working in a fast-paced, early-stage startup environment.
-
Web Development Specialist
1 week ago
Kanpur, Uttar Pradesh, India beBeewebdevelopment Full time ₹ 15,000 - ₹ 24,000Web Development SpecialistWe are seeking a skilled Web Development Specialist to join our team. As a key member of our digital marketing agency, you will be responsible for designing and implementing high-quality web solutions that meet the needs of our clients.
-
Web Interface Specialist
7 days ago
Kanpur, Uttar Pradesh, India beBeeSpecialist Full time ₹ 10,00,000 - ₹ 15,00,000Web Interface SpecialistWe are seeking a skilled Web Interface Specialist to design and implement responsive web interfaces that meet our clients' needs.Key Responsibilities:Design and implement responsive web interfaces using modern front-end frameworks and librariesCollaborate with back-end developers to ensure seamless integration of web...
-
Web Development and SEO Specialist
1 week ago
Kanpur, Uttar Pradesh, India beBeeWebDeveloper Full time ₹ 45,00,000 - ₹ 50,00,000Web Development and SEO Specialist">We are seeking an experienced Web Developer to join our team as a Web Development and SEO Specialist. This role involves a mix of front-end development, technical SEO implementation, and performance optimization.The ideal candidate will have a solid understanding of web development principles, experience with WordPress,...
-
Senior Data Migration Specialist
2 weeks ago
Kanpur, Uttar Pradesh, India beBeeDataMigration Full time ₹ 1,50,00,000 - ₹ 2,00,00,000About the RoleAs a Senior Data Migration Specialist, you will be responsible for leading complex data migration projects from start to finish. This includes developing and implementing data migration strategies that align with business goals, ensuring accuracy, efficiency, and scalability.You will work closely with cross-functional teams to identify and...
-
Senior Data Validation Specialist
7 days ago
Kanpur, Uttar Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000Senior Data Validation SpecialistThis is a senior-level position for an experienced data validation specialist to join our team. We are seeking a highly skilled professional with strong analytical and problem-solving skills, excellent communication skills, and experience in testing ETL processes.Job Description:The ideal candidate will be responsible for...
-
Senior Web Application Developer
1 week ago
Kanpur, Uttar Pradesh, India beBeeDeveloper Full time ₹ 7,50,000 - ₹ 15,00,000Job Description:We are seeking an experienced Senior Web Application Developer to join our team. As a Senior Web Application Developer, you will play a key role in designing, developing, and maintaining cutting-edge web applications.Key Responsibilities:Design and develop scalable and efficient web applications using PHP and Laravel.Collaborate with the team...
-
Data Mining Specialist
1 week ago
Kanpur, Uttar Pradesh, India beBeeDataMining Full time ₹ 9,00,000 - ₹ 12,00,000Job Title: Data Mining SpecialistJob DescriptionWe are seeking a skilled and innovative Data Mining Specialist to join our team. As a key member of our organization, you will be responsible for designing, developing, and maintaining robust web scraping solutions to extract structured and unstructured data from various websites and APIs.Your primary focus...
-
Web Development Specialist
1 week ago
Kanpur, Uttar Pradesh, India beBeeWebDevelopment Full time ₹ 4,00,000 - ₹ 5,00,000Job Title: Web Development SpecialistWe are a fast-growing startup providing virtual assistance and business support services to clients across the globe. Our company is seeking a highly skilled Web Development Specialist to design, develop, and maintain functional, user-friendly, and visually appealing websites on multiple platforms.About the Role:The...
-
Web Application Specialist
1 week ago
Kanpur, Uttar Pradesh, India beBeeDeveloping Full time ₹ 9,00,000 - ₹ 15,00,000We're seeking an experienced Web Application Specialist to join our team.About the Role:This is a challenging position that requires strong technical skills and expertise in web application development. The successful candidate will be responsible for designing, building, and maintaining high-quality web applications using React.js.Key...
-
Senior Data Engineering Specialist
7 days ago
Kanpur, Uttar Pradesh, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000Job Title: Senior Data Engineering SpecialistJob Description:We are seeking an experienced data engineering specialist to join our team. The successful candidate will have a strong background in computer science and data science, with 3+ years of experience working with Python, SQL, PySpark, and bash scripts.Responsibilities:Develop and maintain robust data...
