Data Engineering Specialist
7 days ago
We're looking for a driven individual to join our team as a Data Engineer. This role is ideal for someone who thrives on early-stage challenges, loves building innovative, scalable solutions, and owns the entire tech stack.
Key Responsibilities- Web Scraping & Crawling: Build and maintain automated scrapers to extract structured and unstructured data from websites, APIs, and public datasets.
- Scalable Scraping Systems: Develop multi-threaded, distributed crawlers capable of handling high-volume data collection without interruptions.
- Data Parsing & Cleaning: Normalize scraped data, remove noise, and ensure consistency before passing to data pipelines.
- Anti-bot & Evasion Tactics: Implement proxy rotation, captcha solving, and request throttling techniques to handle scraping restrictions.
- Integration with Pipelines: Deliver clean, structured datasets into NoSQL stores and ETL pipelines for further enrichment and graph-based storage.
- Data Quality & Validation: Ensure data accuracy, deduplicate records, and maintain a trust scoring system for data confidence.
- Documentation & Maintenance: Keep scrapers updated when websites change, and document scraping logic for reproducibility.
- Data Quality & Validation: Ensure data accuracy, deduplicate records, and maintain a trust scoring system for data confidence.
- Integration with Pipelines: Deliver clean, structured datasets into NoSQL stores and ETL pipelines for further enrichment and graph-based storage.
- Anti-bot & Evasion Tactics: Implement proxy rotation, captcha solving, and request throttling techniques to handle scraping restrictions.
- Data Parsing & Cleaning: Normalize scraped data, remove noise, and ensure consistency before passing to data pipelines.
- Scalable Scraping Systems: Develop multi-threaded, distributed crawlers capable of handling high-volume data collection without interruptions.
You must have 2+ years of experience in web scraping, crawling, or data collection.
Familiarity with Python, NoSQL databases, and data serialization formats is required.
Experience in handling large-scale scraping, proxy management, and rate-limiting is essential.
Our CultureWe value transparency, collaboration, and individual ownership, creating an environment where talented people can do their best work.
Our fraud detection and prevention solution relies on cutting-edge technology and innovation to stay ahead of emerging threats.
- Problem-Driven Innovation: We focus on solving real-world problems that genuinely matter for our customers.
- Rapid Action & Ownership: We encourage autonomy and accountability—own your projects, move quickly, and shape the future of our organization.
- Collaborative Excellence: Cross-team collaboration ensures alignment, sparks innovation, and drives us forward together.
- Continuous Learning: Fraud evolves rapidly, and so do we. Continuous improvement, experimentation, and learning are core to our success.
-
Data Engineering Specialist
2 weeks ago
Rajkot, Gujarat, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000Job Title: Data Engineering SpecialistRole Overview:We are seeking a highly skilled Data Engineering Specialist to join our organization. The successful candidate will be responsible for designing, building, and maintaining large-scale data systems.The ideal candidate will have expertise in analytic data warehouse technologies, including Snowflake and...
-
Cloud Data Engineering Specialist
2 weeks ago
Rajkot, Gujarat, India beBeeData Full time ₹ 12,00,000 - ₹ 25,00,000Job Title: Cloud Data Engineering SpecialistAbout the RoleWe are seeking a skilled Cloud Data Engineer to design and develop scalable data pipelines using Spark. As a Cloud Data Engineer, you will leverage Azure Databricks and Datalake for efficient data processing and storage.Main Responsibilities:Design and implement data pipelines to efficiently process...
-
Content Developer
2 weeks ago
Rajkot, Gujarat, India beBeeDocumentation Specialist Full time ₹ 12,00,000 - ₹ 25,00,000About the Role:As a key member of our documentation team, you will be responsible for creating high-quality documentation that accurately reflects the features and benefits of our products. You will work closely with various departments to understand project requirements and develop comprehensive documentation that meets organizational standards.Your...
-
ETL Data Quality Specialist
2 weeks ago
Rajkot, Gujarat, India beBeeETL Full time ₹ 14,16,667Job Title: ETL Data Quality Specialist">"Ensuring the accuracy and completeness of data is a top priority in our organization.">We are seeking an experienced ETL Data Quality Specialist to join our team. As a key member of our data engineering team, you will play a vital role in ensuring the smooth operation of our data pipelines.">Requirements:">5+ years of...
-
Data Management Specialist
1 week ago
Rajkot, Gujarat, India beBeeVeeva Full time ₹ 8,00,000 - ₹ 15,00,000Job Title: Data Management Specialist We are seeking a skilled and experienced Data Management Specialist to join our team. Key Responsibilities:Ensure data integrity and security by performing regular system audits.Identify and resolve technical issues related to applications.Work collaboratively with cross-functional teams to resolve problems.Provide...
-
Data Engineering Specialist
1 week ago
Rajkot, Gujarat, India beBeeBackend Full time ₹ 1,20,00,000 - ₹ 2,50,00,000Senior Backend Data EngineerWe are seeking a skilled Senior Backend Data Engineer to join our team. The ideal candidate will have 4+ years of experience in backend/data engineering and possess expertise in Python, Azure, and PostgreSQL.The successful candidate will be responsible for designing and implementing crawling/fetch pipelines, parsing/normalizing...
-
GCP Data Insights Specialist
7 days ago
Rajkot, Gujarat, India beBeeDataInsights Full time ₹ 1,50,00,000 - ₹ 2,01,00,000GCP Data Insights SpecialistJob Overview:We are seeking an experienced GCP Looker professional to join our team. As a data insights specialist, you will be responsible for leveraging your technical expertise to drive business growth and improvement.Key Responsibilities:Analyzing complex data sets to identify trends and insights that inform business...
-
Data Architect Specialist
2 weeks ago
Rajkot, Gujarat, India beBeeDataArchitect Full time ₹ 25,00,000 - ₹ 35,00,000Job Title: Data Architect SpecialistWe are seeking an experienced data architect with a strong background in cloud development to lead the design and implementation of large-scale data pipelines and architectures.The ideal candidate has hands-on experience designing, building, and optimizing complex data systems in cloud environments (especially AWS). This...
-
Senior Data Engineer Role
2 weeks ago
Rajkot, Gujarat, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000Data Engineer SpecialistRole: Expert data engineer with 4–8 years of experience required.Responsibilities:Create scalable data pipelines on AWS and optimize their performance.Implement data ingestion, transformation, and integration solutions using Spark, Glue, and SQL to deliver high-quality data products.Manage and optimize cloud storage and compute...
-
Data Architecture Specialist
2 weeks ago
Rajkot, Gujarat, India beBeeDataArchitecture Full time ₹ 9,00,000 - ₹ 13,60,000Data Architecture SpecialistWe are seeking an experienced professional to oversee the design and implementation of large-scale data architectures, integrating with Power BI, Synapse, and other Azure services.Main Responsibilities:Design and implement solution architectures for complex data projects.Lead a team in delivering scalable and secure data...
