Senior Data Solutions Developer
5 days ago
We are seeking a skilled professional to develop and implement scalable data extraction solutions.
This is an excellent opportunity for someone who thrives in early-stage challenges, loves building innovative solutions from day zero, and wants to own the entire tech stack.
Key Responsibilities:- Data Extraction & Processing: Design and develop automated scrapers to extract structured and unstructured data from websites, APIs, and public datasets.
- Scalable Scraping Systems: Develop multi-threaded, distributed crawlers capable of handling high-volume data collection without interruptions.
- Data Normalization & Cleaning: Normalize scraped data, remove noise, and ensure consistency before passing to data pipelines.
- Anti-bot & Evasion Tactics: Implement proxy rotation, captcha solving, and request throttling techniques to handle scraping restrictions.
- Integration with Pipelines: Deliver clean, structured datasets into NoSQL stores and ETL pipelines for further enrichment and graph-based storage.
- Data Quality & Validation: Ensure data accuracy, deduplicate records, and maintain a trust scoring system for data confidence.
- Documentation & Maintenance: Keep scrapers updated when websites change, and document scraping logic for reproducibility.
- Data Quality & Validation: Ensure data accuracy, deduplicate records, and maintain a trust scoring system for data confidence.
- Integration with Pipelines: Deliver clean, structured datasets into NoSQL stores and ETL pipelines for further enrichment and graph-based storage.
- Anti-bot & Evasion Tactics: Implement proxy rotation, captcha solving, and request throttling techniques to handle scraping restrictions.
- 2+ years of experience in web scraping, crawling, or data collection.
- Strong proficiency in Python (libraries like BeautifulSoup, Scrapy, Selenium, Playwright, Requests).
- Familiarity with NoSQL databases (MongoDB, DynamoDB) and data serialization formats (JSON, CSV, Parquet).
- Experience in handling large-scale scraping with proxy management and rate-limiting.
- Basic knowledge of ETL processes and integration with data pipelines.
- Exposure to graph databases (Neo4j) is a plus.
- Problem-Driven Innovation: We're deeply committed to solving real challenges that genuinely matter for our customers.
- Rapid Action & Ownership: We encourage autonomy and accountability—own your projects, move quickly, and shape the future of your work.
- Collaborative Excellence: Cross-team collaboration ensures alignment, sparks innovation, and drives us forward together.
- Continuous Learning: Stay ahead of the curve by continuously improving, experimenting, and learning.
- Data Normalization & Cleaning: Normalize scraped data, remove noise, and ensure consistency before passing to data pipelines.
- Scalable Scraping Systems: Develop multi-threaded, distributed crawlers capable of handling high-volume data collection without interruptions.
-
Senior Data Solution Architect
1 week ago
Amrāvati, Maharashtra, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000Delivering Modern Data SolutionsJob DescriptionThe role of Senior Data Engineer is crucial in developing modern data warehouse solutions using Snowflake and ADF. The ideal candidate will have a strong background in data warehousing and ETL processes, with expertise in Snowflake security, Snowflake SQL, and designing/implementing other Snowflake objects.A...
-
Amrāvati, Maharashtra, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000We are seeking a seasoned Data Engineering expert to lead the development of our self-service data platform for reporting and analytics.Build scalable data solutions with Databricks, SQL, Python, Spark, and Delta Lake on Azure.The ideal candidate will have 8+ years of experience in data engineering, with at least 3 years in senior roles. They should be...
-
Data Solutions Developer
14 hours ago
Amrāvati, Maharashtra, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 24,00,000Job Description:The ideal candidate will be responsible for designing, developing and optimizing large-scale data processing solutions using PySpark, Spark and Python.The successful applicant will also be required to implement ETL/ELT solutions to integrate structured and unstructured data from multiple sources, develop and maintain Hive queries and ensure...
-
Senior Data Solutions Developer
7 days ago
Amrāvati, Maharashtra, India beBeeData Full time ₹ 75,00,000 - ₹ 1,50,00,000Job SummaryWe are seeking an experienced data engineer to design and implement scalable data pipelines using Azure Databricks (PySpark/Scala).This is a key role in our organization where you will work with data scientists, analysts, and business stakeholders to deliver high-quality data solutions.Main ResponsibilitiesDesign and Implement Scalable Data...
-
Big Data Solutions Lead
5 days ago
Amrāvati, Maharashtra, India beBeeBigData Full time ₹ 20,00,000 - ₹ 30,00,000Senior Big Data DeveloperWe are seeking a highly skilled Senior Big Data Developer to lead our big data development initiatives.Key Responsibilities:Analyzing complex data requirements and designing scalable solutions using Spark, Scala, and PySpark.Developing and deploying high-quality code in onshore-offshore working mode.Collaborating with...
-
Enterprise Data Solutions Architect
2 weeks ago
Amrāvati, Maharashtra, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000Job Title - Enterprise Data Solutions ArchitectA senior-level professional with extensive experience in designing, implementing and migrating complex Data, Directory and Internet Services (DDI) systems is required.
-
Advanced Data Solutions Developer
3 days ago
Amrāvati, Maharashtra, India beBeeMachineLearning Full time ₹ 20,00,000 - ₹ 25,00,000Machine Learning EngineerWe are seeking an experienced Machine Learning professional to design, implement and integrate scalable data solutions into our products. The ideal candidate will have a strong background in machine learning, with expertise in developing and deploying models using popular frameworks.The successful candidate will be responsible for...
-
Senior Data Solutions Architect
3 days ago
Amrāvati, Maharashtra, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000Job Title: Data EngineerAbout People Prime Worldwide is a global innovator of IT and business services. Our commitment is to our clients' long-term success, combining global reach with local client attention to serve them in over 50 countries around the globe.We are seeking a skilled Data Engineer to design and implement tailored data solutions, providing...
-
Senior Data Solutions Architect
2 weeks ago
Amrāvati, Maharashtra, India beBeeDataEngineer Full time ₹ 25,00,000 - ₹ 40,00,000Job DescriptionAs a Technical Lead at datae2e-technologies, you will be responsible for leading a team of talented data engineers to design and deliver scalable data pipelines and analytics platforms.The ideal candidate will have deep expertise in Big Data platforms, Microsoft Azure, and Databricks. You will oversee the development of end-to-end data...
-
Senior Data Solutions Specialist
3 days ago
Amrāvati, Maharashtra, India beBeeData Full time ₹ 15,00,000 - ₹ 30,00,000Sikich India is seeking a seasoned Data Architect to lead our data and AI initiatives.You will design, build, and optimize end-to-end data solutions using Microsoft's data platforms.This involves implementing contemporary data architecture patterns, creating robust data pipelines, and delivering insight-driven analytics to inform business decisions.The ideal...
