Innovative Data Architect
4 days ago
We are looking for an experienced and skilled professional to lead our data engineering efforts. The ideal candidate will have a strong background in software development, particularly with Python programming language.
This role is ideal for someone who has experience in building scalable solutions, handling large datasets, and developing innovative systems from scratch.
Key Responsibilities:- Web Scraping & Crawling: Develop automated scrapers to extract structured and unstructured data from websites, APIs, and public datasets.
- Scalable Scraping Systems: Design and implement multi-threaded, distributed crawlers capable of handling high-volume data collection without interruptions.
- Data Parsing & Cleaning: Normalize scraped data, remove noise, and ensure consistency before passing to data pipelines.
- Anti-bot & Evasion Tactics: Implement proxy rotation, captcha solving, and request throttling techniques to handle scraping restrictions.
- Integration with Pipelines: Deliver clean, structured datasets into NoSQL stores and ETL pipelines for further enrichment and graph-based storage.
- Data Quality & Validation: Ensure data accuracy, deduplicate records, and maintain a trust scoring system for data confidence.
- Documentation & Maintenance: Keep scrapers updated when websites change, and document scraping logic for reproducibility.
- Strong proficiency in Python (libraries like BeautifulSoup, Scrapy, Selenium, Playwright, Requests).
- Familiarity with NoSQL databases (MongoDB, DynamoDB) and data serialization formats (JSON, CSV, Parquet).
- Experience in handling large-scale scraping with proxy management and rate-limiting.
- Basic knowledge of ETL processes and integration with data pipelines.
- Exposure to graph databases (Neo4j) is a plus.
- We are united by a single critical mission - stopping fraud before it impacts businesses.
- Curiosity, innovation, and proactive action define our approach.
- We value transparency, collaboration, and individual ownership, creating an environment where talented people can do their best work.
- Data Quality & Validation: Ensure data accuracy, deduplicate records, and maintain a trust scoring system for data confidence.
- Integration with Pipelines: Deliver clean, structured datasets into NoSQL stores and ETL pipelines for further enrichment and graph-based storage.
- Anti-bot & Evasion Tactics: Implement proxy rotation, captcha solving, and request throttling techniques to handle scraping restrictions.
- Data Parsing & Cleaning: Normalize scraped data, remove noise, and ensure consistency before passing to data pipelines.
- Scalable Scraping Systems: Design and implement multi-threaded, distributed crawlers capable of handling high-volume data collection without interruptions.
At Gala Intelligence, we're dedicated to solving one of the most pressing business challenges - fraud detection and prevention. We're building cutting-edge, real-time products designed to empower consumers and businesses to stay ahead of fraudsters, leveraging innovative technology and deep domain expertise.
-
Senior Lead Data Innovation Architect
1 week ago
Mysore, Karnataka, India beBeeDataEngineering Full time ₹ 25,00,000 - ₹ 35,00,000Job OverviewWe are seeking a highly skilled Senior Lead Data Engineer to join our team. As a technical leader, you will drive best practices in data engineering, architecture, and governance.Key Responsibilities:Lead Data Engineering: Architect, design, and optimize complex data pipelines using Databricks and Azure Data Services.Scalable Solutions: Lead the...
-
Data Architect Specialist
1 week ago
Mysore, Karnataka, India beBeeDataArchitect Full time ₹ 20,00,000 - ₹ 25,00,000Job Title: Data Architect SpecialistWe are seeking a skilled Data Architect Specialist to design, develop and implement data solutions that meet our business needs.This role involves creating and maintaining high-level architectures for data systems, ensuring scalability, reliability and performance.You will work with cross-functional teams to gather...
-
Chief Data Architect
1 week ago
Mysore, Karnataka, India beBeeData Full time US$ 1,80,000 - US$ 2,00,000Key Position: Data Architect">Job Overview:">We are seeking a highly skilled Data Architect with 6–8 years of experience in designing, developing and managing enterprise data solutions. The ideal candidate will have a strong background in cloud data architecture, data warehousing, big data processing and data integration.">Key Responsibilities:">Design...
-
Data Architect Consultant
7 days ago
Mysore, Karnataka, India beBeeDataGovernance Full time ₹ 2,05,76,123 - ₹ 2,51,19,866Job Title: Data Architect ConsultantA highly experienced SAP data professional is required to drive enterprise data strategy, architecture, and implementation on SAP Datasphere.Key Responsibilities:Design and implement end-to-end data solutions for SAP Datasphere integration with enterprise systems.Lead migration strategies from legacy warehouses to...
-
Advanced Data Architect
1 week ago
Mysore, Karnataka, India beBeeData Full time ₹ 28,80,000 - ₹ 36,00,000Data ArchitectA leading IT company is seeking a skilled data architect to design and implement advanced data solutions.
-
Data Architect
7 days ago
Mysore, Karnataka, India beBeeData Full time ₹ 10,00,000 - ₹ 15,00,000Job Title: Data ArchitectJob Summary:We are seeking a highly skilled Data Architect to lead the design and implementation of our data infrastructure.The ideal candidate will have expertise in data modeling, data warehousing, and ETL processes.They will work closely with cross-functional teams to ensure seamless integration of data systems.Key Skills and...
-
Chief Data Innovation Officer
1 week ago
Mysore, Karnataka, India beBeeDataEngineering Full time ₹ 29,49,120 - ₹ 34,20,400Data Engineering LeadAbout Us:We're a leader in the restaurant industry, leveraging digital transformation and operational efficiencies to drive innovation.Our technology hub focuses on developing new capabilities in data science, data analytics, e-commerce, automation, cloud computing, and information security to accelerate business strategy.Job...
-
Chief Data Architect
1 week ago
Mysore, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 18,00,000Job OverviewWe are seeking an experienced Chief Data Architect to lead our data engineering efforts. The ideal candidate will have a strong background in designing and implementing large-scale data processing systems using Azure/AWS Databricks.Key Responsibilities:Design, develop, and maintain large-scale data processing systems using cloud-based...
-
Data Architect
1 week ago
Mysore, Karnataka, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000Job Overview:Data architects design and implement large-scale data systems that enable organizations to collect, store, process, and analyze data.Main Responsibilities:Create and manage conceptual, logical & physical data models across multiple domains.Design and optimize data solutions, ensuring data is trusted, understood, and easy to use.Collaborate with...
-
Chief Data Architect
2 weeks ago
Mysore, Karnataka, India beBeeData Full time US$ 10,00,000 - US$ 15,00,000Job Summary:Data architects with experience in designing and developing large-scale data systems are sought to collaborate on high-profile projects. About the Role:This role involves leading the design, development, and implementation of distributed computing frameworks. A strong focus is placed on collaboration, problem-solving, and delivery under...
