
Data Engineer
5 hours ago
We're looking for an entrepreneurial, passionate, and driven Data Engineer to join Startup Gala Intelligence backed by Navneet Tech Venture. As we're building our technology platform from scratch, you'll have the unique opportunity to shape our technology vision, architecture, and engineering culture right from the ground up. You'll directly contribute to foundational development and establish best practices, while eventually building and contributing to our engineering team.
This role is ideal for someone eager to own the entire tech stack, who thrives on early-stage challenges, and loves building innovative, scalable solutions from day zero.
What You'll Do- Web Scraping & Crawling: Build and maintain automated scrapers to extract structured and unstructured data from websites, APIs, and public datasets.
- Scalable Scraping Systems: Develop multi-threaded, distributed crawlers capable of handling high-volume data collection without interruptions.
- Data Parsing & Cleaning: Normalize scraped data, remove noise, and ensure consistency before passing to data pipelines.
- Anti-bot & Evasion Tactics: Implement proxy rotation, captcha solving, and request throttling techniques to handle scraping restrictions.
- Integration with Pipelines: Deliver clean, structured datasets into NoSQL stores and ETL pipelines for further enrichment and graph-based storage.
- Data Quality & Validation: Ensure data accuracy, deduplicate records, and maintain a trust scoring system for data confidence.
- Documentation & Maintenance: Keep scrapers updated when websites change, and document scraping logic for reproducibility.
- Data Quality & Validation: Ensure data accuracy, deduplicate records, and maintain a trust scoring system for data confidence.
- Integration with Pipelines: Deliver clean, structured datasets into NoSQL stores and ETL pipelines for further enrichment and graph-based storage.
- Anti-bot & Evasion Tactics: Implement proxy rotation, captcha solving, and request throttling techniques to handle scraping restrictions.
- Data Parsing & Cleaning: Normalize scraped data, remove noise, and ensure consistency before passing to data pipelines.
- Scalable Scraping Systems: Develop multi-threaded, distributed crawlers capable of handling high-volume data collection without interruptions.
Technical Skills:
- 2+ years of experience in web scraping, crawling, or data collection.
- Strong proficiency in Python (libraries like BeautifulSoup, Scrapy, Selenium, Playwright, Requests).
- Familiarity with NoSQL databases (MongoDB, DynamoDB) and data serialization formats (JSON, CSV, Parquet).
- Experience in handling large-scale scraping with proxy management and rate-limiting.
- Basic knowledge of ETL processes and integration with data pipelines.
- Exposure to graph databases (Neo4j) is a plus.
Soft Skills:
- Detail-oriented, ensuring accuracy and reliability of collected data.
- Strong problem-solving skills, particularly in adapting scrapers to evolving web structures.
- Curious mindset with a drive to discover new data sources.
- Comfortable working in a fast-paced, early-stage startup environment.
Gala Intelligence, backed by Navneet Tech Ventures, is a tech-driven startup dedicated to solving one of the most pressing business challenges - fraud detection and prevention. We're building cutting-edge, real-time products designed to empower consumers and businesses to stay ahead of fraudsters, leveraging innovative technology and deep domain expertise.
Our culture and values:
We're united by a single, critical mission - stopping fraud before it impacts businesses. Curiosity, innovation, and proactive action define our approach. We value transparency, collaboration, and individual ownership, creating an environment where talented people can do their best work.
- Problem-Driven Innovation: We're deeply committed to solving real challenges that genuinely matter for our customers.
- Rapid Action & Ownership: We encourage autonomy and accountability—own your projects, move quickly, and shape the future of Gala Intelligence.
- Collaborative Excellence: Cross-team collaboration ensures alignment, sparks innovation, and drives us forward together.
- Continuous Learning: Fraud evolves rapidly, and so do we. Continuous improvement, experimentation, and learning are core to our success.
If you're excited by the opportunity to leverage technology in the fight against fraud, and you're ready to build something impactful from day one, we want to hear from you
-
Data Engineering Specialist
2 days ago
Agra, Uttar Pradesh, India beBeeEngineering Full time ₹ 17,75,000 - ₹ 23,57,000About Our Opportunity:We are seeking an experienced Data Engineer to join our team in Hyderabad. As a key member of our organization, you will be responsible for designing and implementing scalable data solutions to support our business functions.Position Summary:This is a challenging role that requires expertise in cloud computing platforms, technologies,...
-
Senior Data Engineer
40 minutes ago
Agra, Uttar Pradesh, India beBeeData Full time ₹ 20,00,000 - ₹ 30,00,000Data Engineering Leadership RoleThis senior data engineering position requires an expert to develop efficient and scalable data pipelines that support business needs. The ideal candidate has a strong technical background in Big Data technologies, including pySpark, Hadoop, and Hive, as well as experience with cloud platforms and orchestration tools.Develops...
-
Data Engineering Specialist
1 day ago
Agra, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,20,00,000Job Title: Data Engineer SpecialistWe are seeking a seasoned Data Engineer to fill this key role. The ideal candidate will have a proven track record of at least 6 years of experience, with significant expertise in Azure Synapse and close to 1 year of experience in Microsoft Fabric.The successful candidate will possess a deep understanding of data...
-
Data Engineer Position
2 days ago
Agra, Uttar Pradesh, India beBeeSenior Full time ₹ 12,80,000 - ₹ 19,36,000A leading data engineer opportunity is available in the field of Senior data engineer.This role involves working with Airflow, utilizing its potential to streamline data processing and analytics tasks. Proficiency in Python programming is a must, along with expertise in Snowflake for efficient data storage and management.Located in Pune, Bengaluru, or...
-
Data Engineering Specialist
5 days ago
Agra, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 90,00,000 - ₹ 1,20,00,000Data Engineering RoleWe are seeking a skilled professional to take on the role of Data Engineer. This position involves analyzing and organizing raw data, interpreting trends and patterns, conducting complex data analysis, and reporting results to stakeholders.The ideal candidate will have experience in data modeling, data mining, and segmentation...
-
Data Engineering Lead
3 days ago
Agra, Uttar Pradesh, India beBeeData Full time ₹ 40,00,000 - ₹ 50,00,000About Our TeamWe are a dynamic and innovative team focused on building and improving our Data Warehouse offerings. As a Principal Data Engineer, you will be responsible for leading a team of Senior Engineers and working closely with clients to gather requirements.In this role, you will have the opportunity to propose architecture, solve complex data modeling...
-
Cloud Data Engineer
6 days ago
Agra, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 1,20,00,000 - ₹ 2,50,00,000Cloud Data EngineerWe are seeking a skilled Cloud Data Engineer to design and develop robust data pipelines that clean, transform, and aggregate data from disparate sources.Collaborate with data scientists to design and develop robust data pipelines using industry-wide tools such as Apache Beam, Airflow, and BigQuery.Model front-end and back-end data sources...
-
Data Engineering Professional
5 days ago
Agra, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000Job Title: Data Engineering ProfessionalWe are seeking an experienced Data Engineering professional to join our team. The ideal candidate will have a strong background in cloud technologies, with expertise in designing and implementing scalable data pipelines using Python.The role involves developing and maintaining efficient data processing systems,...
-
Data Engineer Specialist
6 days ago
Agra, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000Job Title: Data Engineer SpecialistWe are seeking a skilled Data Engineer to join our team.About the Role:The successful candidate will have 4+ years of experience in IT and be proficient in SQL, Power BI, Tableau or Looker.Familiarity with cloud platforms and databases such as MySQL, PostgreSQL, SQL Server, Oracle, Apache Spark, Hadoop, or Hive is...
-
Data Architecture Engineer
6 days ago
Agra, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 17,22,000 - ₹ 25,19,000Job TitleA senior data engineer with expertise in Microsoft Azure is needed to design, build, and optimize scalable data pipelines and lakehouse architectures.