Data Engineer

2 days ago


Hubli, Karnataka, India Gala Intelligence Full time

We're looking for an entrepreneurial, passionate, and driven Data Engineer to join Startup Gala Intelligence backed by Navneet Tech Venture situated in Ahmedabad. As we're building our technology platform from scratch, you'll have the unique opportunity to shape our technology vision, architecture, and engineering culture right from the ground up. You'll directly contribute to foundational development and establish best practices, while eventually building and contributing to our engineering team.

This role is ideal for someone eager to own the entire tech stack, who thrives on early-stage challenges, and loves building innovative, scalable solutions from day zero.

What You'll Do

  • Web Scraping & Crawling: Build and maintain automated scrapers to extract structured and unstructured data from websites, APIs, and public datasets.
    • Scalable Scraping Systems: Develop multi-threaded, distributed crawlers capable of handling high-volume data collection without interruptions.
      • Data Parsing & Cleaning: Normalize scraped data, remove noise, and ensure consistency before passing to data pipelines.
        • Anti-bot & Evasion Tactics: Implement proxy rotation, captcha solving, and request throttling techniques to handle scraping restrictions.
          • Integration with Pipelines: Deliver clean, structured datasets into NoSQL stores and ETL pipelines for further enrichment and graph-based storage.
            • Data Quality & Validation: Ensure data accuracy, deduplicate records, and maintain a trust scoring system for data confidence.
              • Documentation & Maintenance: Keep scrapers updated when websites change, and document scraping logic for reproducibility.

Who You Are

Technical Skills:

  • 2+ years of experience in web scraping, crawling, or data collection.
  • Strong proficiency in Python (libraries like BeautifulSoup, Scrapy, Selenium, Playwright, Requests).
  • Familiarity with NoSQL databases (MongoDB, DynamoDB) and data serialization formats (JSON, CSV, Parquet).
  • Experience in handling large-scale scraping with proxy management and rate-limiting.
  • Basic knowledge of ETL processes and integration with data pipelines.
  • Exposure to graph databases (Neo4j) is a plus.

Soft Skills:

  • Detail-oriented, ensuring accuracy and reliability of collected data.
  • Strong problem-solving skills, particularly in adapting scrapers to evolving web structures.
  • Curious mindset with a drive to discover new data sources.
  • Comfortable working in a fast-paced, early-stage startup environment.

Who We Are & Our Culture

Gala Intelligence, backed by Navneet Tech Ventures, is a tech-driven startup dedicated to solving one of the most pressing business challenges - fraud detection and prevention. We're building cutting-edge, real-time products designed to empower consumers and businesses to stay ahead of fraudsters, leveraging innovative technology and deep domain expertise.

Our culture and values:

We're united by a single, critical mission - stopping fraud before it impacts businesses. Curiosity, innovation, and proactive action define our approach. We value transparency, collaboration, and individual ownership, creating an environment where talented people can do their best work.

  • Problem-Driven Innovation: We're deeply committed to solving real challenges that genuinely matter for our customers.
  • Rapid Action & Ownership: We encourage autonomy and accountability—own your projects, move quickly, and shape the future of Gala Intelligence.
  • Collaborative Excellence: Cross-team collaboration ensures alignment, sparks innovation, and drives us forward together.
  • Continuous Learning: Fraud evolves rapidly, and so do we. Continuous improvement, experimentation, and learning are core to our success.

If you're excited by the opportunity to leverage technology in the fight against fraud, and you're ready to build something impactful from day one, we want to hear from you



  • Hubli, Karnataka, India NTT DATA Full time

    Req ID 338875 NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a AI Security Engineer - Shared Security Services Engineering to join our team in Banaglore Karn taka IN-KA India ...


  • Hubli, Karnataka, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Key Data Engineer PositionThis is a crucial data engineer role for an organization. The ideal candidate will have a deep understanding of data engineering principles and be able to apply them to real-world problems.The successful applicant will design and develop data pipelines using Python and cloud-based tools, implement data warehousing and ETL solutions,...


  • Hubli, Karnataka, India beBeeDataEngineer Full time ₹ 25,00,000 - ₹ 35,00,000

    **Job Title:** Data Engineering SpecialistWe are looking for a highly skilled engineer to join our data engineering team. The ideal candidate will have a proven track record in building, scaling, and optimizing big data pipelines, and hands-on experience in distributed data systems and cloud-based solutions.**Key Responsibilities:Design, develop, and...


  • Hubli, Karnataka, India beBeeDataEngineer Full time ₹ 24,00,000 - ₹ 40,00,000

    Job Title: Data Engineering SpecialistWe are seeking a seasoned data engineering specialist to lead our organization's data warehousing, big data, and data analytics initiatives.Total years of experience: 9+ Years required for this position.The ideal candidate should have extensive skills and success in the implementation of technology projects within a...


  • Hubli, Karnataka, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 22,00,000

    Job Title: Data Engineering SpecialistJob Description:We are seeking an experienced Data Engineer with hands-on expertise in Python and Pyspark to join our team. As a key member, you will be responsible for implementing a data-driven solution for a large retailer.Required Skills & Qualifications:5+ years of experience as a Data EngineerExpertise in Python,...


  • Hubli, Karnataka, India beBeeDataEngineer Full time ₹ 1,00,00,000 - ₹ 1,50,00,000

    About Our Data Engineering RoleWe're seeking a seasoned data engineer to spearhead our analytics team's growth and development.This strategic position requires someone with extensive experience in handling log-level data, cross-platform engineering, and proficiency in modern business intelligence tools.The ideal candidate will play a pivotal role in...


  • Hubli, Karnataka, India beBeeDataEngineering Full time ₹ 10,00,000 - ₹ 25,00,000

    Job Role: Data Engineering ExpertPrimary Responsibilities:Design, develop, and implement data pipelines leveraging Oracle Data Flow or Apache Spark (PySpark)Ensure seamless integration and automation across data services by orchestrating data workflowsCollaborate effectively with cross-functional teams and engage with stakeholders to drive business...

  • Data Engineer

    1 week ago


    Hubli, Karnataka, India beBeeDataEngineer Full time ₹ 1,08,09,120 - ₹ 2,08,18,200

    About the RoleWe are seeking a skilled Data Engineer to join our team and contribute to the design, development, and maintenance of ETL pipelines using Azure Data Factory.The ideal candidate will have expertise in designing and implementing data transformation workflows, integrating data from various sources, and ensuring data quality and reliability.Key...

  • Cloud Data Engineer

    7 days ago


    Hubli, Karnataka, India beBeeData Full time ₹ 1,70,88,000 - ₹ 2,41,12,000

    Job Title: Cloud Data EngineerWe are seeking a highly skilled data engineer to join our team.The ideal candidate will be responsible for designing, implementing and optimizing data pipelines on our data platform.Data Pipeline Development: Design, develop and maintain scalable data pipelines using Azure Synapse, Databricks & Apache Spark (PySpark).Data...


  • Hubli, Karnataka, India beBeeEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Software Engineering SpecialistWe are looking for a skilled Software Engineering Specialist to join our team. This role involves developing and optimizing data engineering pipelines using various technologies.This position requires experience with Azure Data Factory (ADF), Databricks, and Synapse Analytics.You will be responsible for designing scalable data...