Data engineer

2 weeks ago


Kozhikode, India Gala Intelligence Full time

We're looking for an entrepreneurial, passionate, and driven Data Engineer to join Startup Gala Intelligence backed by Navneet Tech Venture. As we're building our technology platform from scratch, you'll have the unique opportunity to shape our technology vision, architecture, and engineering culture right from the ground up. You’ll directly contribute to foundational development and establish best practices, while eventually building and contributing to our engineering team.This role is ideal for someone eager to own the entire tech stack, who thrives on early-stage challenges, and loves building innovative, scalable solutions from day zero.What You’ll DoWeb Scraping & Crawling: Build and maintain automated scrapers to extract structured and unstructured data from websites, APIs, and public datasets.Scalable Scraping Systems: Develop multi-threaded, distributed crawlers capable of handling high-volume data collection without interruptions.Data Parsing & Cleaning: Normalize scraped data, remove noise, and ensure consistency before passing to data pipelines.Anti-bot & Evasion Tactics: Implement proxy rotation, captcha solving, and request throttling techniques to handle scraping restrictions.Integration with Pipelines: Deliver clean, structured datasets into No SQL stores and ETL pipelines for further enrichment and graph-based storage.Data Quality & Validation: Ensure data accuracy, deduplicate records, and maintain a trust scoring system for data confidence.Documentation & Maintenance: Keep scrapers updated when websites change, and document scraping logic for reproducibility.Who You AreTechnical Skills:2+ years of experience in web scraping, crawling, or data collection.Strong proficiency in Python (libraries like Beautiful Soup, Scrapy, Selenium, Playwright, Requests).Familiarity with No SQL databases (Mongo DB, Dynamo DB) and data serialization formats (JSON, CSV, Parquet).Experience in handling large-scale scraping with proxy management and rate-limiting.Basic knowledge of ETL processes and integration with data pipelines.Exposure to graph databases (Neo4j) is a plus.Soft Skills:Detail-oriented, ensuring accuracy and reliability of collected data.Strong problem-solving skills, particularly in adapting scrapers to evolving web structures.Curious mindset with a drive to discover new data sources.Comfortable working in a fast-paced, early-stage startup environment.Who We Are & Our CultureGala Intelligence, backed by Navneet Tech Ventures, is a tech-driven startup dedicated to solving one of the most pressing business challenges - fraud detection and prevention. We're building cutting-edge, real-time products designed to empower consumers and businesses to stay ahead of fraudsters, leveraging innovative technology and deep domain expertise.Our culture and values:We’re united by a single, critical mission - stopping fraud before it impacts businesses. Curiosity, innovation, and proactive action define our approach. We value transparency, collaboration, and individual ownership, creating an environment where talented people can do their best work.Problem-Driven Innovation: We're deeply committed to solving real challenges that genuinely matter for our customers.Rapid Action & Ownership: We encourage autonomy and accountability—own your projects, move quickly, and shape the future of Gala Intelligence.Collaborative Excellence: Cross-team collaboration ensures alignment, sparks innovation, and drives us forward together.Continuous Learning: Fraud evolves rapidly, and so do we. Continuous improvement, experimentation, and learning are core to our success.If you're excited by the opportunity to leverage technology in the fight against fraud, and you're ready to build something impactful from day one, we want to hear from you


  • Data Engineer

    3 weeks ago


    Kozhikode, Kerala, India Logic Pursuits Full time

    Job Title: Data Engineer (Snowflake + dbt)Location: Hyderabad, IndiaJob Type: Full-timeJob Description:We are looking for an experienced and results-driven Data Engineer to join our growing Data Engineering team. The ideal candidate will be proficient in building scalable, high-performance data transformation pipelines using Snowflake and dbt, and able to...

  • Data Engineer

    3 weeks ago


    Kozhikode, Kerala, India Talogy Full time

    Data EngineerThis opportunity is ideal for a determined and proactive individual who has a wide range of skills in a variety of database administration, reporting and dashboarding disciplines. This role requires an analytical thinker who pays significant attention to detail in their work.We are looking for an experienced data engineer with extensive...

  • Quality Engineer

    6 days ago


    Kozhikode, India Tiger Analytics Full time

    As a Quality Engineer - Data, you will be involved in every phase of SDLC and focus on Functional testability, Automation and Performance of the software. More specifically, you will work on:Selecting and integrating Data tools and frameworks required to provide requested capabilities.Technical guidance for software engineers engaged in the design, coding,...

  • Data Engineer

    2 weeks ago


    Kozhikode, India Innodata Inc. Full time

    We are looking for a Data Engineer with strong experience in CI/CD practices, Databricks (Spark), Python, Github and SQL. The ideal candidate should have hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and working with modern DevOps/configuration management tools.Key ResponsibilitiesDesign, implement, and...


  • Kozhikode, India Vista Applied Solutions Group Inc Full time

    Job Summary:Our client is seeking a Senior Data Engineer to lead the modernization of our enterprise data platform using Microsoft Fabric, with a focus on building an AI-ready foundation. This role is key to replacing legacy ERP systems, retiring SSIS, and implementing scalable, code-driven data pipelines to support advanced analytics and future AI...


  • Kozhikode, Kerala, India Palo Alto Networks Full time

    Our MissionAt Palo Alto Networks everything starts and ends with our mission:Being the cybersecurity partner of choice, protecting our digital way of life.Our vision is a world where each day is safer and more secure than the one before. We are a company built on the foundation of challenging and disrupting the way things are done, and we're looking for...


  • Kozhikode, Kerala, India CYAN360 Full time

    Position: Senior AWS Data EngineerLocation: RemoteSalary: OpenWork Timings: 2:30 PM to 11:30 PM IST*** Need someone who can join immediately or in 15 days***Responsibilities:Design, develop, and deploy end-to-end data pipelines on AWS cloud infrastructure using services such as Amazon S3, AWS Glue, AWS Lambda, Amazon Redshift, etc.Implement data processing...

  • Data Analyst

    1 day ago


    Kozhikode, Kerala, India ZACKLE ENGINEERS LLP ,Channel Partner - TOSTEM ( Part of LIXIL) Full time ₹ 1,20,000 - ₹ 2,40,000 per year

    Job Title: Data AnalystCompany: Zackle EngineersLocation: Calicut , KeralaJob Type: Full-timeAbout the RoleZackle Engineers is looking for a talented and detail-oriented Data Analyst to join our team. In this role, you will be responsible for collecting, analyzing, and interpreting large datasets to help us make data-driven decisions. You will transform raw...

  • Data Scientist

    4 weeks ago


    Kozhikode, Kerala, India C5i Full time

    TJob descriptionWe are seeking a highly skilled Data Scientist with a passion for AI, machine learning, and deep learning to join our dynamic team. The ideal candidate will have experience in generative models, LLMs, and advanced AI techniques, and will contribute to solving complex business challenges.Job Title: Data Scientist (Generative AI LLMs)Location:...


  • Kozhikode, Kerala, India Arcana Full time

    We are seeking dynamic Portfolio Data Analysts to join our team and collaborate closely with our founders, financial analysts, product managers, and engineers. In this role, you'll play a pivotal part in supporting our client onboarding and success team. You'll need a strong ability to analyze financial data, translate insights into actionable strategies,...