Data Engineer

4 days ago

Pune, Maharashtra, India HG Insights Full time ₹ 1,20,000 - ₹ 1,50,000 per year

At HG Insights we provides AI-powered revenue growth intelligence and technology intelligence data to help B2B companies refine their go-to-market (GTM) strategies by analyzing market size, identifying potential customers, and uncovering in-market purchasing signals. With the recent acquisitions of MadKudu and TrustRadius, we've created an agentic GTM ecosystem that eliminates manual handoffs, guesswork, and siloed signals.

We're searching for a strong Data Engineer to take this ecosystem to the next level. You'll play a critical role in tackling high-impact projects, including large-scale data integration, improving and enriching intent signals, and building the foundational capabilities that will power our future AI initiatives. This is an opportunity to work with complex data pipelines at scale, shape the backbone of our intelligence platform, and directly influence how thousands of enterprise customers uncover growth opportunities.

What You Will Do
  • Build and maintain ETL pipelines using Apache Airflow in our kubernetes environment, processing 10M+ daily events from MongoDB to PostgreSQL and BigQuery
  • Design real-time data streaming architectures using Google Cloud Pub/Sub for visitor tracking, intent signals, and company resolution workflows
  • Develop ML data infrastructure for AI-powered features including vector embeddings, semantic search, and automated content generation using OpenAI and Google Vertex AI
  • Create analytics and reporting systems on BigQuery for customer intent data, lead scoring models, and business intelligence dashboards
  • Implement data quality and monitoring frameworks ensuring accuracy across the entire data pipeline from source to customer delivery
  • Build customer data delivery systems including Snowflake integration and API endpoints for enterprise data consumption
What You Will Be Responsible For
  • Data pipeline reliability with 99.9% uptime for critical business intelligence feeding customer-facing intent data products
  • Data accuracy and consistency across MongoDB PostgreSQL BigQuery Snowflake transformation chains
  • ML infrastructure performance supporting real-time vector search, embedding generation, and AI model inference
  • Scalable data architecture handling exponential growth in visitor data and intent signals
  • Customer data SLAs ensuring timely delivery of intent data to enterprise customers with contractual requirements
  • Building Dashboards and alerting for management of these systems
What You Will Need
  • 5+ years data engineering with Python, SQL, and distributed data processing frameworks
  • Strong ETL/ELT experience with Apache Airflow, dbt, or similar orchestration tools
  • Cloud data platform expertise with BigQuery, Cloud Storage, and data warehouse optimization
  • Real-time streaming experience with Pub/Sub, Kafka, or similar event-driven systems
  • Database proficiency across PostgreSQL, MongoDB, and modern data warehouse technologies
Nice to Have
  • ML/AI pipeline experience with vector databases (Pinecone), embedding models, and LLM integration
  • Intent data and lead scoring domain knowledge in B2B marketing technology
  • Apache Beam or Dataflow for large-scale data processing
  • Customer analytics and behavioral data modeling experience

  • Data Science Specialist

    6 days ago

    Pune, Maharashtra, India Data Direct Networks Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    OverviewThis is an incredible opportunity to be part of a company that has been at the forefront of AI and high-performance data storage innovation for over two decades. DataDirect Networks (DDN) is a global market leader renowned for powering many of the world's most demanding AI data centers, in industries ranging from life sciences and healthcare to...

  • Data Scientist Specialist

    15 hours ago

    Pune, Maharashtra, India Optimum Data Analytics Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Role Overview:We are looking for a Data Scientist Specialist to join our growing AI & Data team. The ideal candidate will have hands-on experience designing and deploying AI/ML solutions with Azure Cloud, LLMOps, Containerized environments, and Generative AI technologies. This is an onsite role based in Pune, offering you the opportunity to collaborate...

  • Senior Software Engineer

    2 weeks ago

    Pune, Maharashtra, India Crest Data Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    We are looking for a strong ReactJS Lead Engineers to join our engineering team in Ahmedabad. The primary responsibility will be to lead the design and develop Enterprise Software for our Global Fortune 500 clients in Data Center and Big Data segments.Location: PUNE / AHMEDABAD ( WFO Only)Key ResponsibilitiesResponsible for providing expertise in software...

  • Senior Software Engineer

    1 week ago

    Pune, Maharashtra, India Data Axle Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About Data Axle:Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging...

  • Azure Support Engineer

    4 days ago

    Pune, Maharashtra, India NTT DATA Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Req ID: 338755NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Azure Support Engineer - Digital Solution Consultant Sr. Analyst to join our team in Pune, Mahārāshtra (IN-MH), India...

  • Data Engineer

    4 days ago

    Pune, Maharashtra, India RedPluto Analytics Private Limited Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Company DescriptionRedPluto Analytics is a trusted partner in data science, data engineering, and data analytics. Our passionate team of professionals leverages data to drive efficiency, innovation, and strategic decision-making for businesses across various industries in India. Our services include Data Engineering, Cloud Transformations, Data Management,...

  • Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Vi (Vodafone Idea) Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    Assistant Manager - Data Engineer - PuneThe Assistant Manager - Data Engineer role in Pune involves working on data engineering projects and collaborating with cross-functional teams to develop and maintain data pipelines, ETL processes, and data warehousing solutions. The role requires strong analytical and problem-solving skills, as well as the ability to...

  • Mid level GenAI Engineers

    2 weeks ago

    Pune, Maharashtra, India NTT DATA Full time ₹ 10,00,000 - ₹ 30,00,000 per year

    Req ID: 341066NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Mid level GenAI Engineers to join our team in Pune, Mahārāshtra (IN-MH), India (IN). Key Responsibilities Build...

  • Systems - Senior Software Engineer - Framework

    1 week ago

    Pune, Maharashtra, India Crest Data Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job DescriptionWe are looking for a strong ReactJS Lead Engineers to join our engineering team in Ahmedabad. The primary responsibility will be to lead the design and develop Enterprise Software for our Global Fortune 500 clients in Data Center and Big Data segments.Location : PUNE / AHMEDABAD (WFO Only).Key ResponsibilitiesResponsible for providing...

  • Data Engineering

    2 days ago

    Pune, Maharashtra, India Verdantas Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Join Verdantas – A Top #ENR 81 Firm Driving Sustainable ProgressWe are seeking an Engineering Lead in Pune to architect and implement scalable, secure AI/ML data solutions aligned with business objectives. The role involves designing robust batch and real-time data architectures, leading ETL/ELT pipeline development, managing data lakes and warehouses,...