Staff/Senior Data Engineer

4 weeks ago

Pune, India HG Insights Full time

At HG Insights we provides AI-powered revenue growth intelligence and technology intelligence data to help B2B companies refine their go-to-market (GTM) strategies by analyzing market size, identifying potential customers, and uncovering in-market purchasing signals. With the recent acquisitions of MadKudu and TrustRadius, we’ve created an agentic GTM ecosystem that eliminates manual handoffs, guesswork, and siloed signals. We’re searching for a strong Data Engineer to take this ecosystem to the next level. You’ll play a critical role in tackling high-impact projects, including large-scale data integration, improving and enriching intent signals, and building the foundational capabilities that will power our future AI initiatives. This is an opportunity to work with complex data pipelines at scale, shape the backbone of our intelligence platform, and directly influence how thousands of enterprise customers uncover growth opportunities. What You Will Do Build and maintain ETL pipelines using Apache Airflow in our kubernetes environment, processing 10M+ daily events from MongoDB to PostgreSQL and BigQuery Design real-time data streaming architectures using Google Cloud Pub/Sub for visitor tracking, intent signals, and company resolution workflows Develop ML data infrastructure for AI-powered features including vector embeddings, semantic search, and automated content generation using OpenAI and Google Vertex AI Create analytics and reporting systems on BigQuery for customer intent data, lead scoring models, and business intelligence dashboards Implement data quality and monitoring frameworks ensuring accuracy across the entire data pipeline from source to customer delivery Build customer data delivery systems including Snowflake integration and API endpoints for enterprise data consumption What You Will Be Responsible For Data pipeline reliability with 99.9% uptime for critical business intelligence feeding customer-facing intent data products Data accuracy and consistency across MongoDB → PostgreSQL → BigQuery → Snowflake transformation chains ML infrastructure performance supporting real-time vector search, embedding generation, and AI model inference Scalable data architecture handling exponential growth in visitor data and intent signals Customer data SLAs ensuring timely delivery of intent data to enterprise customers with contractual requirements Building Dashboards and alerting for management of these systems What You Will Need 9+ years data engineering with Python, SQL, and distributed data processing frameworks Strong ETL/ELT experience with Apache Airflow, dbt, or similar orchestration tools Cloud data platform expertise with BigQuery, Cloud Storage, and data warehouse optimization Real-time streaming experience with Pub/Sub, Kafka, or similar event-driven systems Database proficiency across PostgreSQL, MongoDB, and modern data warehouse technologies Nice to Have ML/AI pipeline experience with vector databases (Pinecone), embedding models, and LLM integration Intent data and lead scoring domain knowledge in B2B marketing technology Apache Beam or Dataflow for large-scale data processing Customer analytics and behavioral data modeling experience

  • Senior Data Engineer

    16 hours ago

    Pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and...

  • Staff Data Engineer

    7 days ago

    Pune, Maharashtra, India Pattern Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Role Overview- As a Staff Data Engineer, you'll be a technical leader and systems thinker within Pattern's Data Engineering team—designing and scaling our canonical data model to deliver trusted, high-quality data. You'll transform complex, raw data with a set of efficient pipelines into tables that are easy to understand and efficient to power analytics,...

  • Staff Data Engineer

    15 hours ago

    Pune, India Baker Hughes Full time

    Are you excited about the opportunity to contribute to an industry leader in Energy Technology? As a Staff Data Engineer, you will play a pivotal role in ensuring the highest standards of quality in our digital transformation. Our Digital Technology Team provides top-tier products and services, and your expertise will be crucial in solving complex challenges...

  • Staff Data Engineer

    4 days ago

    Pune, Maharashtra, India Baker Hughes Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Staff Data EngineerAre you excited about the opportunity to contribute to an industry leader in Energy Technology? As a Staff Data Engineer, you will play a pivotal role in ensuring the highest standards of quality in our digital transformation. Our Digital Technology Team provides top-tier products and services, and your expertise will be crucial in solving...

  • Senior Data Scientist

    14 hours ago

    Pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the USA. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and...

  • Data Engineer Senior Consultant

    2 weeks ago

    Pune, India NTT Data Full time

    Job Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer Senior Consultant to join our team in Pune, Mahrshtra (IN-MH), India (IN). Location: | Experience: 5+...

  • Staff Data Platform Engineer(Dev Ops)

    15 hours ago

    Pune, India Zendesk Full time

    Job Description Staff Platform Engineer (DevOps) Our Enterprise Data & Analytics (EDA) is looking for an experienced Staff Data Platform Engineer to join our growing Platform engineering team. You’ll work in a collaborative Agile environment using the latest engineering best practices with involvement in all aspects of the software development lifecycle....

  • Senior Staff Software Engineer

    16 hours ago

    Pune, India Druva Full time

    About Druva Druva enables cyber, data and operational resilience for every organization with the Data Resiliency Cloud, the industry’s first and only at scale SaaS solution. Customers can radically simplify data protection, streamline data governance, and gain data visibility and insights as they accelerate cloud adoption. Druva pioneered a SaaS-based...

  • Senior Data Engineer

    3 weeks ago

    Pune, India AIQU Full time

    We are hiring for Senior Data Engineer to join one of our major clients based out of KSA.Job Details:Role: Senior Data EngineerWork Location: RemoteEmployment Type: Contract – 12 months & extendableRole Summary:The Senior Data Engineer plays a lead role in designing, building, optimizing, and governing data pipelines and architectures that power analytics,...

  • Senior Data Engineer

    3 weeks ago

    Pune, India AIQU Full time

    We are hiring for Senior Data Engineer to join one of our major clients based out of KSA.Job Details:Role: Senior Data EngineerWork Location: RemoteEmployment Type: Contract – 12 months & extendableRole Summary:The Senior Data Engineer plays a lead role in designing, building, optimizing, and governing data pipelines and architectures that power analytics,...