Staff/Senior Data Engineer

3 weeks ago

Pune Maharashtra India, Maharashtra HG Insights Full time

At HG Insights we provides AI-powered revenue growth intelligence and technology intelligence data to help B2B companies refine their go-to-market (GTM) strategies by analyzing market size, identifying potential customers, and uncovering in-market purchasing signals. With the recent acquisitions of MadKudu and TrustRadius, we’ve created an agentic GTM ecosystem that eliminates manual handoffs, guesswork, and siloed signals.

We’re searching for a strong Data Engineer to take this ecosystem to the next level. You’ll play a critical role in tackling high-impact projects, including large-scale data integration, improving and enriching intent signals, and building the foundational capabilities that will power our future AI initiatives. This is an opportunity to work with complex data pipelines at scale, shape the backbone of our intelligence platform, and directly influence how thousands of enterprise customers uncover growth opportunities.

What You Will Do

  • Build and maintain ETL pipelines using Apache Airflow in our kubernetes environment, processing 10M+ daily events from MongoDB to PostgreSQL and BigQuery
  • Design real-time data streaming architectures using Google Cloud Pub/Sub for visitor tracking, intent signals, and company resolution workflows
  • Develop ML data infrastructure for AI-powered features including vector embeddings, semantic search, and automated content generation using OpenAI and Google Vertex AI
  • Create analytics and reporting systems on BigQuery for customer intent data, lead scoring models, and business intelligence dashboards
  • Implement data quality and monitoring frameworks ensuring accuracy across the entire data pipeline from source to customer delivery
  • Build customer data delivery systems including Snowflake integration and API endpoints for enterprise data consumption

What You Will Be Responsible For

  • Data pipeline reliability with 99.9% uptime for critical business intelligence feeding customer-facing intent data products
  • Data accuracy and consistency across MongoDB → PostgreSQL → BigQuery → Snowflake transformation chains
  • ML infrastructure performance supporting real-time vector search, embedding generation, and AI model inference
  • Scalable data architecture handling exponential growth in visitor data and intent signals
  • Customer data SLAs ensuring timely delivery of intent data to enterprise customers with contractual requirements
  • Building Dashboards and alerting for management of these systems

What You Will Need

  • 9+ years data engineering with Python, SQL, and distributed data processing frameworks
  • Strong ETL/ELT experience with Apache Airflow, dbt, or similar orchestration tools
  • Cloud data platform expertise with BigQuery, Cloud Storage, and data warehouse optimization
  • Real-time streaming experience with Pub/Sub, Kafka, or similar event-driven systems
  • Database proficiency across PostgreSQL, MongoDB, and modern data warehouse technologies

Nice to Have

  • ML/AI pipeline experience with vector databases (Pinecone), embedding models, and LLM integration
  • Intent data and lead scoring domain knowledge in B2B marketing technology
  • Apache Beam or Dataflow for large-scale data processing
  • Customer analytics and behavioral data modeling experience

  • Staff Data Engineer

    3 weeks ago

    Pune, Maharashtra, India, Maharashtra Andor Tech Full time

    Are you passionate about building scalable, reliable, and production-ready data infrastructure? We’re looking for a Senior Data Engineer with a proven track record of designing, planning, and maintaining data platforms that power business-critical decisions. What You’ll Do: ✅ Design, construct, test, and maintain large-scale data management systems ✅...

  • Staff Data Engineer

    2 days ago

    Pune, Maharashtra, India Pattern Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Role Overview As a Staff Data Engineer, you'll be a technical leader and systems thinker within Pattern's Data Engineering team—designing and scaling our canonical data model to deliver trusted, high-quality data. You'll transform complex, raw data with a set of efficient pipelines into tables that are easy to understand and efficient to power analytics,...

  • Staff Data Engineer

    2 days ago

    Pune, Maharashtra, India Pattern Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Role Overview-As a Staff Data Engineer, you'll be a technical leader and systems thinker within Pattern's Data Engineering team—designing and scaling our canonical data model to deliver trusted, high-quality data. You'll transform complex, raw data with a set of efficient pipelines into tables that are easy to understand and efficient to power analytics,...

  • Senior Data Engineer

    2 weeks ago

    Pune, Maharashtra, India, Maharashtra RiDiK Full time

    We’re looking for a Senior Data Engineer to support our team in PAN India. This role offers the opportunity to work on meaningful projects, collaborate with talented colleagues, and contribute to the success of a growing company. If you’re someone who takes initiative, values continuous learning, and thrives in a collaborative setting, we’d love to...

  • Senior Data Engineer

    3 weeks ago

    Pune, Maharashtra, India, Maharashtra Hireologist Full time

    Job Title: Big Data EngineerLocation: Pune (Hybrid)Experience - 5-7 YOESalary Range: ₹35–40 LPAAbout the RoleWe are looking for a Big Data Engineer to design, build, and scale high-performance data pipelines that power our products and insights. You’ll be working closely with product managers, architects, and engineering leads to define technical...

  • Senior Data Engineer

    2 weeks ago

    Pune, Maharashtra, India, Maharashtra MSBC Group Full time

    As a Data Engineer, your primary role is to create and maintain high-performance data pipelines, warehouses, and cloud-based systems. This includes creating efficient batch and streaming pipelines, using Snowflake for scalable data warehousing, and leveraging AWS for cloud development. You will work with an agile team to ensure the reliability and accuracy...

  • Senior Data Engineer( DWH)

    2 weeks ago

    Pune, Maharashtra, India, Maharashtra Mastercard Full time

    Title and SummarySenior Data EngineerJob Description SummarySenior Data Engineer (DW)Mastercard is a global technology company in the payments industry. Our mission is to connect and power an inclusive, digital economy that benefits everyone, everywhere by making transactions safe, simple, smart, and accessible. Using secure data and networks, partnerships...

  • Senior/Staff Machine Learning Engineer

    3 weeks ago

    Pune, Maharashtra, India, Maharashtra HG Insights Full time

    About HG InsightsHeadquartered in Santa Barbara, California, HG Insights is the global leader in technology intelligence. We help the world’s most innovative companies accelerate their go-to-market efforts with precision through advanced data science methodologies and proprietary data assets. We offer a culture that blends innovation, collaboration, and...

  • Data Engineer

    4 days ago

    Pune, Maharashtra, India Data Axle Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    About Data Axle:Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging proprietary...

  • Senior Staff Software Engineer

    7 hours ago

    Pune, Maharashtra, India Osmos Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Who We Are:Osmos, a B2B SaaS company founded by ex-Amazon ad-tech experts, is revolutionizing retail media with an AI-powered operating system that increases retailer profitability (by up to 7% of sales) and delivers superior ROAS for brands. By enabling Tier 1 retailers and marketplaces worldwide to activate more brands and leverage advanced targeting, we...