Staff/Senior Data Engineer
2 weeks ago
At HG Insights we provides AI-powered revenue growth intelligence and technology intelligence data to help B2B companies refine their go-to-market (GTM) strategies by analyzing market size, identifying potential customers, and uncovering in-market purchasing signals. With the recent acquisitions of MadKudu and TrustRadius, we’ve created an agentic GTM ecosystem that eliminates manual handoffs, guesswork, and siloed signals.We’re searching for a strong Data Engineer to take this ecosystem to the next level. You’ll play a critical role in tackling high-impact projects, including large-scale data integration, improving and enriching intent signals, and building the foundational capabilities that will power our future AI initiatives. This is an opportunity to work with complex data pipelines at scale, shape the backbone of our intelligence platform, and directly influence how thousands of enterprise customers uncover growth opportunities.What You Will DoBuild and maintain ETL pipelines using Apache Airflow in our kubernetes environment, processing 10M+ daily events from MongoDB to PostgreSQL and BigQueryDesign real-time data streaming architectures using Google Cloud Pub/Sub for visitor tracking, intent signals, and company resolution workflowsDevelop ML data infrastructure for AI-powered features including vector embeddings, semantic search, and automated content generation using OpenAI and Google Vertex AICreate analytics and reporting systems on BigQuery for customer intent data, lead scoring models, and business intelligence dashboardsImplement data quality and monitoring frameworks ensuring accuracy across the entire data pipeline from source to customer deliveryBuild customer data delivery systems including Snowflake integration and API endpoints for enterprise data consumptionWhat You Will Be Responsible ForData pipeline reliability with 99.9% uptime for critical business intelligence feeding customer-facing intent data productsData accuracy and consistency across MongoDB → PostgreSQL → BigQuery → Snowflake transformation chainsML infrastructure performance supporting real-time vector search, embedding generation, and AI model inferenceScalable data architecture handling exponential growth in visitor data and intent signalsCustomer data SLAs ensuring timely delivery of intent data to enterprise customers with contractual requirementsBuilding Dashboards and alerting for management of these systemsWhat You Will Need9+ years data engineering with Python, SQL, and distributed data processing frameworksStrong ETL/ELT experience with Apache Airflow, dbt, or similar orchestration toolsCloud data platform expertise with BigQuery, Cloud Storage, and data warehouse optimizationReal-time streaming experience with Pub/Sub, Kafka, or similar event-driven systemsDatabase proficiency across PostgreSQL, MongoDB, and modern data warehouse technologiesNice to HaveML/AI pipeline experience with vector databases (Pinecone), embedding models, and LLM integrationIntent data and lead scoring domain knowledge in B2B marketing technologyApache Beam or Dataflow for large-scale data processingCustomer analytics and behavioral data modeling experience
-
Staff Data Engineer
5 days ago
bangalore, India Commonwealth Bank Full timeOrganization:At CommBank, we never lose sight of the role we play in other people’s financial wellbeing. Our focus is to help people and businesses move forward to progress. To make the right financial decisions and achieve their dreams, targets, and aspirations. Regardless of where you work within our organisation, your initiative, talent, ideas, and...
-
Senior Staff Engineer
4 days ago
bangalore, India Antal International Full time📌 Hiring: Senior Staff Engineer – Customer Experience Platform📍 Bangalore | HybridJoin a fast-growing tech company building AI-powered platforms that redefine real-world customer experiences across mobility, aviation, and fleet.Tech Stack: Scala/Java, PostgreSQL/MySQL, AWS🛠️ Role Highlights:Lead technical vision and roadmap for customer-facing...
-
Staff Data Engineer
3 days ago
Bangalore, India Commonwealth Bank Full timeOrganization: At CommBank, we never lose sight of the role we play in other people’s financial wellbeing. Our focus is to help people and businesses move forward to progress. To make the right financial decisions and achieve their dreams, targets, and aspirations. Regardless of where you work within our organisation, your initiative, talent, ideas, and...
-
Staff Data Engineer
4 days ago
bangalore, India Commonwealth Bank Full timeOrganization: At CommBank, we never lose sight of the role we play in other people’s financial wellbeing. Our focus is to help people and businesses move forward to progress. To make the right financial decisions and achieve their dreams, targets, and aspirations. Regardless of where you work within our organisation, your initiative, talent, ideas, and...
-
Senior Staff Engineer
4 days ago
bangalore, India Antal International Full timeHiring: Senior Staff Engineer – Customer Experience Platform Bangalore | Hybrid Join a fast-growing tech company building AI-powered platforms that redefine real-world customer experiences across mobility, aviation, and fleet. Tech Stack: Scala/Java, PostgreSQL/MySQL, AWS
-
Senior Staff Engineer
3 days ago
bangalore, India Antal International Full timeHiring: Senior Staff Engineer – Customer Experience Platform Bangalore | Hybrid Join a fast-growing tech company building AI-powered platforms that redefine real-world customer experiences across mobility, aviation, and fleet. Tech Stack: Scala/Java, PostgreSQL/MySQL, AWS
-
Senior Staff Engineer
3 days ago
bangalore district, India Antal International Full time📌 Hiring: Senior Staff Engineer – Customer Experience Platform 📍 Bangalore | Hybrid Join a fast-growing tech company building AI-powered platforms that redefine real-world customer experiences across mobility, aviation, and fleet. Tech Stack: Scala/Java, PostgreSQL/MySQL, AWS 🛠️ Role Highlights: Lead technical vision and roadmap for...
-
Senior Data Engineer
5 days ago
bangalore, India LogixHealth Full timeJob Title: Senior Data EngineerLocation: Bengaluru/CoimbatoreJob Type: Full-TimeImmediate joiners or notice period of less than 10days are needed.Job Role:As a Senior Data Engineer at LogixHealth, you will work with a globally distributed team of engineers to design and build cutting-edge solutions that directly improve the healthcare industry. You’ll...
-
Senior DevOps Engineer
4 days ago
bangalore, India Crest Data Full timeCompany Overview: Crest Data is the global leading provider of Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services. With a clientele that includes several Fortune 500 corporations and some of the innovative Silicon Valley Startups. Company URL : Job Location - Ahmedabad Job...
-
Senior DevOps Engineer
3 days ago
bangalore, India Crest Data Full timeCompany Overview: Crest Data is the global leading provider of Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services. With a clientele that includes several Fortune 500 corporations and some of the innovative Silicon Valley Startups. Company URL : Job Location - Ahmedabad Job...
