Senior Business Intelligence Engineer

Job Title: Senior Business Intelligence Engineer
Department: Analytics
About Us
At HG Insights, we lead the way in technology intelligence, delivering AI-driven insights through advanced data science and scalable big data architecture. Our Big Data Insights Platform ingests and processes billions of unstructured records, fueling a robust data lake that powers analytics and reporting for strategic decision-making. As a BI Engineer, you'll work with high-volume data pipelines, model datasets for business consumption, and help transform raw data into meaningful insights that drive enterprise outcomes. Join us to shape the future of B2B intelligence through data.

What You'll Do:

• Develop dashboards, reporting tools, and real-time metrics to monitor business performance.
• Ensure data quality, integrity, and security across all data assets.
• Develop and optimize data solutions using Python for data manipulation, automation, and analytics.
• Build and manage robust ETL processes using industry-standard tools and frameworks.
• Write advanced SQL queries for data extraction, aggregation, and analysis across large, complex datasets.
• Model, warehouse, and manage data in relational databases (RDBMS) and cloud data warehouses (e.g., Snowflake, Databricks).
• Apply agile methodologies to manage project workflows, foster cross-functional collaboration, and adapt to changing business needs.
• Utilize version control systems (e.g., Git) for code management and collaboration.
• Stay current with emerging technologies and industry best practices in data engineering and business intelligence.

What You'll Be Responsible For

• Drive end-to-end delivery of data and analytics projects, from requirements gathering to deployment and ongoing optimization, ensuring projects are completed on time and within scope.
• Collaborate with legal, privacy, security, and business stakeholders to align data management practices with organizational and regulatory requirements.
• Design, implement, and maintain scalable data pipelines and ETL workflows to extract, transform, and load data from diverse sources.
• Establishing and maintaining comprehensive data governance and compliance frameworks to ensure data quality, integrity, security, and regulatory compliance.

What You'll Need

• Bachelor's or Master's degree in Computer Science, Engineering, Information Systems, or a related field.
• 5+ years of professional experience in business intelligence, data engineering, or analytics roles.
• Proficiency in Python for data processing and automation.
• Advanced SQL skills and experience with relational databases (e.g., PostgreSQL, MySQL, SQL Server, Oracle).
• Hands-on experience with ETL tools and frameworks (e.g., Airflow, dbt).
• Experience working with big data technologies, including Snowflake and Databricks.
• Strong understanding of data modeling, warehousing concepts, and best practices.
• Demonstrated experience establishing and maintaining data governance and compliance frameworks, including data quality, security, and regulatory compliance.
• Proven ability to drive end-to-end data and analytics projects, including requirements gathering, development, deployment, and optimization.
• Experience working in agile environments and applying agile project management principles.
• Experience with cloud platforms, with a preference for AWS (e.g., S3, Redshift, EC2, DynamoDB).
• Familiarity with code versioning tools such as Git.
• Demonstrated ability to work cross-functionally and communicate technical concepts to non-technical stakeholders.
• Strong problem-solving skills and attention to detail.

Preferred Qualifications

• Knowledge of data visualization tools (e.g., Tableau, Power BI, Quicksight).
• Familiarity with containerization (Docker, Kubernetes) and CI/CD pipelines.
• Exposure to streaming data technologies (Kafka, Spark Streaming).
• Experience with statistical analysis, forecasting, and A/B testing.
• Knowledge of data security and privacy best practices in cloud environments.
• Experience using Hex notebooks for collaborative analytics, data science workflows, and building interactive data apps is a plus
• Experience using or implementing AI-based solutions to solve business problems and drive projects forward.

Soft Skills

• Excellent communication and interpersonal skills.
• Ability to thrive in a fast-paced, ambiguous, and evolving environment.
• Self-starter with a strong bias for action and ownership.