Azure Data Engineer – Business Intelligence Operations Lead

Pune

About Us

We empower enterprises globally through intelligent, creative, and insightful services for data integration, data analytics and data visualization.

Hoonartek is a leader in enterprise transformation, data engineering and an acknowledged world-class Ab Initio delivery partner.

Using centuries of cumulative experience, research and leadership, we help our clients eliminate the complexities & risk of legacy modernization and safely deliver big data hubs, operational data integration, business intelligence, risk & compliance solutions and traditional data warehouses & marts.

At Hoonartek, we work to ensure that our customers, partners and employees all benefit from our unstinting commitment to delivery, quality and value. Hoonartek is increasingly the choice for customers seeking a trusted partner of vision, value and integrity

How We Work?

Define, Design and Deliver (D3) is our in-house delivery philosophy. It's culled from agile and rapid methodologies and focused on 'just enough design'. We embrace this philosophy in everything we do, leading to numerous client success stories and indeed to our own success.

We embrace change, empowering and trusting our people and building long and valuable relationships with our employees, our customers and our partners. We work flexibly, even adopting traditional/waterfall methods where circumstances demand it. At Hoonartek, the focus is always on delivery and value.

Job Description

Job Responsibilities:

1. Collaborating with stakeholders and CXOs, understanding source data, and translating new business requirements into technical solutions using Databricks / Azure Synapse and Azure Data Factory.

2. Designing, implementing, and managing end-to-end ETL/ELT processes for MIS automations, new system integrations, Streaming data ingestion using Delta Live tables

3. Cost Estimation / Optimization / Controls of Data Engineering cloud solutions – new and existing

4. Datalake governance, Data purging / Archival policy design and implementation

5. Development experience in Qlik & Power BI to guide team for Advance analytics scenarios – Bucketing /Time Series/Forecasting/Correlation/Time Intelligence functions/ What-If / Hierarchical data handling

6. Change management – technically review of existing Data pipelines, SQL & Python code, Data Visualizations in Qlik & Power BI for potential issues and deliver change request, through planning and due approval of Change Request through Change Approval Borad

7. Estimation and delivery of adhoc and scheduled data pipelines processing high volume structured and unstructured data.

8. Supervision, accuracy review and delivery of all adhoc data requirements

9. Setup Proactive ETL Monitoring and troubleshooting ETL issues would be active parts the role.

10. Ensuring compliance with data governance and data security/masking standards for data delivery

11. Planning and overseeing execution DR drill of BI data platform

12. Ensure developments follow standard coding patterns, are fully documented for audit submissions.

13. Able to communicate, plan and execute BI platform Audit with internal audit team.

Competencies for the job

1) Proven experience with big data solution design and development in Databricks, notebooks & schema design, development, best practice and notebooks Azure Dev Ops / CI-CD Pipelines

2) Hands On in Python PySpark, Spark SQL, Delta Live + Kafka; Azure SQL DB, Azure Data Factory, Azure DataBricks, Azure Synapse, Azure Data Lake, Delta, Pyspark, Python, Logic Apps, Azure DevOps, CI/CD implementation, Power BI / QlikSense, Blob Storage, ADLS, Azure Key Vault, ETL, SSIS

3) Experience in Query Development, Performance Tuning and loading data to Databricks SQL DW

4) Experience in data ingestion into ADLS, Azure Blob Storage, Azure Logic Apps

5) Practical knowledge of data warehouse implementation – denormalization, conformance, fact, dimensions

6) Good knowledge of data visualizations best practices using either or both QlikSense and Power BI - for Advance analytics scenarios – Bucketing / Time Series / Forecasting / Correlation / Time Intelligence functions/ What-If / Hierarchical data handling

Desired Experience:

years of experience in Azure Data & Analytics core skills.

2) Experience of BI Technical PM role

3) Excellent communication skills in written and verbal English

4) Knowledge of core functions of a large NBFC/Bank – Sales, Credit, Collections, Finance and Accounts