MonoSpear Technologies

Description :

About the Role :

We are seeking a skilled Data Engineer with strong expertise in SQL, SSIS (SQL Server Integration Services), and Azure Data Factory (ADF) to join our data engineering team.

The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines and ETL processes to support our data analytics and business intelligence initiatives.

You will work closely with data scientists, analysts, and business stakeholders to ensure data is accurate, timely, and accessible.

Key Responsibilities :

- Design, develop, and maintain end-to-end data pipelines using SQL, SSIS, and Azure Data Factory to extract, transform, and load data from various sources into data warehouses and data lakes.

- Develop, test, and deploy scalable ETL processes that support large volumes of data and complex business requirements.

- Collaborate with data architects and analysts to understand data requirements and translate them into technical designs.

- Optimize SQL queries and SSIS packages for performance and reliability.

- Implement data ingestion workflows using Azure Data Factory, including data movement, orchestration, and scheduling.

- Monitor data pipeline health and troubleshoot issues proactively to minimize downtime.

- Work with cloud data platforms, particularly Azure Synapse Analytics, Azure Data Lake Storage, and other Azure data services.

- Ensure data quality, consistency, and governance standards are maintained across all data processes.

- Collaborate with DevOps teams to automate deployments and manage CI/CD pipelines for data workflows.

- Document ETL processes, data flows, and pipeline configurations for maintenance and audit purposes.

- Stay updated with the latest developments in data engineering tools, cloud services, and best practices.

- Support ad-hoc data extraction and transformation requests from various teams.

Required Qualifications :

years of experience in data engineering or related roles.

- Strong proficiency in SQL and relational database concepts, including query optimization and performance tuning.

- Hands-on experience designing and developing ETL solutions using SSIS.

- Experience with cloud-based data integration tools, particularly Azure Data Factory (ADF).

- Familiarity with cloud data storage solutions such as Azure Data Lake Storage and Azure Blob Storage.

- Experience with data warehousing concepts and platforms such as Azure Synapse Analytics or SQL Server Data Warehouse.

- Knowledge of data modeling, schema design, and data governance best practices.

- Understanding of CI/CD pipelines and automation in the context of data workflows.

- Strong analytical, problem-solving, and communication skills.

- Bachelors degree in Computer Science, Information Systems, or related field