Quantiphi - Azure Data Engineer - Data Migration

Job Location : Mumbai, Bangalore, Trivandrum.

Experience Level : 3+ years of experience.

Job Role : Senior Data Engineer Azure.

We are looking for an experienced Azure Data Engineer with a strong background in data migration, particularly in transitioning workloads from other cloud platforms/on-prem to Microsoft Azure. As a key member of our technology consulting team, you will play a pivotal role in designing and implementing data solutions on Azure for our clients.

Must have skills :

- Profound knowledge and expertise in Microsoft Azure, including Azure Data services like Azure SQL Database, Azure Data Lake Storage, Azure Synapse, Azure Databricks, Azure Data Factory etc.

- Strong skills in data modeling to design efficient and scalable data solutions.

- Proficiency in data integration techniques, ETL processes, and data pipeline development using Azure services.

- In-depth understanding of data governance principles, data security, and compliance requirements (i.e., GDPR, HIPAA), and the ability to implement these in Azure environments.

- Experience with database management systems, both relational and NoSQL, and the ability to choose the right storage solutions for different data types.

- Proficiency in SQL for querying and working with relational databases, as well as knowledge of NoSQL databases.

- Familiarity with data analysis tools and reporting platforms such as Power BI, Tableau, or similar.

- Strong programming skills in languages like Python, Java, or C# for scripting, automation, and data manipulation.

- The ability to manage data-related projects, work collaboratively with cross-functional teams, and meet project deadlines.

- Strong documentation skills and excellent communication skills for conveying complex technical concepts to non-technical stakeholders.

Good to have skills :

- Relevant Microsoft Azure certifications, such as Azure Data Engineer or Azure Solutions Architect, can enhance your credibility.

- Knowledge of big data technologies like Hadoop and Spark for handling large datasets.

- Good to have experience in Snowflake.

- Familiarity with machine learning concepts and Azure Machine Learning for implementing data-driven models.

- Experience with DevOps practices and continuous integration/continuous deployment (CI/CD) pipelines for data solutions.

- Understanding of real-time data processing and streaming technologies, such as Azure Stream Analytics.

- Skills in advanced analytics, data mining, and statistical analysis is a good to have.

Role & Responsibilities :

- Developing the data integration solutions to bring data from various sources into Azure, ensuring data quality and consistency.

- Choosing and implementing appropriate Azure data storage solutions for different data types and optimizing for performance and cost.

- Implementing data processing solutions using Azure services, optimizing for performance and scalability.

- Executing data migration projects, including migrations from on-premises environments to Azure and between different cloud platforms.

- Establishment and enforcement of data governance policies, ensuring data is compliant with regulations and industry standards.

- Monitoring data solutions for performance and cost, making necessary adjustments for optimization.

- Create data models as per client solution needs.

- Documentation for data architecture and solutions.

- Collaboration with cross-functional teams, including data engineers, data scientists, and business stakeholders, to ensure data solutions meet business needs.

- Adhering to project timelines.

- Communicate with non-technical stakeholders to understand their data requirements and convey the benefits of data solutions, including migration strategies.