Data Solution Architect

Company Description

The current opening is for one of our client which is a leading IT Consulting and services company in healthcare domain.

Role Description :

This is a full-time hybrid role for a Data Architect with Python and AWS at Anlage HRO Services in Pune. The Data Architect will be responsible for data governance, data architecture, data modeling, ETL processes, and data - 16 - 20 yrs

Job Summary :

We are seeking a highly skilled Data Architect with extensive experience in Python programming and AWS cloud technologies to design, implement, and manage scalable, secure, and efficient data systems. The ideal candidate will work closely with stakeholders to create robust data architectures, manage big data pipelines, and ensure seamless data integration across various platforms.

Key Responsibilities :

Design and Architect Data Solutions:

- Lead the design and implementation of large-scale data systems, ensuring scalability, security, and performance.

- Architect data models, database structures, and data pipelines tailored to business needs.

- Design and implement data integration processes from various data sources (e.g., databases, APIs, etc.).

Python Programming :

- Develop data pipelines using Python and frameworks such as Pandas, PySpark, or similar.

- Write efficient, reusable, and scalable Python code for data extraction, transformation, and loading

(ETL) processes.

AWS Cloud Solutions :

- Leverage AWS services (e.g., S3, Redshift, Lambda, EMR, Glue, RDS) to build cloud-based data solutions.

- Implement data storage solutions in AWS, including but not limited to data lakes and data warehouses.

- Manage data security, access control, and compliance on the AWS platform.

Data Governance and Quality :

- Ensure data quality, integrity, and consistency across all data systems and platforms.

- Define data governance standards and ensure data privacy and compliance (GDPR, HIPAA, etc.).

Collaboration and Leadership :

- Collaborate with data scientists, data engineers, and other stakeholders to understand data

requirements and design appropriate solutions.

- Provide mentorship and technical leadership to junior team members.

Performance Optimization :

- Optimize data pipelines for performance and cost efficiency, particularly when working with large-scale data sets in AWS.

- Troubleshoot and resolve any data-related issues promptly to minimize downtime and ensure smooth data flows.

Required Skills & Qualifications :

Experience :

- 5+ years of experience as a Data Architect or similar role in the data engineering domain.

- Strong experience in Python programming, with a focus on data engineering, ETL processes, and

automation.

- Extensive experience working with AWS data services such as S3, Redshift, Glue, Lambda, EMR, and RDS.

- Hands-on experience with designing and managing data lakes and data warehouses in AWS.

Technical Expertise :

- In-depth knowledge of data modeling (relational, dimensional, NoSQL) and database architecture.

- Proficient in SQL and database management, including query optimization.

- Familiarity with big data technologies (e.g., Spark, Hadoop).

- Experience with ETL tools (e.g., AWS Glue, Apache Airflow) for data integration and transformation.

Cloud & Infrastructure :

- Strong understanding of cloud architecture and best practices for designing scalable and cost-efficient systems in AWS.

- Knowledge of AWS serverless technologies (Lambda, API Gateway) is a plus.

Soft Skills :

- Strong problem-solving skills and ability to troubleshoot complex data-related issues.

- Excellent communication skills, with the ability to explain technical concepts to non-technical

stakeholders.

- Ability to work effectively in a fast-paced, collaborative team environment.

Please Note : - We are looking for candidates who can join in a very short notice as it is for a critical project.