ETL Architect
1 week ago
Summary: ETL Architect (10+ Years Experience)
We are seeking an experienced
ETL Tech Lead
to oversee and drive data migration, integration, and pipeline development projects. This role involves leading the migration of on-premise databases (Oracle, SQL Server) to AWS cloud platforms such as Redshift and S3, ensuring seamless integration across diverse systems. The ideal candidate will design and optimize robust ETL/ELT workflows, leveraging tools like Informatica, AWS Glue, and custom Python solutions, while maintaining data quality and governance. Additionally, the role requires expertise in building scalable data architectures using AWS services, managing automated workflows with Apache Airflow, and mentoring junior engineers. A strong background in SQL, Python, and AWS cloud infrastructure is essential, with a focus on driving high-performance data operations aligned with business objectives.
About the Role
Data Migration & Integration: Lead data migration projects to move on-premise data (Oracle, SQL Server) to AWS cloud-based solutions (Redshift, S3, RDS). Coordinate end-to-end processes for seamless data transfers and integrations across platforms.Data Ingestion & Pipelines: Design, implement, and maintain robust, scalable data ingestion pipelines to integrate structured and unstructured data from various sources into cloud-based platforms like AWS. Use tools like Informatica, Apache Airflow, or custom Python solutions.Cloud Infrastructure (AWS): Develop cloud-native data architectures using AWS services (e.g., Redshift, S3, Glue, Lambda, RDS, and Athena). Optimize data storage, processing, and retrieval in AWS to meet performance and cost efficiency goals.ETL/ELT Development: Build and optimize ETL/ELT processes using tools like Informatica, AWS Glue, AWS Transfer Family and custom Python-based solutions. Ensure data flows are automated, efficient, and scalable.Automation & Workflow Orchestration: Implement and manage workflow orchestration with Apache Airflow to automate and schedule ETL tasks, ensuring reliable data delivery to target systems.Collaborate with Stakeholders: Work closely with business users, analysts, and other engineering teams to understand data requirements, propose data solutions, and ensure alignment with business goals. Translate business needs into technical solutions.Data Quality & Governance: Ensure data quality, integrity, and compliance with governance policies. Implement monitoring and logging to ensure pipeline health and detect anomalies or issues proactively.Mentoring & Leadership: Mentor and guide junior data engineers, helping them grow in their technical skills and best practices. Promote a culture of continuous learning and high performance.Performance Tuning & Optimization: Continuously monitor and optimize data pipeline performance, troubleshoot issues, and apply best practices for improving query performance and data processing times.
Skills (Must have) :
Experience with Data Migrations: Proven track record of handling large-scale data migrations, particularly from on-premise databases (e.g., Oracle, SQL Server) to cloud platforms like AWS.Cloud Platforms (AWS): Strong hands-on experience with AWS services including S3, Redshift, RDS, Lambda, Glue, and Athena. Familiarity with AWs Transfer Family, AWS Data Pipeline and AWS DMS (Database Migration Service) is a plus.ETL/ELT Tools: Extensive experience with ETL/ELT tools like Informatica, AWS Glue, or Apache NiFi, as well as custom Python scripts for data transformations and data workflows.Python Programming: Advanced proficiency in Python, including experience with libraries such as Pandas, NumPy, and PySpark for data processing and transformations. Experience in writing efficient, scalable code is essential.Apache Airflow: Proficiency in Apache Airflow for building, scheduling, and managing data workflows and pipeline automation.SQL & Database Skills: Strong experience with relational databases like Oracle, SQL Server, and cloud databases like Amazon Redshift or RDS. Familiarity with writing complex SQL queries and optimizing them for large-scale data processing.Data Modeling & Warehousing: Solid understanding of data modeling techniques (e.g., star schema, snowflake schema) and experience with data warehousing solutions, particularly in the cloud (AWS Redshift, Snowflake, etc.).Data Integration: Experience integrating data from various sources (databases, APIs, flat files, etc.), and managing large-scale data ingestion pipelines.Data Quality & Governance: Experience implementing data quality checks, error handling, and monitoring for data pipelines. Familiarity with data governance best practices for compliance and security.Version Control & CI/CD: Experience with version control (e.g., Git) and CI/CD practices for managing code and automating data workflows. Familiarity with Jenkins, GitLab CI, or other tools is a plus.
Skills (Good to Have) :
Financial Services/Capital Markets Experience: Experience working with financial data, including market data, transaction data, risk data, or financial reporting and working with financial data vendors such as Bloomberg, Refinitiv, Morningstar, Barclays.Big Data Technologies: Experience with Big Data tools and frameworks like Hadoop, Spark, or Kafka is a plus, particularly in a cloud-based environment (AWS EMR, AWS Kinesis, etc.).Data Security & Compliance: Knowledge of best practices for securing data, particularly in financial services, including encryption, data masking, and managing sensitive information in cloud environments.Leadership Experience: For Lead roles, experience managing or mentoring a team of data engineers, guiding architecture decisions, and driving process improvements.
Education and Certifications:
Bachelor’s degree in Computer Science, Engineering, Data Science, or a related field (or equivalent experience).Certifications in AWS (e.g., AWS Certified Data Analytics – Specialty, AWS Certified Solutions Architect – Associate/Professional) are highly desirable.Additional certifications in data engineering, databases, or cloud platforms would be beneficial.
-
ETL Architect
1 week ago
Gurgaon, India Gemini Solutions Pvt Ltd Full timeAbout the Company : Gemini Solutions is a global IT consulting firm and a leading offshore outsourcing company with an expertise in BFSI domain. Founded and owned by IIT Delhi and IIIT Hyderabad alumni. We have expertise across each part of the entire Software Development Life Cycle - Development, Quality Assurance, 24x7 DevOps and also...
-
Etl architect
1 week ago
Gurgaon, India Gemini Solutions Pvt Ltd Full timeAbout the Company : Gemini Solutions is a global IT consulting firm and a leading offshore outsourcing company with an expertise in BFSI domain. Founded and owned by IIT Delhi and IIIT Hyderabad alumni. We have expertise across each part of the entire Software Development Life Cycle - Development, Quality Assurance, 24x7 Dev Ops and also...
-
Data Architect for Workday Adaptive ETL
15 hours ago
Gurgaon, Haryana, India SysTechCorp Inc Full timeJob DescriptionSysTechCorp Inc is seeking a highly skilled Data Architect to join our team. As a Data Architect, you will be responsible for designing and developing data integration solutions using Workday Adaptive tools and technologies.Key Responsibilities:Design and develop data integration solutions using Workday Adaptive tools and...
-
High Salary: ETL Architect
1 week ago
Gurgaon, India Gemini Solutions Pvt Ltd Full timeAbout the Company: Gemini Solutions is a global IT consulting firm and a leading offshore outsourcing company with an expertise in BFSI domain. Founded and owned by IIT Delhi and IIIT Hyderabad alumni. We have expertise across each part of the entire Software Development Life Cycle - Development, Quality Assurance, 24x7 DevOps and also Infrastructure/Managed...
-
Etl iics/ idmc specialist
20 hours ago
Gurgaon, India Axtria - Ingenious Insights Full timeJob Role: ETL Technical Lead ELIGIBILITY CRITERIA: Work Experience: Overall 5+ years of experience working on Databases, Data Warehouse, Data Integration and BI/Reporting solutions with relevant experience in Lifesciences/Pharma domain. Technical: Design and implement effective database solutions and data models to store and retrieve data. ...
-
gurgaon, India Gemini Solutions Pvt Ltd Full timeAbout the Company : Gemini Solutions is a global IT consulting firm and a leading offshore outsourcing company with an expertise in BFSI domain. Founded and owned by IIT Delhi and IIIT Hyderabad alumni. We have expertise across each part of the entire Software Development Life Cycle - Development, Quality Assurance, 24x7 DevOps and also...
-
Etl iics/ idmc specialist
1 week ago
Gurgaon, India Axtria - Ingenious Insights Full timeJob Role: ETL Technical LeadELIGIBILITY CRITERIA:Work Experience: Overall 5+ years of experience working on Databases, Data Warehouse, Data Integration and BI/Reporting solutions with relevant experience in Lifesciences/Pharma domain.Technical:Design and implement effective database solutions and data models to store and retrieve data.Hands on experience in...
-
Data Visualization and ETL Expert
3 weeks ago
Gurgaon, Haryana, India IGT Solutions Full timeAbout IGT SolutionsIGT Solutions is a leading customer experience (CX) company that leverages digital technologies to deliver transformative experiences for global brands across the travel and high-growth tech industries.We have a global delivery footprint, spanning 30+ locations worldwide, with a team of 25,000+ CX and technology experts from diverse...
-
Data Architect
1 day ago
Gurgaon, Haryana, India Drimlite Full timeJob Title : Data ArchitectLocation : Not applicableExperience : 3-5 years of experienceBudget : 24 LPAWork Mode : RemoteInterview Mode : VirtualMust-Have Skills : Designing data pipelines, data engineering, ETL processes, Azure DevOps, PySparkJob Description :We are seeking a skilled Data Architect to design, develop, and maintain data architectures and ETL...
-
Solutions Architect
4 weeks ago
gurgaon, India Valiance Solutions Full timeAbout Us:Valiance is a niche AI consulting firm specializing in AI, Data Engineering, and Cloud Platforms, delivering cutting-edge solutions to clients in the US and India. We are seeking an experienced Solution Architect to lead and architect diverse business intelligence, data warehousing, and AI projects while ensuring timely and successful delivery.Role...
-
Associate Consultant
1 week ago
Pune/Noida/Gurgaon/Gurugram, India Spectral Consultants Full timeRoles and Responsibilities :Requirement Analysis : - Understand the ETL requirements and data flow from source to target.- Collaborate with business analysts and stakeholders to gather testing requirements.Test Planning : - Develop a comprehensive test plan that outlines the scope, objectives, resources, schedule, and testing strategy for the ETL...
-
Highly Skilled Data Architect
1 day ago
Gurgaon, Haryana, India IGT Solutions Full timeIGT Solutions is seeking a highly skilled Data Architect to join our team. The ideal candidate will have 7+ years of experience in designing, developing, and maintaining robust and scalable ETL processes, databases, and data marts.About the RoleThe successful candidate will work closely with other members of the data team to ensure data integrity, quality,...
-
Enterprise Data Architect
1 day ago
Gurgaon, Haryana, India Fractal Full timeJob OverviewFractal is seeking a skilled Enterprise Data Architect to design and manage data architecture for our Enterprise Analytics Ecosystem. The ideal candidate will have strong knowledge of Data Warehousing, Dimensional Modeling, Star and Snowflake Schema, ETL, and database design principles.About the RoleAs an Enterprise Data Architect, you will be...
-
Senior Systems Architect
3 weeks ago
Gurgaon, Haryana, India Quadrant Technologies Full timeJob SummaryQuadrant Technologies is seeking a highly skilled Senior Systems Architect to lead the design and implementation of our data platforms. The ideal candidate will have a strong background in Big Data and cloud technologies, with a proven track record of conceiving, designing, and developing scalable data systems.Key ResponsibilitiesDesign and...
-
Senior Data Architect
1 week ago
Gurgaon, Haryana, India Techno Wise Full timeJob Title: Senior Data Architect - Snowflake ExpertAt Techno Wise, we're seeking a highly skilled Senior Data Architect to lead our Snowflake development efforts. As a key member of our data team, you'll design and implement optimized data models in Snowflake to meet business requirements.Key Responsibilities:Data Modeling: Develop and maintain complex data...
-
Data Virtualization Architect
15 hours ago
Gurgaon, Haryana, India GSS HR Solutions Pvt Ltd Full timeWe are seeking a seasoned Data Virtualization Architect to join our dynamic team at GSS HR Solutions Pvt Ltd in Bangalore/Gurgaon.About the Role:The ideal candidate will play a pivotal part in designing, developing, and implementing innovative data virtualization solutions using Denodo Platform.Your expertise in Denodo will be instrumental in streamlining...
-
Data Engineering Architect
1 month ago
Gurgaon, Haryana, India UnitedHealth Group Full timeAt UnitedHealth Group, we strive to create a culture guided by diversity and inclusion, where talented peers collaborate to improve health outcomes. As a Data Engineering Architect, you will play a critical role in developing innovative solutions that connect people with the care, pharmacy benefits, and resources they need to thrive. Your expertise will...
-
Azure Databricks Engineer
5 hours ago
Gurgaon/Gurugram, India Arrixa Full timeKey Responsibilities :- Data Pipeline Development : Design, develop, and optimize data pipelines and workflows in Azure Databricks for ETL/ELT processing, data transformation, and analytics. - Big Data Solutions : Architect and implement big data solutions using Azure Databricks, Spark, Azure Data Lake, and other Azure data services. - Data Integration :...
-
Cloud Data Architect
5 days ago
Gurgaon, Haryana, India IGT Solutions Full timeAbout the Role:As a seasoned Cloud Data Architect at IGT Solutions, you will play a pivotal role in designing and developing cutting-edge data engineering solutions using Azure Databricks. With a strong focus on scalability and efficiency, you will lead the development of ETL/ELT pipelines, leveraging your expertise in Python, PySpark, and Azure services.Key...
-
Senior Cloud Architect
3 weeks ago
Gurgaon, Haryana, India Invokhr Full timeJob DescriptionWe are seeking a highly skilled Senior Cloud Architect to join our team at Invokhr. This is a challenging and rewarding opportunity for experienced professionals who want to drive business success.About the RoleThis role will lead the development of cloud-based solutions, leveraging Informatica Intelligent Cloud Services (IICS) to deliver...
