ETL Architect

2 weeks ago

Gurugram, India Gemini Solutions Pvt Ltd Full time

About the Company : Gemini Solutions is a global IT consulting firm and a leading offshore outsourcing company with an expertise in BFSI domain. Founded and owned by IIT Delhi and IIIT Hyderabad alumni. We have expertise across each part of the entire Software Development Life Cycle - Development, Quality Assurance, 24x7 DevOps and also Infrastructure/Managed Services. Today we can boast of experts in 60+ technologies who have successfully delivered globally distributed projects including but not limited to application development, legacy to cloud migrations, tech stack transitions, capacity planning & infrastructure support and end-to-end implementations. Take a sneak peek at our culture here:


Position Summary: ETL Architect (10+ Years Experience)


We are seeking an experienced ETL Tech Lead to oversee and drive data migration, integration, and pipeline development projects. This role involves leading the migration of on-premise databases (Oracle, SQL Server) to AWS cloud platforms such as Redshift and S3, ensuring seamless integration across diverse systems. The ideal candidate will design and optimize robust ETL/ELT workflows, leveraging tools like Informatica, AWS Glue, and custom Python solutions, while maintaining data quality and governance. Additionally, the role requires expertise in building scalable data architectures using AWS services, managing automated workflows with Apache Airflow, and mentoring junior engineers. A strong background in SQL, Python, and AWS cloud infrastructure is essential, with a focus on driving high-performance data operations aligned with business objectives.


About the Role


  • Data Migration & Integration: Lead data migration projects to move on-premise data (Oracle, SQL Server) to AWS cloud-based solutions (Redshift, S3, RDS). Coordinate end-to-end processes for seamless data transfers and integrations across platforms.
  • Data Ingestion & Pipelines: Design, implement, and maintain robust, scalable data ingestion pipelines to integrate structured and unstructured data from various sources into cloud-based platforms like AWS. Use tools like Informatica, Apache Airflow, or custom Python solutions.
  • Cloud Infrastructure (AWS): Develop cloud-native data architectures using AWS services (e.g., Redshift, S3, Glue, Lambda, RDS, and Athena). Optimize data storage, processing, and retrieval in AWS to meet performance and cost efficiency goals.
  • ETL/ELT Development: Build and optimize ETL/ELT processes using tools like Informatica, AWS Glue, AWS Transfer Family and custom Python-based solutions. Ensure data flows are automated, efficient, and scalable.
  • Automation & Workflow Orchestration: Implement and manage workflow orchestration with Apache Airflow to automate and schedule ETL tasks, ensuring reliable data delivery to target systems.
  • Collaborate with Stakeholders: Work closely with business users, analysts, and other engineering teams to understand data requirements, propose data solutions, and ensure alignment with business goals. Translate business needs into technical solutions.
  • Data Quality & Governance: Ensure data quality, integrity, and compliance with governance policies. Implement monitoring and logging to ensure pipeline health and detect anomalies or issues proactively.
  • Mentoring & Leadership: Mentor and guide junior data engineers, helping them grow in their technical skills and best practices. Promote a culture of continuous learning and high performance.
  • Performance Tuning & Optimization: Continuously monitor and optimize data pipeline performance, troubleshoot issues, and apply best practices for improving query performance and data processing times.


Skills (Must have) :


  • Experience with Data Migrations: Proven track record of handling large-scale data migrations, particularly from on-premise databases (e.g., Oracle, SQL Server) to cloud platforms like AWS.
  • Cloud Platforms (AWS): Strong hands-on experience with AWS services including S3, Redshift, RDS, Lambda, Glue, and Athena. Familiarity with AWs Transfer Family, AWS Data Pipeline and AWS DMS (Database Migration Service) is a plus.
  • ETL/ELT Tools: Extensive experience with ETL/ELT tools like Informatica, AWS Glue, or Apache NiFi, as well as custom Python scripts for data transformations and data workflows.
  • Python Programming: Advanced proficiency in Python, including experience with libraries such as Pandas, NumPy, and PySpark for data processing and transformations. Experience in writing efficient, scalable code is essential.
  • Apache Airflow: Proficiency in Apache Airflow for building, scheduling, and managing data workflows and pipeline automation.
  • SQL & Database Skills: Strong experience with relational databases like Oracle, SQL Server, and cloud databases like Amazon Redshift or RDS. Familiarity with writing complex SQL queries and optimizing them for large-scale data processing.
  • Data Modeling & Warehousing: Solid understanding of data modeling techniques (e.g., star schema, snowflake schema) and experience with data warehousing solutions, particularly in the cloud (AWS Redshift, Snowflake, etc.).
  • Data Integration: Experience integrating data from various sources (databases, APIs, flat files, etc.), and managing large-scale data ingestion pipelines.
  • Data Quality & Governance: Experience implementing data quality checks, error handling, and monitoring for data pipelines. Familiarity with data governance best practices for compliance and security.
  • Version Control & CI/CD: Experience with version control (e.g., Git) and CI/CD practices for managing code and automating data workflows. Familiarity with Jenkins, GitLab CI, or other tools is a plus.


Skills (Good to Have) :


  • Financial Services/Capital Markets Experience: Experience working with financial data, including market data, transaction data, risk data, or financial reporting and working with financial data vendors such as Bloomberg, Refinitiv, Morningstar, Barclays.
  • Big Data Technologies: Experience with Big Data tools and frameworks like Hadoop, Spark, or Kafka is a plus, particularly in a cloud-based environment (AWS EMR, AWS Kinesis, etc.).
  • Data Security & Compliance: Knowledge of best practices for securing data, particularly in financial services, including encryption, data masking, and managing sensitive information in cloud environments.
  • Leadership Experience: For Lead roles, experience managing or mentoring a team of data engineers, guiding architecture decisions, and driving process improvements.


Education and Certifications:


  • Bachelor’s degree in Computer Science, Engineering, Data Science, or a related field (or equivalent experience).
  • Certifications in AWS (e.g., AWS Certified Data Analytics – Specialty, AWS Certified Solutions Architect – Associate/Professional) are highly desirable.
  • Additional certifications in data engineering, databases, or cloud platforms would be beneficial.

  • ETL Architect

    1 week ago

    Gurugram, India IGT Solutions Full time

    Role : ETL Architect. Primary Skills : Python, Pyspark, AWS, Snowflake, PLSQL,. Experience : 8+ Years. Location : Remote. Notice period : Immediate Joiner. Job Overview : We are seeking a skilled and experienced ETL Architect to join our data engineering team. The ideal candidate will have over 8 years of hands-on experience designing, architecting, and...

  • Associate Consultant

    2 months ago

    Gurugram, India Spectral Consultants Full time

    Roles and Responsibilities :Requirement Analysis : - Understand the ETL requirements and data flow from source to target.- Collaborate with business analysts and stakeholders to gather testing requirements.Test Planning : - Develop a comprehensive test plan that outlines the scope, objectives, resources, schedule, and testing strategy for the ETL...

  • ETL IICS/ IDMC Specialist

    2 weeks ago

    Gurugram, India Axtria - Ingenious Insights Full time

    Job Role: ETL Technical LeadELIGIBILITY CRITERIA: Work Experience: Overall 5+ years of experience working on Databases, Data Warehouse, Data Integration and BI/Reporting solutions with relevant experience in Lifesciences/Pharma domain .Technical:Design and implement effective database solutions and data models to store and retrieve data.Hands on experience...

  • Software Engineer

    6 months ago

    Gurugram, India Moody's Full time

    At Moody's, we unite the brightest minds to turn today’s risks into tomorrow’s opportunities. We do this by striving to create an inclusive environment where everyone feels welcome to be who they are—with the freedom to exchange ideas, think innovatively, and listen to each other and customers in meaningful ways.  If you are excited about this...

  • Gemini Solutions Pvt Ltd | ETL Architect | gurugram

    2 weeks ago

    gurugram, India Gemini Solutions Pvt Ltd Full time

    About the Company : Gemini Solutions is a global IT consulting firm and a leading offshore outsourcing company with an expertise in BFSI domain. Founded and owned by IIT Delhi and IIIT Hyderabad alumni. We have expertise across each part of the entire Software Development Life Cycle - Development, Quality Assurance, 24x7 DevOps and also...

  • Gemini Solutions

    4 days ago

    Gurugram, India Gemini Solutions Private Limited Full time

    About the Company : Gemini Solutions is a global IT consulting firm and a leading offshore outsourcing company with an expertise in BFSI domain. Founded and owned by IIT Delhi and IIIT Hyderabad alumni. We have expertise across each part of the entire Software Development Life Cycle Development, Quality Assurance, 24x7 DevOps and also Infrastructure/Managed...

  • Associate Consultant

    2 weeks ago

    Pune/Noida/Gurgaon/Gurugram, India Spectral Consultants Full time

    Roles and Responsibilities :Requirement Analysis : - Understand the ETL requirements and data flow from source to target.- Collaborate with business analysts and stakeholders to gather testing requirements.Test Planning : - Develop a comprehensive test plan that outlines the scope, objectives, resources, schedule, and testing strategy for the ETL...

  • Azure Databricks Engineer

    2 months ago

    Gurugram, India Arrixa Full time

    Key Responsibilities :- Data Pipeline Development : Design, develop, and optimize data pipelines and workflows in Azure Databricks for ETL/ELT processing, data transformation, and analytics. - Big Data Solutions : Architect and implement big data solutions using Azure Databricks, Spark, Azure Data Lake, and other Azure data services. - Data Integration :...

  • Quadrant Technologies

    2 months ago

    Gurugram, India Quadrant Technologies Full time

    Job Description :Requirements :- Understands product needs to define optimal system specifications.- Plans/ designs the technology solution, built to scale and compliant to security standards.- Communicates system requirements to product engineering teams.- Provides information architecture, data engineering pipeline design, application software, APIdesign...

  • Data Engineer

    2 days ago

    Gurugram, India Steerlean Consulting Services Pvt Ltd. Full time

    Job Description :As a Data Engineer, you will design, build, and maintain scalable data pipelines and systems to support analytics and business intelligence. You will work closely with data scientists, analysts, and other engineers to ensure seamless data integration, quality, and availability. This role requires hands-on experience in big data tools, cloud...

  • Azure Databricks Engineer

    3 days ago

    Gurgaon/Gurugram, India Arrixa Full time

    Key Responsibilities :- Data Pipeline Development : Design, develop, and optimize data pipelines and workflows in Azure Databricks for ETL/ELT processing, data transformation, and analytics. - Big Data Solutions : Architect and implement big data solutions using Azure Databricks, Spark, Azure Data Lake, and other Azure data services. - Data Integration :...

  • Senior Data Engineer

    4 weeks ago

    Gurugram, India TalentXO Full time

    Job Description : We are looking for "Sr. Data Engineer" for one of our clients (who offers online cohort-based courses for architects, engineers and designers in the AEC industry to advance their professional growth. They serve learners from 45+ countries including India, MENA, USA, Europe, and SEA. Their courses are delivered by professionals from global...

  • Quadrant Technologies

    2 weeks ago

    Gurgaon/Gurugram, India Quadrant Technologies Full time

    Job Description : Requirements : - Understands product needs to define optimal system specifications. - Plans/ designs the technology solution, built to scale and compliant to security standards. - Communicates system requirements to product engineering teams. - Provides information architecture, data engineering pipeline design, application software,...

  • Senior Data Engineer

    4 weeks ago

    Gurugram, India Snap Find Full time

    Company Name : NovatrWebsite : Skills : SQL queries,ETL tools and frameworks,Big data technologies,Cloud platforms (AWS, Azure, GCP),Data warehousingDescription :OUR STORY :In 2021, Novatr began as a dream at a tiny garage in the bustling lanes of Delhi. This dream was to empower every architect, engineer, and AEC professional with cutting-edge technology...

  • Senior Data Engineer

    4 weeks ago

    Gurugram, India Inamul Hasan Full time

    Website : https : //www.novatr.com/Required Skills : SQL queries, ETL tools and frameworks, Big data technologies, Cloud platforms (AWS, Azure, GCP), Data warehousingOur Story :In 2021, Novatr began as a dream at a tiny garage in the bustling lanes of Delhi. This dream was to empower every architect, engineer, and AEC professional with cutting-edgetechnology...

  • Database Architect

    2 weeks ago

    Gurgaon/Gurugram, India Aviation Indeed Private Limited Full time

    Position : Data ArchitectRole Overview :The Data Architect will play a pivotal role in designing and implementing the company's data infrastructure. This position requires a strong understanding of data modeling, architecture, and best practices to ensure data quality, consistency, and accessibility across the organization.Key Responsibilities :-...

  • Data Solutions Architect

    6 months ago

    Gurugram, Haryana, India Luxoft Full time

    **Project** Description**: We have an opportunity with one of the biggest banking clients. Here you will join their long-term digital transformation programme as part of the Data & DevOps Team. **Responsibilities**: - Key Responsibilities: - Analysis of problem statement, Own the technical solution, provide an end-to-end assurance that satisfies business...

  • SAS Developer

    2 months ago

    Gurugram, India Elite recruitments Full time

    Job Opportunity for SAS DI Developers with global consulting firm. Location : Gurgaon. As a SAS DI Developer, you will be responsible for designing, developing, and managing the data integration processes using SAS Data Integration Studio. You will work closely with business analysts, data architects, and other team members to build efficient data pipelines,...

  • Data Architect

    1 month ago

    Gurugram, India Minutes to Seconds Pty Ltd Full time

    Job DescriptionAbout the job At Minutes to Seconds, we match people having great skills with tailor-fitted jobs to achieve well-deserved success. We know how to match people to the right job roles to create that perfect fit. This changes the dynamics of business success and catalyzes the growth of individuals. Our aim is to provide both our candidates and...

  • Data Architect

    1 month ago

    Gurugram, India Minutes to Seconds Pty Ltd Full time

    About the job At Minutes to Seconds, we match people having great skills with tailor-fitted jobs to achieve well-deserved success. We know how to match people to the right job roles to create that perfect fit. This changes the dynamics of business success and catalyzes the growth of individuals. Our aim is to provide both our candidates and clients with...