High Salary: ETL Architect
14 hours ago
We are seeking an experienced ETL Tech Lead to oversee and drive data migration, integration, and pipeline development projects. This role involves leading the migration of on-premise databases (Oracle, SQL Server) to AWS cloud platforms such as Redshift and S3, ensuring seamless integration across diverse systems. The ideal candidate will design and optimize robust ETL/ELT workflows, leveraging tools like Informatica, AWS Glue, and custom Python solutions, while maintaining data quality and governance. Additionally, the role requires expertise in building scalable data architectures using AWS services, managing automated workflows with Apache Airflow, and mentoring junior engineers. A strong background in SQL, Python, and AWS cloud infrastructure is essential, with a focus on driving high-performance data operations aligned with business objectives.
About the Role
- Data Migration & Integration: Lead data migration projects to move on-premise data (Oracle, SQL Server) to AWS cloud-based solutions (Redshift, S3, RDS). Coordinate end-to-end processes for seamless data transfers and integrations across platforms.- Data Ingestion & Pipelines: Design, implement, and maintain robust, scalable data ingestion pipelines to integrate structured and unstructured data from various sources into cloud-based platforms like AWS. Use tools like Informatica, Apache Airflow, or custom Python solutions.- Cloud Infrastructure (AWS): Develop cloud-native data architectures using AWS services (e.g., Redshift, S3, Glue, Lambda, RDS, and Athena). Optimize data storage, processing, and retrieval in AWS to meet performance and cost efficiency goals.- ETL/ELT Development: Build and optimize ETL/ELT processes using tools like Informatica, AWS Glue, AWS Transfer Family and custom Python-based solutions. Ensure data flows are automated, efficient, and scalable.- Automation & Workflow Orchestration: Implement and manage workflow orchestration with Apache Airflow to automate and schedule ETL tasks, ensuring reliable data delivery to target systems.- Collaborate with Stakeholders: Work closely with business users, analysts, and other engineering teams to understand data requirements, propose data solutions, and ensure alignment with business goals. Translate business needs into technical solutions.- Data Quality & Governance: Ensure data quality, integrity, and compliance with governance policies. Implement monitoring and logging to ensure pipeline health and detect anomalies or issues proactively.- Mentoring & Leadership: Mentor and guide junior data engineers, helping them grow in their technical skills and best practices. Promote a culture of continuous learning and high performance.- Performance Tuning & Optimization: Continuously monitor and optimize data pipeline performance, troubleshoot issues, and apply best practices for improving query performance and data processing times.
Skills (Must have) :
- Experience with Data Migrations: Proven track record of handling large-scale data migrations, particularly from on-premise databases (e.g., Oracle, SQL Server) to cloud platforms like AWS.- Cloud Platforms (AWS): Strong hands-on experience with AWS services including S3, Redshift, RDS, Lambda, Glue, and Athena. Familiarity with AWs Transfer Family, AWS Data Pipeline and AWS DMS (Database Migration Service) is a plus.- ETL/ELT Tools: Extensive experience with ETL/ELT tools like Informatica, AWS Glue, or Apache NiFi, as well as custom Python scripts for data transformations and data workflows.- Python Programming: Advanced proficiency in Python, including experience with libraries such as Pandas, NumPy, and PySpark for data processing and transformations. Experience in writing efficient, scalable code is essential.- Apache Airflow: Proficiency in Apache Airflow for building, scheduling, and managing data workflows and pipeline automation.- SQL & Database Skills: Strong experience with relational databases like Oracle, SQL Server, and cloud databases like Amazon Redshift or RDS. Familiarity with writing complex SQL queries and optimizing them for large-scale data processing.- Data Modeling & Warehousing: Solid understanding of data modeling techniques (e.g., star schema, snowflake schema) and experience with data warehousing solutions, particularly in the cloud (AWS Redshift, Snowflake, etc.).- Data Integration: Experience integrating data from various sources (databases, APIs, flat files, etc.), and managing large-scale data ingestion pipelines.- Data Quality & Governance: Experience implementing data quality checks, error handling, and monitoring for data pipelines. Familiarity with data governance best practices for compliance and security.- Version Control & CI/CD: Experience with version control (e.g., Git) and CI/CD practices for managing code and automating data workflows. Familiarity with Jenkins, GitLab CI, or other tools is a plus.
Skills (Good to Have) :
- Financial Services/Capital Markets Experience: Experience working with financial data, including market data, transaction data, risk data, or financial reporting and working with financial data vendors such as Bloomberg, Refinitiv, Morningstar, Barclays.- Big Data Technologies: Experience with Big Data tools and frameworks like Hadoop, Spark, or Kafka is a plus, particularly in a cloud-based environment (AWS EMR, AWS Kinesis, etc.).- Data Security & Compliance: Knowledge of best practices for securing data, particularly in financial services, including encryption, data masking, and managing sensitive information in cloud environments.- Leadership Experience: For Lead roles, experience managing or mentoring a team of data engineers, guiding architecture decisions, and driving process improvements.
Education and Certifications:
- Bachelor’s degree in Computer Science, Engineering, Data Science, or a related field (or equivalent experience).- Certifications in AWS (e.g., AWS Certified Data Analytics – Specialty, AWS Certified Solutions Architect – Associate/Professional) are highly desirable.- Additional certifications in data engineering, databases, or cloud platforms would be beneficial.
-
ETL Architect
2 days ago
Gurgaon, India Gemini Solutions Pvt Ltd Full timeAbout the Company : Gemini Solutions is a global IT consulting firm and a leading offshore outsourcing company with an expertise in BFSI domain. Founded and owned by IIT Delhi and IIIT Hyderabad alumni. We have expertise across each part of the entire Software Development Life Cycle - Development, Quality Assurance, 24x7 DevOps and also...
-
Etl architect
24 hours ago
Gurgaon, India Gemini Solutions Pvt Ltd Full timeAbout the Company : Gemini Solutions is a global IT consulting firm and a leading offshore outsourcing company with an expertise in BFSI domain. Founded and owned by IIT Delhi and IIIT Hyderabad alumni. We have expertise across each part of the entire Software Development Life Cycle - Development, Quality Assurance, 24x7 Dev Ops and also...
-
ETL Architect
2 days ago
Gurgaon, India Gemini Solutions Pvt Ltd Full timeAbout the Company : Gemini Solutions is a global IT consulting firm and a leading offshore outsourcing company with an expertise in BFSI domain. Founded and owned by IIT Delhi and IIIT Hyderabad alumni. We have expertise across each part of the entire Software Development Life Cycle - Development, Quality Assurance, 24x7 DevOps and also...
-
Interior Architect
3 weeks ago
Gurgaon, India Umbrette Full timeCompany DescriptionUmbrette is an architectural and interior design planning firm located in Gurugram. We are technology-first company dedicated to delivering an unmatched design experience for our esteemed clients. We specialize in high-quality residential projects that blend innovation and excellence. Our team thrives on creativity, precision, and a deep...
-
ETL Tester
1 month ago
Pune/Noida/Gurgaon/Gurugram, India Spectral Consultants Full timeETL Tester Job DescriptionRole Summary: We are seeking an experienced ETL Tester to join our team at Spectral Consultants. The successful candidate will be responsible for testing ETL processes to ensure data quality and integrity.Key Responsibilities:Develop and execute test plans to validate ETL processesCollaborate with development teams to identify and...
-
(High Salary) Senior/Lead Data Architect
4 weeks ago
Gurgaon, India The LHR Group Full timeOrganization: A top global management consulting firmDomain - Travel, Hospitality, Real-estate- Infrastructure, Smart Cities, Government, Port, Shipping, Infrastructure, Smart CitiesCompensation: Highly competitive, above the industry standardsResponsibilities:- Lead and/or assist in designing and developing cloud-based data systems, tailoring solutions to...
-
Data Visualization and ETL Expert
2 weeks ago
Gurgaon, Haryana, India IGT Solutions Full timeAbout IGT SolutionsIGT Solutions is a leading customer experience (CX) company that leverages digital technologies to deliver transformative experiences for global brands across the travel and high-growth tech industries.We have a global delivery footprint, spanning 30+ locations worldwide, with a team of 25,000+ CX and technology experts from diverse...
-
▷ High Salary: Solution Architect
2 months ago
Gurgaon, India Amtex Systems Inc. Full timeAbout Company : Systems, a global technology innovator with 25+ years of expertise. Specializing in Software Development, IT Consulting, Digital Media, Business Intelligence, Mobile Applications, and Content Management, we're at the forefront of industry evolution caters to diverse sectors, including Technology, Finance, Media, Fashion, Retail, and the...
-
gurgaon, India Gemini Solutions Pvt Ltd Full timeAbout the Company : Gemini Solutions is a global IT consulting firm and a leading offshore outsourcing company with an expertise in BFSI domain. Founded and owned by IIT Delhi and IIIT Hyderabad alumni. We have expertise across each part of the entire Software Development Life Cycle - Development, Quality Assurance, 24x7 DevOps and also...
-
Etl Tester
5 months ago
Gurgaon, India Appzlogic Mobility Solutions Pvt Ltd Full time**Job description-** - Hands-on experience with ETL testing tools, frameworks, and automation (e.g., Clarity with database systems (e.g., Oracle, SQL Server, MySQL) and data warehousing concepts. - Experience in troubleshooting data-related issues, identifying root causes, and proposing effective solutions. - Strong analytical and problem-solving skills,...
-
▷ (High Salary) Data Engineer - Sales
2 weeks ago
Gurgaon, India ATOSS Software SE Full timeYour Responsibilities:We are seeking a skilled and detail-oriented Sales Data Engineer to join our Revenue Operations team in Gurgaon, India. The ideal candidate will have a strong background in data engineering, with experience in building and maintaining data systems, particularly in Snowflake. This role will involve close collaboration with our teams at...
-
Senior ETL Analyst
7 days ago
Gurgaon, Haryana, India Spectral Consultants Full timeSpectral Consultants is seeking a highly skilled Senior ETL Analyst to join our team. As an ETL Tester, you will play a crucial role in ensuring the accuracy and efficiency of our ETL processes.Key Responsibilities:Develop test plans and test cases to validate ETL processesTest data transformations to ensure accurate conversions and mappingCollaborate with...
-
Etl iics/ idmc specialist
1 day ago
Gurgaon, India Axtria - Ingenious Insights Full timeJob Role: ETL Technical LeadELIGIBILITY CRITERIA:Work Experience: Overall 5+ years of experience working on Databases, Data Warehouse, Data Integration and BI/Reporting solutions with relevant experience in Lifesciences/Pharma domain.Technical:Design and implement effective database solutions and data models to store and retrieve data.Hands on experience in...
-
Data Architect
3 weeks ago
Gurgaon, Haryana, India Invokhr Full timeJob Title: Data ArchitectJob Summary:Invokhr is seeking a skilled Data Architect to design, develop, and implement complex data pipelines on the Azure Cloud Data and Analytics Platform.Key Responsibilities:Develop technical designs and code deliverables.Review team deliverables, provide support and mentoring.Build and deploy data mappings, sessions, and...
-
Sap Solutions Architect
3 weeks ago
Gurgaon, India Career Stone Consultant Full timeSAP HANA S4 Solutions Expert ( FICO Modules - Functional expert)( We can look ate lead consultants Principle consultant who has experience in Solutions Design )Job Description:We are looking for an experienced SAP Solution Manager to independently oversee and manage SAP S4 HANA Assessment projects. The ideal candidate will work closely with multiple legal...
-
Database Solutions Architect
7 days ago
Gurgaon, Haryana, India PeopleStrong Full time**Job Summary:**We are seeking an experienced Database Solutions Architect to join our team at PeopleStrong. This is a challenging opportunity for an individual with strong SQL development skills, including T-SQL programming and Microsoft SQL Server expertise.**About the Role:**This position involves developing high-quality database solutions, analyzing...
-
Senior Cloud Architect
2 weeks ago
Gurgaon, Haryana, India Invokhr Full timeJob DescriptionWe are seeking a highly skilled Senior Cloud Architect to join our team at Invokhr. This is a challenging and rewarding opportunity for experienced professionals who want to drive business success.About the RoleThis role will lead the development of cloud-based solutions, leveraging Informatica Intelligent Cloud Services (IICS) to deliver...
-
Technical Architect
2 days ago
Gurgaon, India Coforge Full timeTitle: Data Architect (Data Bricks)Location: GurugramYears of experience: 12+ yearsSkill Stack:- MS Azure PaaS and Iaas technologies (Databricks, Synapse, Data Factory, CI/CD, Azure DevOps, ML, IOT)Working with a forward thinking organization who are truly leveraging their data in Azure and Databricks. The company also in the process of mapping out what the...
-
Big Data Architect
5 months ago
Gurgaon, India Techfrolic Software Solutions Pvt. Ltd Full time**Job description** We are seeking a highly skilled and experienced Big Data Architect to join our team. As a Big Data Architect, you will be responsible for designing and implementing robust, scalable, and high-performance big data solutions that meet our client's diverse and complex requirements. Your expertise in big data technologies, data modeling, and...
-
Data Migration Solutions Architect
2 weeks ago
Gurgaon, Haryana, India exl Full timeJob OverviewWe are seeking a highly skilled Data Migration Solutions Architect to join our team at EXL. In this role, you will play a key part in designing and implementing PySpark-based solutions for our clients.Key ResponsibilitiesLead the development of PySpark-based data migration solutions that meet client requirements and objectives.Work closely with...
