
ETL Data Engineer
10 hours ago
Pls rate the candidate (from 1 to 5, 1 lowest, 5 highest ) in these areas
- Big Data
- PySpark
- AWS
- Redshift
Position Summary
Experienced ETL Developers and Data Engineers to ingest and analyze data from multiple enterprise sources into Adobe Experience Platform
Requirements
- About 4-6 years of professional technology experience mostly focused on the following:
- 4+ year of experience on developing data ingestion pipelines using Pyspark(batch and streaming).
- 4+ years experience on multiple Data engineering related services on AWS, e.g. Glue, Athena, DynamoDb, Kinesis, Kafka, Lambda, Redshift etc.
- 1+ years of experience of working with Redshift esp the following.
o Experience and knowledge of loading data from various sources, e.g. s3 bucket and on-prem data sources into Redshift.
o Experience of optimizing data ingestion into Redshift.
o Experience of designing, developing and optimizing queries on Redshift using SQL or PySparkSQL
o Experience of designing tables in Redshift(distribution key, compression etc., vacuuming,etc. )
Experience of developing applications that consume the services exposed as ReST APIs. Experience and ability to write and analyze complex and performant SQLs
Special Consideration given for
- 2 years of Developing and supporting ETL pipelines using enterprise-grade ETL tools like Pentaho, Informatica, Talend
- Good knowledge on Data Modellin g(design patterns and best practices)
- Experience with Reporting Technologies (i.e. Tableau, PowerBI)
What youll do
Analyze and understand customers use case and data sources and extract, transform and load data from multitude of customers enterprise sources and ingest into Adobe Experience Platform
Design and build data ingestion pipelines into the platform using PySpark
Ensure ingestion is designed and implemented in a performant manner to support the throughout and latency needed.
Develop and test complex SQLs to extract\analyze and report the data ingested into the Adobe Experience platform.
Ensure the SQLs are implemented in compliance with the best practice to they are performant.
Migrate platform configurations, including the data ingestion pipelines and SQL, across various sandboxes.
Debug any issues reported on data ingestion, SQL or any other functionalities of the platform and resolve the issues.
Support Data Architects in implementing data model in the platform.
Contribute to the innovation charter and develop intellectual property for the organization.
Present on advanced features and complex use case implementations at multiple forums.
Attend regular scrum events or equivalent and provide update on the deliverables.
Work independently across multiple engagements with none or minimum supervision.
-
ETL Data Engineer
16 hours ago
New Delhi, India The Techgalore Full timePls rate the candidate (from 1 to 5, 1 lowest, 5 highest ) in these areas Big Data PySpark AWS Redshift Position Summary Experienced ETL Developers and Data Engineers to ingest and analyze data from multiple enterprise sources into Adobe Experience Platform Requirements About 4-6 years of professional technology experience mostly focused on the...
-
QA Engineer
16 hours ago
New Delhi, India Talent Worx Full timeWe are looking for a talented QA Engineer specialized in Database and ETL testing to join our dynamic team. The successful candidate will be responsible for ensuring the quality of our data processes by validating ETL workflows, database functionalities, and data integrity across our platforms. Key Responsibilities: Develop and execute thorough testing...
-
QA Engineer
11 hours ago
New Delhi, India Talent Worx Full timeWe are looking for a talented QA Engineer specialized in Database and ETL testing to join our dynamic team. The successful candidate will be responsible for ensuring the quality of our data processes by validating ETL workflows, database functionalities, and data integrity across our platforms. Key Responsibilities: Develop and execute thorough...
-
ETL QA Engineer
1 week ago
Delhi, India Saransh Inc Full timeWe're Hiring: Senior ETL QA Engineer Experience: 6–8 Years Experience Location : Hyderabad / Chennai Join: Immediate Joiners Preferred Employment Type : Full-Time | Hybrid Are you passionate about ensuring data integrity and accuracy in high-performance systems? Do you excel in ETL testing and SQL validation ? We’re looking for an...
-
ETL & Data Warehouse Engineer
4 weeks ago
Delhi, Delhi, India Winning Edge Full timePRIMARY DUTIES/RESPONSIBILITIES :- Maintain and provide enhancements to data architecture within new/existing systems including Data Warehouse.- Recommend and implement processes to improve data quality, data reliability, and database performance.- Employ variety of ETL and integration tools for system and data integrations.- Architect solutions that support...
-
Senior Data Engineer
2 weeks ago
Delhi Division, India Findem Full timeJob Description :Key Responsibilities :- Design, develop, and maintain scalable data pipelines and ETL processes to support data integration from multiple sources.- Perform data modeling for both structured and semi-structured datasets.- Implement and manage data warehousing solutions to store and organize large volumes of data efficiently.- Optimize ETL...
-
Data Engineer
17 hours ago
New Delhi, India Trigyn Technologies Full timeJob Description: Job Description Experience: Minimum 5 yrs. Work Location: Client office in Delhi. Remote working options are not available. We are seeking a skilled Data Engineer with at least 5 years of experience to join our data analytics team, focusing on building robust data pipelines and systems to support the creation of dynamic dashboards. The...
-
Data Engineer
10 hours ago
New Delhi, India Trigyn Technologies Full timeJob Description: Job Description Experience: Minimum 5 yrs. Work Location: Client office in Delhi. Remote working options are not available. We are seeking a skilled Data Engineer with at least 5 years of experience to join our data analytics team, focusing on building robust data pipelines and systems to support the creation of dynamic dashboards....
-
Cloudious - Senior Data Engineer - ETL/PySpark
3 weeks ago
Delhi, Delhi, India Cloudious lLC Full timeRequirements:- 8+ years of professional software engineering mostly focused on the following: 3 to 4 years of customer-facing international exposure.- At least 2 years of experience interacting with technology and business senior leaders.- Exceptional leadership, communication and stakeholder management skills Leading innovation and automaton agendas for...
-
Senior Data Engineer
4 days ago
Delhi, NCR, India MchooversPacific Data Integrators Full time US$ 1,00,000 - US$ 1,50,000 per yearJob Title: Senior Data Engineer (IDMC-CDI)Primary Skills: SQL, IDMC (CDI), ETL ConceptsMode of Work: Remote/WFHExperience: 5-10 YearsAbout UsWe are PDI (Pacific Data Integrators), a leading provider of Data Management, Analytics, and Cloud solutions. As an Informatica Platinum Partner and a reseller of various market-leading products, we help enterprises...