ETL Data Engineer

10 hours ago

New Delhi, India The Techgalore Full time

Pls rate the candidate (from 1 to 5, 1 lowest, 5 highest ) in these areas

  1. Big Data
  2. PySpark
  3. AWS
  4. Redshift

Position Summary

Experienced ETL Developers and Data Engineers to ingest and analyze data from multiple enterprise sources into Adobe Experience Platform

Requirements

  • About 4-6 years of professional technology experience mostly focused on the following:
  • 4+ year of experience on developing data ingestion pipelines using Pyspark(batch and streaming).
  • 4+ years experience on multiple Data engineering related services on AWS, e.g. Glue, Athena, DynamoDb, Kinesis, Kafka, Lambda, Redshift etc.
  • 1+ years of experience of working with Redshift esp the following.

o Experience and knowledge of loading data from various sources, e.g. s3 bucket and on-prem data sources into Redshift.

o Experience of optimizing data ingestion into Redshift.

o Experience of designing, developing and optimizing queries on Redshift using SQL or PySparkSQL

o Experience of designing tables in Redshift(distribution key, compression etc., vacuuming,etc. )

Experience of developing applications that consume the services exposed as ReST APIs. Experience and ability to write and analyze complex and performant SQLs

Special Consideration given for

  • 2 years of Developing and supporting ETL pipelines using enterprise-grade ETL tools like Pentaho, Informatica, Talend
  • Good knowledge on Data Modellin g(design patterns and best practices)
  • Experience with Reporting Technologies (i.e. Tableau, PowerBI)

What youll do

Analyze and understand customers use case and data sources and extract, transform and load data from multitude of customers enterprise sources and ingest into Adobe Experience Platform

Design and build data ingestion pipelines into the platform using PySpark

Ensure ingestion is designed and implemented in a performant manner to support the throughout and latency needed.

Develop and test complex SQLs to extract\analyze and report the data ingested into the Adobe Experience platform.

Ensure the SQLs are implemented in compliance with the best practice to they are performant.

Migrate platform configurations, including the data ingestion pipelines and SQL, across various sandboxes.

Debug any issues reported on data ingestion, SQL or any other functionalities of the platform and resolve the issues.

Support Data Architects in implementing data model in the platform.

Contribute to the innovation charter and develop intellectual property for the organization.

Present on advanced features and complex use case implementations at multiple forums.

Attend regular scrum events or equivalent and provide update on the deliverables.

Work independently across multiple engagements with none or minimum supervision.



  • ETL Data Engineer

    4 hours ago

    New Delhi, India The Techgalore Full time

    Pls rate the candidate (from 1 to 5, 1 lowest, 5 highest ) in these areas Big Data PySpark AWS Redshift Position Summary Experienced ETL Developers and Data Engineers to ingest and analyze data from multiple enterprise sources into Adobe Experience Platform Requirements About 4-6 years of professional technology experience...

  • QA Engineer

    10 hours ago

    New Delhi, India Talent Worx Full time

    We are looking for a talented QA Engineer specialized in Database and ETL testing to join our dynamic team. The successful candidate will be responsible for ensuring the quality of our data processes by validating ETL workflows, database functionalities, and data integrity across our platforms. Key Responsibilities: Develop and execute thorough testing...

  • QA Engineer

    5 hours ago

    New Delhi, India Talent Worx Full time

    We are looking for a talented QA Engineer specialized in Database and ETL testing to join our dynamic team. The successful candidate will be responsible for ensuring the quality of our data processes by validating ETL workflows, database functionalities, and data integrity across our platforms. Key Responsibilities: Develop and execute thorough...

  • ETL QA Engineer

    1 week ago

    Delhi, India Saransh Inc Full time

    We're Hiring: Senior ETL QA Engineer Experience: 6–8 Years Experience Location : Hyderabad / Chennai Join: Immediate Joiners Preferred Employment Type : Full-Time | Hybrid Are you passionate about ensuring data integrity and accuracy in high-performance systems? Do you excel in ETL testing and SQL validation ? We’re looking for an...

  • ETL & Data Warehouse Engineer

    4 weeks ago

    Delhi, Delhi, India Winning Edge Full time

    PRIMARY DUTIES/RESPONSIBILITIES :- Maintain and provide enhancements to data architecture within new/existing systems including Data Warehouse.- Recommend and implement processes to improve data quality, data reliability, and database performance.- Employ variety of ETL and integration tools for system and data integrations.- Architect solutions that support...

  • Senior Data Engineer

    2 weeks ago

    Delhi Division, India Findem Full time

    Job Description :Key Responsibilities :- Design, develop, and maintain scalable data pipelines and ETL processes to support data integration from multiple sources.- Perform data modeling for both structured and semi-structured datasets.- Implement and manage data warehousing solutions to store and organize large volumes of data efficiently.- Optimize ETL...

  • Data Engineer

    11 hours ago

    New Delhi, India Trigyn Technologies Full time

    Job Description: Job Description Experience: Minimum 5 yrs. Work Location: Client office in Delhi. Remote working options are not available. We are seeking a skilled Data Engineer with at least 5 years of experience to join our data analytics team, focusing on building robust data pipelines and systems to support the creation of dynamic dashboards. The...

  • Data Engineer

    4 hours ago

    New Delhi, India Trigyn Technologies Full time

    Job Description: Job Description Experience: Minimum 5 yrs. Work Location: Client office in Delhi. Remote working options are not available. We are seeking a skilled Data Engineer with at least 5 years of experience to join our data analytics team, focusing on building robust data pipelines and systems to support the creation of dynamic dashboards....

  • Cloudious - Senior Data Engineer - ETL/PySpark

    3 weeks ago

    Delhi, Delhi, India Cloudious lLC Full time

    Requirements:- 8+ years of professional software engineering mostly focused on the following: 3 to 4 years of customer-facing international exposure.- At least 2 years of experience interacting with technology and business senior leaders.- Exceptional leadership, communication and stakeholder management skills Leading innovation and automaton agendas for...

  • Senior Data Engineer

    3 days ago

    Delhi, NCR, India MchooversPacific Data Integrators Full time US$ 1,00,000 - US$ 1,50,000 per year

    Job Title: Senior Data Engineer (IDMC-CDI)Primary Skills: SQL, IDMC (CDI), ETL ConceptsMode of Work: Remote/WFHExperience: 5-10 YearsAbout UsWe are PDI (Pacific Data Integrators), a leading provider of Data Management, Analytics, and Cloud solutions. As an Informatica Platinum Partner and a reseller of various market-leading products, we help enterprises...