ETL Data Engineer

2 days ago

New Delhi, India The Techgalore Full time

Pls rate the candidate (from 1 to 5, 1 lowest, 5 highest ) in these areas Big Data PySpark AWS Redshift Position Summary Experienced ETL Developers and Data Engineers to ingest and analyze data from multiple enterprise sources into Adobe Experience Platform Requirements About 4-6 years of professional technology experience mostly focused on the following: 4+ year of experience on developing data ingestion pipelines using Pyspark(batch and streaming). 4+ years experience on multiple Data engineering related services on AWS, e.g. Glue, Athena, DynamoDb, Kinesis, Kafka, Lambda, Redshift etc. 1+ years of experience of working with Redshift esp the following. o Experience and knowledge of loading data from various sources, e.g. s3 bucket and on-prem data sources into Redshift. o Experience of optimizing data ingestion into Redshift. o Experience of designing, developing and optimizing queries on Redshift using SQL or PySparkSQL o Experience of designing tables in Redshift(distribution key, compression etc., vacuuming,etc. ) Experience of developing applications that consume the services exposed as ReST APIs. Experience and ability to write and analyze complex and performant SQLs Special Consideration given for 2 years of Developing and supporting ETL pipelines using enterprise-grade ETL tools like Pentaho, Informatica, Talend Good knowledge on Data Modellin g(design patterns and best practices) Experience with Reporting Technologies (i.e. Tableau, PowerBI) What youll do Analyze and understand customers use case and data sources and extract, transform and load data from multitude of customers enterprise sources and ingest into Adobe Experience Platform Design and build data ingestion pipelines into the platform using PySpark Ensure ingestion is designed and implemented in a performant manner to support the throughout and latency needed. Develop and test complex SQLs to extract\analyze and report the data ingested into the Adobe Experience platform. Ensure the SQLs are implemented in compliance with the best practice to they are performant. Migrate platform configurations, including the data ingestion pipelines and SQL, across various sandboxes. Debug any issues reported on data ingestion, SQL or any other functionalities of the platform and resolve the issues. Support Data Architects in implementing data model in the platform. Contribute to the innovation charter and develop intellectual property for the organization. Present on advanced features and complex use case implementations at multiple forums. Attend regular scrum events or equivalent and provide update on the deliverables. Work independently across multiple engagements with none or minimum supervision.

  • PySpark & ETL Data Engineer

    4 weeks ago

    New Delhi, India CirrusLabs Full time

    We are CirrusLabs. Our vision is to become the world's most sought-after niche digital transformation company that helps customers realize value through innovation. Our mission is to co-create success with our customers, partners and community. Our goal is to enable employees to dream, grow and make things happen. We are committed to excellence. We are a...

  • PySpark & ETL Data Engineer

    3 weeks ago

    New Delhi, India CirrusLabs Full time

    We areCirrusLabs . Our vision is to become the world's most sought-after niche digital transformation company that helps customers realize value through innovation. Our mission is to co-create success with our customers, partners and community. Our goal is to enable employees to dream, grow and make things happen. We are committed to excellence. We are a...

  • ETL Test Engineer

    7 hours ago

    New Delhi, India Tata Consultancy Services Full time

    Role: ETL Test Engineer Experience range: 7-10 years Location: Bangalore (Walk-in drive in Bangalore)NOTE: This is a Walk-in drive in Bangalore and relevant experience in ETL must 7 yearsJob description:Min 7 to 10 yrs of Exp in ETL Testing. 1. SQL - Expert level of knowledge in core concepts of SQL and query. 2.Lead and mentor a team of ETL testers,...

  • ETL Data Engineer

    1 week ago

    Delhi, Delhi, India The Techgalore Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Pls rate the candidate (from 1 to 5, 1 lowest, 5 highest ) in these areas Big DataPySparkAWSRedshiftPosition SummaryExperienced ETL Developers and Data Engineers to ingest and analyze data from multiple enterprise sources into Adobe Experience Platform Requirements About 4-6 years of professional technology experience mostly focused on the...

  • Azure-ETL Engineer

    3 weeks ago

    New Delhi, India Coforge Full time

    Job DescriptionWe are seeking a seasoned Data Engineer with strong experience in Azure-based ETL pipelines and data architecture. The ideal candidate will be responsible for designing, implementing, and maintaining scalable data solutions that support business intelligence and analytics needs.Key Responsibilities- Design, implement, and maintain data...

  • Data Engineer with SQL/ETL/Pyspark

    4 weeks ago

    New Delhi, India Infosys Finacle Full time

    Mandate Skills - SQL, ETL ,hadoop, pyspark,Required Skills- Pipeline/ETL (Extract, Transform, Load) processes, API integration, scripting languages (Python), and big data technologies (Trio, Iceberg, DuckDB/Parquet). - Database design, data modeling, and data warehousing. SQL and at least one cloud platform. - Analytical tools (Superset, Power BI),...

  • Senior Quality Engineer

    3 weeks ago

    New Delhi, India canadainternationalprojects Full time

    Contract Type: Contract/ConsultantLocation: RemoteClient: Leading Canadian EnterpriseWork Schedule: Eastern Time Zone (5:00 PM - 1:00 AM IST)About the OpportunityWe are seeking an experienced Senior Quality Engineer for an exciting contract opportunity with a premier Canadian client. This role focuses on ensuring the quality of enterprise-scale data...

  • ETL Tester

    2 days ago

    New Delhi, India Tesslogs IT Solutions Full time

    Hello All,Greetings from Tesslogs,We are looking for an experienced ETL Tester with hands-on experience in Selenium and Java automation. The ideal candidate should have a solid understanding of ETL testing processes, data validation, and test automation frameworks to ensure data accuracy and quality across systems.Job Title: ETL Tester with Selenium and Java...

  • ETL Developer

    3 weeks ago

    New Delhi, India Sonata Software Full time

    ETL Developer (Talend)Experience: 3 to 12 yrsLocation : Hyderabad, BengaluruMode: Work From OfficeNote: F2F interview is MandatoryKey Responsibilities:Job Summary:We are seeking a skilled and detail-oriented Talend Developer to join our data engineering team. The ideal candidate will have hands-on experience with Talend Data Integration, strong SQL skills,...

  • ETL Developer

    2 weeks ago

    New Delhi, India Sonata Software Full time

    ETL Developer (Talend) Experience: 3 to 12 yrs Location : Hyderabad, Bengaluru Mode: Work From OfficeNote: F2F interview is MandatoryKey Responsibilities:Job Summary: We are seeking a skilled and detail-orientedTalend Developerto join our data engineering team. The ideal candidate will have hands-on experience withTalend Data Integration , strongSQLskills,...