ETL Data Engineer

1 day ago

Delhi, Delhi, India The Techgalore Full time ₹ 12,00,000 - ₹ 36,00,000 per year

Pls rate the candidate (from 1 to 5, 1 lowest, 5 highest ) in these areas 

  1. Big Data
  2. PySpark
  3. AWS
  4. Redshift

Position Summary

Experienced ETL Developers and Data Engineers to ingest and analyze data from multiple enterprise sources into Adobe Experience Platform

 Requirements 

  • About 4-6 years of professional technology experience mostly focused on the following: 
  •  4+ year of experience on developing data ingestion pipelines using Pyspark(batch and streaming).
  • 4+ years experience on multiple Data engineering related services on AWS, e.g. Glue, Athena, DynamoDb, Kinesis, Kafka, Lambda, Redshift etc.
  • ·  1+ years of experience of working with Redshift esp the following.

o   Experience and knowledge of loading data from various sources, e.g. s3 bucket and on-prem data sources into Redshift.

o   Experience of optimizing data ingestion into Redshift.

o   Experience of designing, developing and optimizing queries on Redshift using SQL or PySparkSQL

o   Experience of designing tables in Redshift(distribution key, compression etc., vacuuming,etc. ) 

·   Experience of developing applications that consume the services exposed as ReST APIs.·   Experience and ability to write and analyze complex and performant SQLs

Special Consideration given for  

  • ·2 years of Developing and supporting ETL pipelines using enterprise-grade ETL tools like Pentaho, Informatica, Talend
  • ·Good knowledge on Data Modelling(design patterns and best practices)
  • ·  Experience with Reporting Technologies (i.e. Tableau, PowerBI)

What you'll do

·   Analyze and understand customer's use case and data sources and extract, transform and load data from multitude of customer's enterprise sources and ingest into Adobe Experience Platform

·   Design and build data ingestion pipelines into the platform using PySpark

·   Ensure ingestion is designed and implemented in a performant manner to support the throughout and latency needed.

·   Develop and test complex SQLs to extract\analyze and report the data ingested into the Adobe Experience platform.

·   Ensure the SQLs are implemented in compliance with the best practice to they are performant.

·   Migrate platform configurations, including the data ingestion pipelines and SQL, across various sandboxes.

·   Debug any issues reported on data ingestion, SQL or any other functionalities of the platform and resolve the issues.

·   Support Data Architects in implementing data model in the platform.

·   Contribute to the innovation charter and develop intellectual property for the organization.

·   Present on advanced features and complex use case implementations at multiple forums.  

·   Attend regular scrum events or equivalent and provide update on the deliverables.

·   Work independently across multiple engagements with none or minimum supervision.

  • Data Engineer

    4 days ago

    Delhi, Delhi, India Straive Full time ₹ 6,00,000 - ₹ 12,00,000 per year

    Company DescriptionStraive operationalizes Data Analytics and AI for global enterprises, including several Fortune 500 companies, to drive efficiency and enhance user experience. As a global leader in AI-driven value creation, Straive empowers diverse clients across industries such as Banking, Financial and Information Services, Retail, Media and Technology,...

  • Data Engineer Lead

    1 day ago

    Delhi, Delhi, India Alpha Consultants Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Company Overview: Alpha Consultants is a leading technology consulting firm specializing in data engineering and cloud solutions. Our team of experts leverages cutting-edge technologies to deliver scalable and reliable solutions to our clients in the None industry. With a strong focus on innovation and quality, we help organizations transform their data into...

  • Azure Data Engineer

    1 week ago

    Delhi, Delhi, India Kryo Tech Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Role DescriptionThis is a contract remote role for anAzure Data Engineer/SeniorData Engineer job opening at aRetail companyoperates in Middle East. The Azure Data Engineer will be responsible for designing, implementing, and optimizing data pipelines using Azure Data Platform Services like Data Factory, Databricks, SQL Database, Synapse, Power BI. This...

  • Data Engineer

    1 week ago

    Delhi, Delhi, India VAYUZ Technologies Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Job Description:We are seeking a highly motivated and detail-oriented individual to join our team as a Data Engineer with experience in the designing, constructing, and maintaining the architecture and infrastructure necessary for data generation, storage and processing and contribute to the successful implementation of digital government policies and...

  • Data Engineer

    1 day ago

    Delhi, Delhi, India Talent Worx Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We are looking for a skilled Data Engineer / Database Administrator (DBA) to join our dynamic team at Talent Worx. This role involves designing, implementing, and maintaining database systems while ensuring data integrity and performance optimization. The ideal candidate will have a strong foundation in both data engineering and database...

  • Data Engineer

    2 weeks ago

    Delhi, Delhi, India Natlov Technologies Pvt Ltd Full time ₹ 6,00,000 - ₹ 12,00,000 per year

    Job descriptionHiring: Data Engineer (AWS )Location: Remote | Shift: 6 PM – 3 AM ISTJoin Natlov Technologies Pvt. Ltd. and be part of a dynamic data engineering teamWhat You'll DoBuild and optimize scalable data pipelines & modelsEnsure data quality, security, and performanceCollaborate across teams & mentor juniorsWork with modern tools like AWS,...

  • Data Warehouse Engineer

    3 days ago

    Delhi, Delhi, India Teknowledge Full time ₹ 5,00,000 - ₹ 12,00,000 per year

    OverviewWe're searching for a Data Warehouse Engineer with a proven track record of developing Business Intelligence solutions to drive key outcomes. The role is responsible for different layers of the data hierarchy - including database design, data collection and storage techniques, to a deep understanding of data transformation tools and methodologies,...

  • Data Engineer

    3 days ago

    Delhi, Delhi, India Natlov Technologies Pvt Ltd Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Hiring: Data Engineer (AWS )Location:Remote |Shift:6 PM – 3 AM ISTJoinNatlov Technologies Pvt. Ltd.and be part of a dynamic data engineering teamWhat You'll DoBuild and optimize scalable data pipelines & modelsEnsure data quality, security, and performanceCollaborate across teams & mentor juniorsWork with modern tools like AWS, BigQuery, Snowflake,...

  • Data Engineer

    2 weeks ago

    Delhi, Delhi, India Kuoni Tumlare Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Key Responsibilities : - Develop robust data pipelines and ETL workflows using Python and Apache Spark. - Orchestrate complex workflows using Databricks Workflows or Azure Data Factory. - Translate business rules, retention metadata, and data governance policies into reusable, modular, and scalable pipeline components. - Ensure adherence to data...

  • Senior Data Engineer

    3 days ago

    Delhi, Delhi, India AagatiServe Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Experience:5–8 YearsLocation:Delhi(Onsite)Employment Type:Full-timeAbout the Role:We are looking for a Senior Data Engineer to join our data engineering team and help design, build, and maintain scalable data pipelines and infrastructure on AWS. The ideal candidate will have strong hands-on experience in PySpark, SQL, and AWS services, with a passion for...