Senior Data Engineer

3 hours ago

Gurugram Haryana India, IN KOGTA FINANCIAL LIMITED Full time

Job Summary

Kogta Financial Ltd. is seeking an experienced and highly skilled ETL & Data Warehouse Developer with strong expertise in AWS data services. As a key member of our data engineering team, you will be responsible for designing, developing, and optimizing ETL pipelines and scalable data warehouse solutions on the AWS platform. The ideal candidate will have a solid background in data modeling, SQL performance tuning, and AWS-based data architectures.


Key Responsibilities

1. ETL Development

  • Design, develop, and implement robust ETL processes using AWS EMR, AWS Data Pipeline, or custom scripts.
  • Ensure efficient extraction, transformation, and loading of data from multiple sources into the data warehouse.

2. Data Warehousing

  • Design and maintain scalable, high-performance data warehouse solutions on AWS.
  • Implement optimized data models and structures for AWS Redshift or equivalent environments.

3. AWS Service Utilization

  • Leverage AWS services such as S3, Lambda, Redshift, EMR, Step Functions and others to build end-to-end data solutions.
  • Stay updated with AWS advancements and recommend new tools or services to enhance data infrastructure.

4. SQL Expertise

  • Develop and optimize complex SQL queries, stored procedures, and views for analytics and reporting.
  • Troubleshoot and fine-tune SQL performance to ensure efficient data retrieval.

5. Pyspark Expertise

  • Design, Develop and optimize ETL pipelines using Pyspark.
  • Leverage optimization and data modelling capabilities to design data pipelines.

6. Performance Optimization

  • Continuously monitor and enhance ETL and query performance.
  • Identify and resolve processing bottlenecks across data pipelines and warehouse layers.

7. Data Integration & Collaboration

  • Collaborate with cross-functional teams to integrate data from multiple systems.
  • Partner with business stakeholders to understand and deliver on data requirements.

8. Security & Compliance

  • Implement strong data security and governance measures.
  • Ensure compliance with relevant industry standards and organizational policies.

9. Documentation

  • Maintain detailed documentation for ETL processes, data models, and configurations.
  • Ensure proper handover and knowledge transfer within the team.


Qualifications & Skills

  • Bachelor’s degree in Computer Science, Information Technology, or a related field.
  • Experience with Spark Streaming will be an advantage.
  • Proven experience as an ETL / Data Warehouse Developer with expertise in AWS and SQL.
  • Strong proficiency in SQL, including complex queries and performance tuning.
  • Hands on experience with developing and maintaining ETL pipeline using Pyspark.
  • Excellent understanding of Spark architecture.
  • Hands-on experience with AWS services such as S3, EMR, Redshift, Lambda, and Step Functions.
  • Solid understanding of data modeling, data integration, and warehousing principles.
  • Familiarity with data security, compliance, and governance best practices.
  • Strong analytical, problem-solving, and communication skills.
  • AWS Certification or equivalent credentials preferred.

  • Senior Data Engineer

    3 hours ago

    Gurugram, Haryana, India, IN Pacific Data Integrators Full time

    Role: Senior Data EngineerLocation: RemoteJob Type: Full-timeShift time: Open to work in EST shift (5PM to 2AM IST) Key ResponsibilitiesLead the design, development, and implementation of complex data integration solutions using Informatica Intelligent Data Management Cloud (IDMC).Develop, document, unit test, and maintain high-quality ETL applications that...

  • Senior Data Engineer

    3 hours ago

    Gurugram, Haryana, India, IN dunnhumby Full time

    Retail Media is transforming how advertisers connect with consumers through personalized and targeted campaigns across retailers' digital and physical touchpoints. Retail Media Measurement plays a pivotal role in ensuring the effectiveness of these campaigns, driving value for advertisers, retailers, and consumers alike.This role focuses on designing,...

  • Data Engineer

    3 hours ago

    Gurugram, Haryana, India, IN IGT Solutions Full time

    Job Title: Senior Data EngineerExperience: 6 to 9 YearsLocation: Hybrid (Gurgaon)Employment Type: Full-timeJob Summary:We are seeking a highly skilled Senior Data Engineer with hands-on experience in Databricks, PySpark, ETL development, and SQL. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines and...

  • Senior Data Analyst

    3 hours ago

    Gurugram, Haryana, India, IN FedEx Full time

    Role Overview: Join our Customer Experience Analytics team as a Senior Analyst, driving data-driven decisions to improve customer satisfaction. You will analyze diverse datasets, develop actionable insights, and present findings to senior leaders to enhance key metrics and decision-making processes. Key Responsibilities:Data Analysis & Insights • Analyze...

  • Senior Data Analyst

    3 hours ago

    Gurugram, Haryana, India, IN Appnext Full time

    Appnext offers end-to-end discovery solutions covering all the touchpoints users have with their devices. Thanks to Appnext’s direct partnerships with top OEM brands and carriers, user engagement is achieved from the moment they personalize their device for the first time and throughout their daily mobile journey.Appnext ‘Timeline’, a patented...

  • Data Engineer

    3 hours ago

    Gurugram, Haryana, India, IN NAB Full time

    Experience – 4 to 14 years Skills -• Proficient in executing ETL processes between data environments• Proficient at coding in SQL (additional knowledge in Python and R is highly regarded)• Proficient at creating analytics related documentation• Communication skills (written and verbal)• Stakeholder engagement skills• Commercial problem-solving...

  • Performance Marketing

    3 hours ago

    Gurugram, Haryana, India, IN Antara Senior Care Full time

    Google Performance Marketing Manager – Ageasy (Antara Senior Care)Location: Gurgaon.Experience: 5+yearsFunction: Performance Marketing (Google)The RoleYou’ll be the go-to person for everything Google Ads building, managing, and scaling performance campaigns across Search, Shopping, Display, and YouTube.This is a builder’s role ideal for someone who has...

  • Performance Marketing Lead

    3 hours ago

    Gurugram, Haryana, India, IN Antara Senior Care Full time

    About Ageasy by AntaraAgeasy is a direct-to-consumer (D2C) brand under Antara, a part of the Max Group, dedicated to enhancing the lives of seniors through thoughtful products and services. Ageasy offers a curated range of products tailored to the evolving needs of the elderly, and is on a mission to become the leading senior care D2C brand in India.Role...

  • Data Engineer

    3 hours ago

    Gurugram, Haryana, India, IN Terra Technology Circle Consulting Private Limited Full time

    Job Title: Data EngineerExperience: 4–8 yearsLocation: GurugramEmployment Type: ContractualAbout the RoleWe are seeking a highly skilled and motivated Data Engineer to join our growing data and analytics team. In this role, you will design, build, and optimize scalable data pipelines and architectures to support analytics, machine learning, and business...

  • Senior Data Engineer

    3 hours ago

    , India, IN Donyati Full time

    Senior Data Engineer Job Title: Senior Data EngineerLocation: Remote/ Willing to TravelJob Type: Full-timeExperience Level: 8+ yearsAbout the Role:We are seeking a highly skilled Senior Data Engineer to join our team in building a modern data platform on AWS. You will play a key role in transitioning from legacy systems to a scalable, cloud-native...