Senior Data Engineer

11 hours ago


Gurugram, India Leewayhertz Technologies Full time

Role & responsibilities

As a Senior Data Engineer, you will be responsible for designing, building, and optimizing data pipelines and lakehouse architectures on AWS. You will ensure data availability, quality, lineage, and governance across analytical and operational platforms. Your expertise will enable scalable, secure, and cost-effective data solutions that power advanced analytics and business intelligence.

Responsibilities :

  • Implement and manage S3 (raw, staging, curated zones), Glue Catalog, Lake Formation, and Iceberg/Hudi/Delta Lake for schema evolution and versioning.
  • Develop PySpark jobs on Glue/EMR, enforce schema validation, partitioning, and scalable transformations.
  • Build workflows using Step Functions, EventBridge, or Airflow (MWAA), with CI/CD deployments via CodePipeline & CodeBuild.
  • Apply schema contracts, validations (Glue Schema Registry, Deequ, Great Expectations), and maintain lineage/metadata using Glue Catalog or third-party tools (Atlan, OpenMetadata, Collibra).
  • Enable Athena and Redshift Spectrum queries, manage operational stores (DynamoDB/Aurora), and integrate with OpenSearch for observability.
  • Design efficient partitioning/bucketing strategies, adopt columnar formats (Parquet/ORC), and implement spot instance usage/bookmarking.
  • Enforce IAM-based access policies, apply KMS encryption, private endpoints, and GDPR/PII data masking.
  • Prepare Gold-layer KPIs for dashboards, forecasting, and customer insights with QuickSight, Superset, or Metabase.
  • Partner with analysts, data scientists, and DevOps to enable seamless data consumption and delivery.

Preferred candidate profile

  • Hands-on expertise with AWS data stack (S3, Glue, Lake Formation, Athena, Redshift, EMR, Lambda).
  • Strong programming skills in PySpark & Python for ETL, scripting, and automation.
  • Proficiency in SQL (CTEs, window functions, complex aggregations).
  • Experience in data governance, quality frameworks (Deequ, Great Expectations).
  • Knowledge of data modeling, partitioning strategies, and schema enforcement.
  • Familiarity with BI integration (QuickSight, Superset, Metabase).

Benefits

  • This role offers the flexibility of working remotely in India.


  • Gurugram, India CoPoint Data Full time

    About CoPoint AI CoPoint AI is a specialized consulting firm focused on transforming businesses through process improvement, data insights, and technology-driven innovation. We leverage AI technologies, Microsoft cloud platforms, and modern web development frameworks to deliver intelligent, scalable solutions that drive measurable impact for our clients. Our...

  • Senior Data Engineer

    13 hours ago


    Gurugram, India Next Mantra Solution Private Limited Full time

    We're Hiring: Senior Data Engineer (AWS | ETL | Data Warehousing) Location: (Add location/Remote) | Experience: 3–10 years We're looking for aSenior Data Engineerto join our growing data team and help us buildscalable, secure, and high-performing data platformson AWS. If you are passionate about designing robust ETL pipelines and optimizing large-scale...


  • Gurugram, India Senior Full time

    Company Description Senior is a UK based MNC and has operations in 12 countries and has 26 operating businesses worldwide serving number of markets. Senior's experienced manpower support, effective use of raw material as well as high technology enable it to deliver optimized components within a short development time and at most competitive prices. Senior...

  • Senior Data Engineer

    12 hours ago


    Gurugram, India DGN INFOSOLUTION PVT. LTD. Full time

    Senior Data Engineer Location: Gurgaon Employment Type: full-time Team: Data & Insights About Blu Parrot: Blu Parrot is a leading innovator in the design and development of cutting-edge software solutions and products leveraging Data Science, Artificial Intelligence (AI), Large Language Models (LLM), and Generative AI technologies. With a passion for...


  • Gurugram, India CoPoint Data Full time

    About CoPoint Data CoPoint Data is a specialized consulting firm focused on transforming businesses through process improvement, data insights, and technology-driven innovation. We leverage AI technologies, Microsoft cloud platforms, and modern web development frameworks to deliver intelligent, scalable solutions that drive measurable impact for our clients....


  • Gurugram, India IT Firm Full time

    We are seeking an experienced and highly motivated Senior Data Engineer to join our dynamic team. The ideal candidate will play a critical role in designing, developing, and maintaining high-performance data infrastructure and pipelines. As a Senior Data Engineer, you will be responsible for ensuring the scalability, performance, and reliability of data...

  • Senior Data Engineer

    12 hours ago


    Gurugram, India Fabric Full time

    Company Name - Aays Analytics Job Summary - You will act as a key member of the Data consulting team, working directly with partners and senior stakeholders. You will design and implement big data and analytics solutions. Communication and organisational skills are key for this position. Key Responsibilities Develop data solutions within a Big Data Azure...

  • Senior Data Engineer

    11 hours ago


    Gurugram, India Egon Zehnder Full time

    The Company Egon Zehnder ) is trusted advisor to many of the world's most respected organizations and a leading Executive Search firm, with more than 600+ consultants and 69 offices in 41 countries spanning Europe, the Americas, Asia Pacific, the Middle East and Africa. Our clients range from the largest corporations to emerging growth companies, government...

  • Senior Data Engineer

    11 hours ago


    Gurugram, India Srijan: Now Material Full time

    : Senior Data Engineer - ETLCompany:Srijan Technologies PVT LTD Location:Gurgaon | Technology Team | Full-time | Partially remote Apply by:No close date About UsWe turn customer challenges into growth opportunities. Material is a global strategy partner to the worlds most recognizable brands and innovative companies. Our people around the globe thrive by...

  • Data Engineer

    2 weeks ago


    Bengaluru, Gurugram, India Trigent Software Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Detailed Job Description:We are currently seeking a Senior Data Engineer with hands-on coding experience and a strong background in Python, PySpark, and Object-oriented programming. The ideal candidate will be responsible for designing, developing, and implementing new features to our existing framework using PySpark and Python. This position requires a deep...