Data Engineer

1 week ago

Delhi NCR, India Leewayhertz Technologies Full time ₹ 15,00,000 - ₹ 20,00,000 per year

As a Senior Data Engineer, you will be responsible for designing, building, and optimizing data pipelines and lakehouse architectures on AWS. You will ensure data availability, quality, lineage, and governance across analytical and operational platforms. Your expertise will enable scalable, secure, and cost-effective data solutions that power advanced analytics and business intelligence.

Responsibilities:

  • Implement and manage S3 (raw, staging, curated zones), Glue Catalog, Lake Formation, and Iceberg/Hudi/Delta Lake for schema evolution and versioning.
  • Develop PySpark jobs on Glue/EMR, enforce schema validation, partitioning, and scalable transformations.
  • Build workflows using Step Functions, EventBridge, or Airflow (MWAA), with CI/CD deployments via CodePipeline & CodeBuild.
  • Apply schema contracts, validations (Glue Schema Registry, Deequ, Great Expectations), and maintain lineage/metadata using Glue Catalog or third-party tools (Atlan, OpenMetadata, Collibra).
  • Enable Athena and Redshift Spectrum queries, manage operational stores (DynamoDB/Aurora), and integrate with OpenSearch for observability.
  • Design efficient partitioning/bucketing strategies, adopt columnar formats (Parquet/ORC), and implement spot instance usage/bookmarking.
  • Enforce IAM-based access policies, apply KMS encryption, private endpoints, and GDPR/PII data masking.
  • Prepare Gold-layer KPIs for dashboards, forecasting, and customer insights with QuickSight, Superset, or Metabase.
  • Partner with analysts, data scientists, and DevOps to enable seamless data consumption and delivery.

Essential Skills

Job

  • Hands-on expertise with AWS data stack (S3, Glue, Lake Formation, Athena, Redshift, EMR, Lambda).
  • Strong programming skills in PySpark & Python for ETL, scripting, and automation.
  • Proficiency in SQL (CTEs, window functions, complex aggregations).
  • Experience in data governance, quality frameworks (Deequ, Great Expectations).
  • Knowledge of data modeling, partitioning strategies, and schema enforcement.
  • Familiarity with BI integration (QuickSight, Superset, Metabase).

Personal

  • Strong problem-solving ability in complex data environments.
  • Ability to communicate technical insights to non-technical stakeholders.
  • Commitment to best practices in data governance, compliance, and security.
  • Collaborative mindset with cross-functional teams.

Preferred Skills

Job

  • Real-time ingestion experience (Kinesis, MSK, Kafka on AWS).
  • Exposure to ML feature store integration with SageMaker.
  • Infrastructure as Code (Terraform, CloudFormation, or CDK).
  • Experience with Data Mesh or domain-driven data architecture.

Personal

  • Experience mentoring junior data engineers.
  • Ability to lead data projects from design to production.
  • Proactive in learning new AWS and data ecosystem technologies.

Other Relevant Information

  • Bachelors/Masters degree in Computer Science, Information Technology, or related field.
  • Minimum 4 years of proven experience in data engineering with AWS.
  • This role offers the flexibility of working remotely in India.

LeewayHertz is an equal opportunity employer and does not discriminate based on race, color, religion, sex, age, disability, national origin, sexual orientation, gender identity, or any other protected status. We encourage a diverse range of applicants.

  • Senior Data Engineer

    1 week ago

    Delhi, NCR, India MchooversPacific Data Integrators Full time US$ 1,00,000 - US$ 1,50,000 per year

    Job Title: Senior Data Engineer (IDMC-CDI)Primary Skills: SQL, IDMC (CDI), ETL ConceptsMode of Work: Remote/WFHExperience: 5-10 YearsAbout UsWe are PDI (Pacific Data Integrators), a leading provider of Data Management, Analytics, and Cloud solutions. As an Informatica Platinum Partner and a reseller of various market-leading products, we help enterprises...

  • Senior Data Engineer

    2 weeks ago

    Delhi, Delhi, India Aptus Data Labs Full time

    Job Title : Senior Data EngineerLocation : : 58 YearsEmployment Type : Full-TimeAbout the Role :Aptus Data Labs is looking for a talented and proactive Senior Data Engineer to help build the backbone of our enterprise data and AI initiatives. Youll work on modern data lake architectures and high-performance pipelines in AWS, enabling real-time insights and...

  • Data Engineer

    1 week ago

    Delhi, NCR, India SAM Manpower & Career Services Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Seeking an experienced Data Engineer with expertise in AWS, SQL, Data Warehousing, PySpark, Airflow, & streaming (Kafka/Flink). Must have strong skills in data pipelines, modern frameworks, file formats (Parquet/Delta/Iceberg), &cloud data solutions.

  • Data Engineer

    2 days ago

    Delhi NCR, Delhi, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    As a data engineer, you will be responsible for designing and building scalable data pipelines and architectures. Your expertise in integrating and transforming large-scale datasets from varied sources will enable seamless collaboration with solution designers to implement data ingestion and enrichment.Key Responsibilities:Data Pipeline Development: Design,...

  • Data Engineer Lead

    6 days ago

    Delhi, Delhi NCR, India beBeeData Full time US$ 90,000 - US$ 1,20,000

    Senior Data Engineer PositionWe are seeking an experienced Senior Data Engineer to join our team.This is a senior-level data engineering position that involves driving data engineering initiatives using Dataiku for data preparation, analysis, visualization, and deploying data solutions.The ideal candidate will have extensive experience with ETL/ELT processes...

  • Big Data Engineer

    1 week ago

    Delhi, NCR, India Qcentrio Full time US$ 90,000 - US$ 1,20,000 per year

    We are seeking an experienced and driven Data Engineer with 5+ years of hands-on experience in building scalable data infrastructure and systems. You will play a key role in designing and developing robust, high-performance ETL pipelines and managing large-scale datasets to support critical business functions. This role requires deep technical expertise,...

  • RRT Engineer

    1 week ago

    Delhi, NCR, India Intersoft Data Labs Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Software Engineer (Rapid Response Team)A strong background in .NET framework and related technologies, including: C# / Visual Basic (.NET)/ WPF (Windows Presentation Foundation) and XAMLEntity FrameworkProficiency in for modern front-end development.Solid experience with PostgreSQL, MySQL, and DynamoDB for database interaction.Working knowledge of...

  • Senior Data Engineer

    6 days ago

    Delhi, Delhi NCR, India beBeeDataEngineering Full time US$ 1,50,000 - US$ 2,00,000

    We are currently seeking an exceptional Data Engineering Professional to spearhead the design, development, and optimization of data processing pipelines on Databricks.As a key member of our team, you will be responsible for architecting scalable and efficient data models, collaborating with cross-functional teams to migrate existing solutions, and ensuring...

  • Data Engineering Lead

    1 week ago

    Delhi NCR, Delhi, India beBeeDataEngineer Full time US$ 90,000 - US$ 1,20,000

    Azure Databricks EngineerWe are seeking a skilled data professional to lead our data engineering efforts and establish an efficient data ecosystem. This role requires expertise in designing, implementing, and maintaining scalable data pipelines using Azure Data Bricks, Python, and Spark.Design and implement data pipelines that integrate with various data...

  • Data Engineer

    2 weeks ago

    Delhi NCR, Delhi, India beBeeDataEngineer Full time US$ 90,000 - US$ 1,20,000

    Job Title: Data Engineer - Cloud Data SolutionsWe are seeking a skilled professional to design, implement and optimize data processing pipelines on the Databricks platform. You will be responsible for architecting scalable data solutions, collaborating with cross-functional teams to migrate existing solutions, and ensuring the reliability and performance of...