Data Engineer

4 days ago


Delhi, Delhi, India Environmental Resources Management Full time ₹ 9,00,000 - ₹ 12,00,000 per year

Who is ERM?

ERM is a leading global sustainability consulting firm, committed for nearly 50 years to helping organizations navigate complex environmental, social, and governance (ESG) challenges. We bring together a diverse and inclusive community of experts across regions and disciplines, providing a truly multicultural environment that fosters collaboration, professional growth, and meaningful global exposure. As a people-first organization, ERM values well-being, career development, and the power of collective expertise to drive sustainable impact for our clients—and the planet.

Introducing our new Global Delivery Centre (GDC)

Our Global Delivery Centre (GDC) in India is a unified platform designed to deliver high-value services and solutions to ERM's global clientele. By centralizing key business and consulting functions, we streamline operations, optimize service delivery, and enable our teams to focus on what matters most—advising clients on sustainability challenges with agility and innovation. Through the GDC, you will collaborate with international teams, leverage emerging technologies, and further enhance ERM's commitment to excellence—amplifying our shared mission to make a lasting, positive impact.

ERM is seeking a Data Engineer to join our Digital Products team. This is an exciting opportunity for an early- to mid-career data professional to support cutting-edge climate science by engineering high-performance data pipelines and workflows in Azure and Microsoft Fabric. The successful candidate will help operationalize global climate model data and other scientific datasets by applying algorithms developed by ERM's climate scientists and consultants, supporting large-scale climate risk assessments across sectors including energy, finance, infrastructure, and natural resources.

You'll work alongside a team of experts in climate science, software development, and environmental consulting. You'll also have access to a global network of technical specialists and opportunities to grow your skills within a purpose-driven organization.

RESPONSIBILITIES:

  • Develop, test, and maintain scalable data pipelines in Azure and Microsoft Fabric to process climate and environmental data.
  • Support the application of scientific algorithms to global climate model outputs and other multidimensional datasets (e.g., NetCDF, Zarr).
  • Optimize data pipelines for performance, scalability, and reliability, including benchmarking storage read/write speeds and tuning Spark-based workflows.
  • Implement logging, monitoring, and metadata management systems for traceability and auditability.
  • Evaluate and configure Azure storage (Blob, Data Lake, etc.) for climate-scale workloads; ensure performance alignment with data access needs.
  • Build and manage distributed processing pipelines to support large-scale data transformations using PySpark and parallel computing strategies.
  • Monitor and optimize I/O performance across workflows and storage tiers.
  • Collaborate with climate scientists and software engineers to translate prototype code into scalable, production-ready processes.
  • Document data engineering workflows and support internal data governance efforts.

REQUIREMENTS:

  • Bachelor's degree in Computer Science, Data Science, Environmental/Climate Science, Oceanography, or a related field.
  • 2+ years of experience in data engineering, including pipeline development and workflow optimization (cloud-based preferred).
  • Hands-on experience with Microsoft Azure data services and/or Microsoft Fabric.
  • Strong programming skills in Python; experience with Spark (PySpark or SparkSQL) in distributed environments.
  • Demonstrated experience working with large, multidimensional datasets (Zarr, NetCDF, HDF5).
  • Familiarity with cloud storage performance tuning and benchmarking techniques.
  • Experience implementing logging, monitoring, and metadata practices in data environments.
  • Strong communication skills, with ability to collaborate across technical and non-technical teams.
  • Preferred: Azure Data Engineering certification, or demonstrable equivalent experience.

  • Senior Data Engineer

    3 weeks ago


    Delhi, Delhi, India Aptus Data Labs Full time

    Job Title : Senior Data EngineerLocation : : 58 YearsEmployment Type : Full-TimeAbout the Role :Aptus Data Labs is looking for a talented and proactive Senior Data Engineer to help build the backbone of our enterprise data and AI initiatives. Youll work on modern data lake architectures and high-performance pipelines in AWS, enabling real-time insights and...

  • Data Engineer

    3 weeks ago


    Delhi, Delhi, India Comtek Full time

    About the Role : We are seeking a skilled Data Engineer to join our team and contribute to our cutting-edge data platform built on a medallion data lake architecture. You will design, develop, and maintain robust data pipelines while collaborating on innovative AI engineering projects. This role combines traditional data engineering responsibilities with...


  • Delhi, Delhi, India NTT DATA Full time

    Req ID 325447 NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Associate Software Engineer to join our team in NTT PAN India locations Delhi IN-DL India IN Role Overview...

  • Data Engineer

    22 hours ago


    Delhi, Delhi, India FlexionHire Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Company DescriptionHidden Road is the global credit network for institutions, enabling seamless access to both traditional and digital markets. Our conflict-free model built on a modern technology stack helps eliminate complexity and reduce costs in prime brokerage, clearing, and financing. For more information, please email Role DescriptionThis is a...

  • Data Engineer

    3 weeks ago


    Delhi, Delhi, India Reve Full time

    Job Title : Data EngineerThis is a unique opportunity to join our team as a skilled data engineer with extensive experience in Python-based data engineering.About the Role : - Design and develop scalable data pipelines using Python.- Work on API development, testing, and deployment.- Develop expertise in ETL/ELT tools and workflow orchestration.-...

  • Data Engineer

    1 week ago


    Delhi, Delhi, India Straive Full time ₹ 6,00,000 - ₹ 12,00,000 per year

    Company DescriptionStraive operationalizes Data Analytics and AI for global enterprises, including several Fortune 500 companies, to drive efficiency and enhance user experience. As a global leader in AI-driven value creation, Straive empowers diverse clients across industries such as Banking, Financial and Information Services, Retail, Media and Technology,...

  • Data Engineer

    3 weeks ago


    Delhi, Delhi, India Animaker Inc Full time

    Role Overview :We are looking for a highly skilled with expertise in Kafka, Python, and Azure Databricks (preferred) to drive our healthcare data engineering projects. The ideal candidate will have deep experience in real-time data streaming, cloud-based data platforms, and large-scale data processing. This role requires strong technical leadership,...

  • Data Engineer

    3 weeks ago


    Delhi, Delhi, India Haruto Technologies LLP Full time

    Role : GCP Data EngineerLocation : RemoteExperience Required : 5+ YearsAbout the Role :We are looking for an experienced GCP Data Engineer who has strong expertise in building and optimizing data pipelines, big data processing, and data warehousing solutions on Google Cloud Platform. The ideal candidate should be hands-on with BigQuery, DataProc, PySpark,...

  • Data Engineer

    3 weeks ago


    Delhi, Delhi, India SproutsAI Full time

    Job Description :The Data Engineer will be responsible for designing, developing, and maintaining the data infrastructure for a healthcare organization. The ideal candidate will have experience in working with healthcare data, including EHR, HIMS, PACS, and RIS. They will also have experience with SQL, Elasticsearch, and data integration tools such as :-...

  • Data Engineer

    3 weeks ago


    Delhi, Delhi, India Avisoft Full time

    Company DescriptionAvisoft is a Technology and IT company based in Mohali and Jammu. We are the preferred cost-effective and quality remote tech partner for global businesses. We offer Product Engineering, IT Consultancy, Project Outsourcing and Staff Augmentation services. We partner with businesses to design and build Tech platforms from scratch or to...