Data Engineer

1 month ago

New Delhi, India ICF Full time

ICF (NASDAQ: ICFI) is a global consulting services company with over 9,000 full- and part-time employees, but we are not your typical consultants. At ICF, business analysts and policy specialists work together with digital strategists, data scientists and creatives. We combine unmatched industry expertise with cutting-edge engagement capabilities to help organizations solve their most complex challenges. Since 1969, public and private sector clients have worked with ICF to navigate change and shape the future. Learn more at icf.com.

We are looking for a Data Engineer to assist ICF in contributing to the development of innovative, accurate, timely, and high-quality products and services, typically working on multiple projects with all levels of staff. You will have the opportunity to apply academic knowledge, gain exposure to major projects, and interact with experts and clients in the field while building content knowledge and consulting skills. 

Location - New Delhi


Key Responsibilities:
1. Data Acquisition and Processing:

Extract, transform, and load (ETL) data from various sources including ISOs and public regulatory agencies. Develop and maintain web scrapers to gather real-time power market analytics. Implement RESTful services to fetch data and handle asynchronous tasks efficiently.

2. Data Warehousing and Optimization:

Design and manage data warehouse solutions using Azure Data Lake Streamline data processes to ensure fast and reliable access to clean and accurate data.

3. Cloud-Based ETL Development:

Design, build, and optimize ETL jobs leveraging Azure services. Integrate with various Azure services to enhance the data pipeline's scalability and resilience.

4. Collaboration and Communication:

Work closely with data SMEs, analysts, and stakeholders to ensure data availability and accuracy. Provide documentation and share knowledge on developed pipelines with the team.

5. Continuous Improvement:

Keep abreast of the latest developments in Azure services and the power markets domain. Proactively identify opportunities for process improvements and introduce best practices.

Basic Qualifications:

Bachelor's degree in Computer Science, Data Science, Operations Research, Engineering, or a related field. 2+ years of minimum experience in power markets or any other quantitative advisory role Familiarity with the Power markets and Energy Policy. Proven experience in web scraping, data warehousing, and streamlining data. Hands-on experience with RESTful service development and asynchronous functions. Prior experience in building and optimizing ETL jobs on cloud platforms.

Preferred Qualifications:

Extensive experience with Azure services, including but not limited to AKS, Azure Batch, Azure Data Factory, Azure Data Lake, Azure Functions, and Azure Blob Storage. Strong understanding of distributed systems and cloud-based architectures. Knowledge and experience with Operations Research techniques such as Linear Programming, Integer Programming, Nonlinear Programming, and other optimization models. Familiarity with tools like CPLEX, Gurobi, or similar optimization solvers is a plus. Demonstrated ability to apply OR techniques to real-world problems. Excellent problem-solving skills, combined with the ability to work in fast-paced environments.

  • Operations Specialist

    5 days ago

    Delhi, India Data Engineer Academy Full time

    Job Title: Operations AnalystLocation : RemoteCompany Overview:Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary to...

  • Operations Specialist

    6 days ago

    Delhi, India Data Engineer Academy Full time

    Job Title: Operations AnalystLocation : RemoteCompany Overview:Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary to...

  • ▷ (25/05/2024) Operations Specialist

    6 days ago

    Delhi, India Data Engineer Academy Full time

    Job Title: Operations AnalystLocation : RemoteCompany Overview:Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary to...

  • Snowflake Data Engineer

    3 days ago

    delhi, India Lapis Data Analytics Full time

    Company DescriptionLapis Data Analytics is a dynamic and innovative data engineering company founded in 2020 and located in Chennai. Our primary focus is on designing, building, and maintaining robust data pipelines that convert raw data into actionable insights. With a team of seasoned experts and cutting-edge technology, we deliver customized data...

  • Digital Engineering Sr. Engineer

    16 hours ago

    New Delhi, India NTT DATA Full time

    Job Description Req ID: 273690 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Sr. Engineer to join our team in Delhi, Delhi (IN-DL), India...

  • Data Engineer

    4 weeks ago

    New Delhi, India Aprisity Technologies Full time

    We are looking for an experienced data engineer to join our team. You will use various methods to transform raw data into useful data systems. For example, you’ll create algorithms and conduct statistical analysis. Overall, you’ll strive for efficiency by aligning data systems with business goals.To succeed in this data engineering position, you should...

  • Data Engineer

    1 month ago

    New Delhi, India Aprisity Technologies Full time

    We are looking for an experienced data engineer to join our team. You will use various methods to transform raw data into useful data systems. For example, you’ll create algorithms and conduct statistical analysis. Overall, you’ll strive for efficiency by aligning data systems with business goals. To succeed in this data engineering position, you should...

  • Data Engineer

    4 weeks ago

    new delhi, India Aprisity Technologies Full time

    We are looking for an experienced data engineer to join our team. You will use various methods to transform raw data into useful data systems. For example, you’ll create algorithms and conduct statistical analysis. Overall, you’ll strive for efficiency by aligning data systems with business goals. To succeed in this data engineering position, you should...

  • Digital Engineering Sr. Engineer

    18 hours ago

    new delhi, India NTT DATA Services Full time

    Req ID:  273690  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Digital Engineering Sr. Engineer to join our team in Delhi, Delhi (IN-DL), India (IN). Responsibilities:-...

  • Digital Engineering Sr. Engineer

    1 day ago

    New Delhi, India NTT DATA Services Full time

    Req ID: 273690 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Sr. Engineer to join our team in Delhi, Delhi (IN-DL), India (IN).Responsibilities:-...

  • Data Engineer

    2 weeks ago

    new delhi, India System Soft Technologies Full time

    Job Summary Overall, as a data engineer working within the Microsoft ecosystem, your role will be crucial in ensuring that the organization's data is accurate, reliable, and readily available for decision-making purposesQualificationAs a data engineer, your main responsibilities will involve designing, implementing, and maintaining data pipelines to...

  • Data Engineer

    2 weeks ago

    new delhi, India System Soft Technologies Full time

    Job SummaryOverall, as a data engineer working within the Microsoft ecosystem, your role will be crucial in ensuring that the organization's data is accurate, reliable, and readily available for decision-making purposesQualificationAs a data engineer, your main responsibilities will involve designing, implementing, and maintaining data pipelines to extract,...

  • Data Engineer

    2 weeks ago

    new delhi, India comfidentil Full time

    Data EngineerLocation: RemoteJob Type: Full-TimeWe are currently seeking a highly skilled and motivated Data Engineer with expertise in managingGreenplum PostgreSQLdatabases to join our team. With a minimum of6+ years of experience , the ideal candidate will play a crucial role in ensuring the reliability, performance, and scalability of our data...

  • Data Engineer

    2 days ago

    new delhi, India Capleo Global Full time

    Lead Data EngineerExperience: 8-10 yearsLocation: BengaluruAvailability: Immediate to 30 daysMandatory Skills:SparkDatabricksPySpark or ScalaSQL & PythonGithubDWH (Snowflake or Presto or Hive or Hadoop)Data Pipeline & Data ModelWe are seeking an experienced Senior Data Engineer to join our dynamic team in Bengaluru. If you are passionate about shaping the...

  • Data Engineer

    1 week ago

    new delhi, India Expedify Full time

    Overview Expedify.iois looking for an intelligent and detailoriented Data Engineer tojoin our ever expanding team of data engineering and analytics. Thehire will be responsible for building and optimizing our datapipeline architecture optimizing data flow and suggesting the rightset of tooling for thesame.Ourcandidate will be working directly with the senior...

  • Data Engineer

    5 days ago

    New Delhi, India Cynosure Corporate Solutions Full time

    Data Engineer Office Location: Delhi (Work from Office)Job Type: Full-timeExperience: 3+ YearsJob Description: We are looking for Data Engineers to join our team. You will use various methods to transform raw data into useful data systems. For example, you’ll create algorithms and conduct statistical analysis. Overall, you’ll strive for efficiency by...

  • Data Engineer

    2 weeks ago

    new delhi, India Vaisesika Full time

    Vaisesikais urgently looking for Data Engineers with experience in Python, Pandas and Data Analytics.Location: RemoteExperience: 5+ yearsInterested candidates share their updated resume to

  • Data Engineer

    5 days ago

    New Delhi, India Cynosure Corporate Solutions Full time

    Data EngineerOffice Location: Delhi (Work from Office)  Job Type: Full-time  Experience: 3+ Years  Job Description: We are looking for Data Engineers to join our team. You will use various methods to transform raw data into useful data systems. For example, you’ll create algorithms and conduct statistical analysis. Overall, you’ll strive for...

  • Data Engineer

    2 weeks ago

    New Delhi, India Uplers Full time

    Uplers - Uplers, originated as an outsourcing firm in 2012, evolved to offer innovative solutions beyond expertise.Uplers is a pioneering talent matchmaking platform that bridges the gap between global companies and top-tier Indian professionals, redefining remote hiring through robust technical skill assessments tailored to specific roles. Uplers seamlessly...

  • Data Engineer

    2 weeks ago

    New Delhi, India Uplers Full time

    Uplers - Uplers, originated as an outsourcing firm in 2012, evolved to offer innovative solutions beyond expertise.Uplers is a pioneering talent matchmaking platform that bridges the gap between global companies and top-tier Indian professionals, redefining remote hiring through robust technical skill assessments tailored to specific roles. Uplers seamlessly...