Data Engineer

2 weeks ago

Gurugram, India Avrio Full time

Overview


Avrio is an international climate tech startup leveraging advancements in AI to decarbonize the real estate industry which is responsible for around 39% of global carbon emissions. As a Machine Learning Engineer at Avrio, you will play a crucial role in developing AI-powered solutions that enhance our product offerings and improve our clients' business outcomes. You will work closely with data scientists and cross-functional teams to build and deploy scalable machine learning models that are critical to our products' success.


Responsibilities


  • Design, develop, and maintain scalable data pipelines and ETL processes to ingest, transform, and store large volumes of structured and unstructured data from diverse sources. Focus on implementing optimal storage solutions for time series data to ensure efficient access and query performance.
  • Develop and maintain a workflow orchestration system for efficiently running ETL and other machine learning pipelines. Implement scheduling, monitoring, and error-handling mechanisms to ensure the reliability and robustness of data processing workflows.
  • Manage infrastructure for alerting and recommendation systems, ensuring timely delivery of actionable insights to clients. Design and deploy scalable solutions for real-time monitoring, anomaly detection, and predictive analytics.
  • Collaborate with cross-functional teams including data scientists, software engineers, and domain experts to understand business requirements and translate them into scalable data engineering solutions.
  • Stay abreast of emerging technologies and best practices in data engineering, workflow orchestration, and infrastructure management. Evaluate and adopt new tools and frameworks to enhance efficiency, scalability, and reliability.
  • Provide technical guidance and mentorship to junior team members, fostering a culture of collaboration, innovation, and continuous learning.
  • Document data engineering processes, workflows, and infrastructure configurations. Ensure compliance with data governance policies, security standards, and regulatory requirements.


Qualifications


  • Bachelor's degree or higher in Computer Science, Engineering, or a related field.
  • Proven experience in data engineering, ETL development, and infrastructure management, preferably in a cloud-based environment.
  • Proficiency in programming languages such as Python, SQL, Java, or Scala, and experience with data processing frameworks like Apache Spark, Apache Beam, or Apache Flink.
  • Strong understanding of distributed computing principles, containerization technologies (e.g., Docker, Kubernetes), and cloud services (e.g., AWS, Azure, GCP).
  • Experience with workflow orchestration tools such as Apache Airflow, Luigi, or Prefect.
  • Knowledge of alerting systems (e.g., Prometheus, Grafana) and recommendation engines.
  • Excellent problem-solving skills, attention to detail, and ability to work independently and collaboratively in a fast-paced environment.
  • Strong communication and interpersonal skills, with the ability to effectively communicate technical concepts to both technical and non-technical stakeholders.


Culture Fit


  • Autonomy: We think your time is sacred, whether it's at work, or outside of work.
  • Ownership: We're a company with a high ownership, high autonomy culture. We hope that you'll come in, help us, and over the course of many years do the best work of your life. When we bring you onboard, we expect you to change the company.
  • New hard problems: We are at the frontier in our industry building cutting-edge solutions. You will constantly have new interesting and hard problems to solve.
  • Growth: We are committed to your professional development. The dynamic nature of our work provides abundant opportunities for personal and career growth.

  • Data Engineer

    2 weeks ago

    Gurugram, India NatWest Group Full time

    Join us as a Data EngineerThis is an exciting opportunity to use your technical expertise to collaborate with colleagues and build effortless, digital first customer experiencesYou’ll be simplifying the bank by developing innovative data driven solutions, using insight to be commercially successful, and keeping our customers’ and the bank’s data safe...

  • Data Engineer

    1 week ago

    Gurugram, India NatWest Digital X Full time

    Join us as a Data EngineerThis is an exciting opportunity to use your technical expertise to collaborate with colleagues and build effortless, digital first customer experiencesYou’ll be simplifying the bank by developing innovative data driven solutions, using insight to be commercially successful, and keeping our customers’ and the bank’s data safe...

  • Data Engineer

    7 days ago

    Gurugram, India NAB Full time

    Consultant - Data Engineer role exists to ensure the delivery of the Right data to the Right customer at the Right time and at the Right Cost using the Right tools and the Right Technology on NAB’s target state Marketing Platforms. You will enable the move, flow and processing of reusable data assets in the Technology and Enterprise Operations space for...

  • Data Engineer

    6 days ago

    Gurugram, India NAB Full time

    Consultant - Data Engineer role exists to ensure the delivery of the Right data to the Right customer at the Right time and at the Right Cost using the Right tools and the Right Technology on NAB’s target state Marketing Platforms. You will enable the move, flow and processing of reusable data assets in the Technology and Enterprise Operations space for...

  • Data Engineer

    2 days ago

    Gurugram, India Virtusa Full time

    Data Engineer - CREQ188856 Description Job Description Skill: Data Engineer Role: T3, T2 Key responsibility: Role Name: Data Engineer Must have 5+ years of experience in below mentioned skills. Must Have: Big Data Concepts , Python, SQL, Shell Scripting, AWS S3 Good to Have: Event-driven/AWA SQS, Microservices, API Development, Kafka,...

  • Data Engineer

    2 days ago

    gurugram, India Virtusa Full time

    Data Engineer - CREQ188856 Description Job Description Skill: Data Engineer Role: T3, T2 Key responsibility: Role Name: Data EngineerMust have 5+ years of experience in below mentioned skills.Must Have: Big Data Concepts , Python, SQL, Shell Scripting, AWS S3Good to Have: Event-driven/AWA SQS, Microservices, API Development, Kafka,...

  • Data Engineer

    5 days ago

    gurugram, India Crescent Techservices Full time

    Role : GCP Data Engineer Location : Gurgaon Experience : 3+ Years Responsibilities: Design, develop, and maintain scalable and efficient data pipelines on Google Cloud Platform (GCP). Collaborate with data architects to implement data models and ensure seamless integration with GCP services. Extract, transform, and load (ETL) data from various sources...

  • Data Engineer

    6 days ago

    Gurugram, India Crescent Techservices Full time

    Role: GCP Data EngineerLocation: Gurgaon Experience: 3+ Years Responsibilities:Design, develop, and maintain scalable and efficient data pipelines on Google Cloud Platform (GCP). Collaborate with data architects to implement data models and ensure seamless integration with GCP services. Extract, transform, and load (ETL) data from various sources into GCP...

  • Data Engineer

    5 days ago

    Gurugram, India Crescent Techservices Full time

    Role: GCP Data EngineerLocation: Gurgaon Experience: 3+ Years Responsibilities:Design, develop, and maintain scalable and efficient data pipelines on Google Cloud Platform (GCP). Collaborate with data architects to implement data models and ensure seamless integration with GCP services. Extract, transform, and load (ETL) data from various sources into GCP...

  • Data Engineer

    4 weeks ago

    Gurugram, India Nutrabay Full time

    We are seeking a skilled Data Engineer to join our team. The ideal candidate will be responsible for handling the movement of data from various sources to our data warehouses and data lakes. The candidate should have a strong understanding of data engineering concepts and experience working with databases such as Redshift, MySQL, and technologies like Athena...

  • Data Engineer

    4 weeks ago

    Gurugram, India Nutrabay Full time

    We are seeking a skilled Data Engineer to join our team. The ideal candidate will be responsible for handling the movement of data from various sources to our data warehouses and data lakes. The candidate should have a strong understanding of data engineering concepts and experience working with databases such as Redshift, MySQL, and technologies like Athena...

  • Data Engineer

    1 month ago

    Gurugram, India Yum! Digital & Tech India Full time

    We’re in search of a candidate who knows about and loves working with modern data integration frameworks, big data and cloud technologies. Candidates must also be proficient with data programming languages (e.g., Python and SQL). The Yum! data engineer will build a variety of data pipelines and models to support advanced AI/ML analytics projects - with the...

  • Data Engineer

    1 month ago

    Gurugram, India Yum! Digital & Tech India Full time

    We’re in search of a candidate who knows about and loves working with modern data integration frameworks, big data and cloud technologies. Candidates must also be proficient with data programming languages (e.g., Python and SQL). The Yum! data engineer will build a variety of data pipelines and models to support advanced AI/ML analytics projects - with the...

  • Data Engineer

    4 weeks ago

    Gurugram, India EXL Full time

    Role Overview: We are looking for a go-getter person who can help support: o Data strategies to meet the demands of business requirements Technical requirements of the organizational data needs from diverse teams Data architecture, models and go-forward data solutions for various teams of the organization • The person will be part of the Data Solutions...

  • Data Engineer

    4 weeks ago

    Gurugram, India EXL Full time

    Role Overview: We are looking for a go-getter person who can help support: o Data strategies to meet the demands of business requirements Technical requirements of the organizational data needs from diverse teams Data architecture, models and go-forward data solutions for various teams of the organization • The person will be part of the Data Solutions...

  • Data Engineer

    4 weeks ago

    Gurugram, India EXL Full time

    Role Overview: We are looking for a go-getter person who can help support: o Data strategies to meet the demands of business requirements Technical requirements of the organizational data needs from diverse teams Data architecture, models and go-forward data solutions for various teams of the organization • The person will be part of the Data Solutions...

  • Lead Data Engineer

    1 month ago

    Gurugram, India MakeMyTrip Full time

    Position: Lead Data Engineer / Principal Data EngineerExperience: Must have 6+ years of experienceAbout Role:We are looking for experienced Data engineers with excellent problem-solving skills to develop machine-learning powered Data Products design to enhance customer experiences.About us:Nurtured from the seed of a single great idea - to empower the...

  • Lead Data Engineer

    1 month ago

    Gurugram, India MakeMyTrip Full time

    Position: Lead Data Engineer / Principal Data EngineerExperience: Must have 6+ years of experienceAbout Role:We are looking for experienced Data engineers with excellent problem-solving skills to develop machine-learning powered Data Products design to enhance customer experiences.About us:Nurtured from the seed of a single great idea - to empower the...

  • Lead Data Engineer

    1 month ago

    Gurugram, India MakeMyTrip Full time

    Position: Lead Data Engineer / Principal Data Engineer Experience: Must have 6+ years of experience About Role: We are looking for experienced Data engineers with excellent problem-solving skills to develop machine-learning powered Data Products design to enhance customer experiences. About us: Nurtured from the seed of a single great idea - to empower...

  • Data Engineer

    7 days ago

    Gurugram, India Wipro Full time

    Band: B2Location: Offshore (Gurgaon/Bangalore)Shift Timings- 12:00 PM to 9:30 PMJob SummaryJob Overview:Our team is actively seeking a motivated and talented Visualization Engineer with Data Warehousing skills who is passionate about requirement gathering and refinement. What are we looking for?We want strong collaborators who can deliver a world-class...