Data Engineer

4 weeks ago


india Talhive HR Management LLP Full time

About Loopio :

Loopio supercharges the way companies respond to Requests for Proposals (RFPs), Due Diligence Questionnaires (DDQs), and Security Questionnaires.

Our platform helps our 900 customers work faster, create higher-quality proposals, and win more business. Our mission is to empower people to focus on what matters.

We do this by giving both our customers and employees the tools they need to make an impact faster. Loopers as our team members are affectionately dubbed driven and passionate.

We're obsessed with feedback, personal growth, and doing work we're proud of. Empower people to focus on what matters.

From our Loopers (employees) to our Loopio Champions (customers), we aim to empower all of the people in Loopio's ecosystem to focus on winning, growth, differentiation, autonomy, mastery, purpose, and more of the things that matter

Job Description :

Function : IT Operations and Support - DevOps / Cloud, Software Engineering - Big Data / DWH / ETL Amazon RedshiftPythonAmazon S3MapReduceAWS Glue

As an AWS Data Engineer focused on our SaaS application, you will play a key role in designing, implementing, and maintaining data pipelines and infrastructure on the AWS platform.

You will collaborate closely with cross-functional teams, including software engineers and data scientists, to gather requirements, design data solutions, and ensure the availability of high-quality datasets for machine-learning analysis.

The ideal candidate will have a strong background in AWS services and data engineering.

Responsibilities :

- Design, develop, and deploy scalable data pipelines on AWS to support the creation of machine-learning-ready datasets for our SaaS application.

- Collaborate with software engineers to integrate data pipelines into our SaaS application architecture, ensuring seamless data ingestion and processing.

- Implement efficient ETL processes to extract, transform, and load data from various sources, including internal databases, third-party APIs, and streaming sources.

- Optimize data storage and retrieval for performance, scalability, and cost-effectiveness, leveraging AWS services such as S3 Glue, Redshift, Athena, etc.

- Work closely with data scientists to understand modeling requirements and ensure the availability of clean, curated datasets for training and evaluation.

- Monitor and troubleshoot data pipelines to ensure reliability, availability, and data quality, implementing automated testing and alerting mechanisms.

- Implement security best practices for data storage, transmission, and access control, ensuring compliance with relevant regulations and standards.

- Document design specifications, deployment procedures, and operational processes, facilitating knowledge sharing and collaboration within the team.

Requirements :

- Bachelor's degree in Computer Science, Engineering, or a related field.

- Proven experience as a Data Engineer or similar role, with at least 4 years of experience.

- Strong proficiency in AWS services such as S3 Glue, Redshift, Athena, EMR, Lambda, etc.

- Hands-on experience with data modeling, ETL development, and SQL.

- Excellent problem-solving skills and attention to detail.

- Strong communication and collaboration skills.

- AWS certification (e.g., AWS Certified Data Analytics - Specialty, AWS Certified Solutions Architect - Associate).

- Experience with programming languages such as Python, Scala, or Java.

- Experience with containerization and orchestration tools such as Docker and Kubernetes.

- Familiarity with DevOps practices and tools for CI/CD.

- Familiarity with machine learning concepts and workflows, including data preprocessing, feature engineering, and model evaluation.

- Experience with real-time data processing and streaming technologies.

(ref:hirist.tech)
  • Operations Specialist

    1 month ago


    India Data Engineer Academy Full time

    Job Title: Operations Analyst Location : RemoteCompany Overview:Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary to...

  • Operations Specialist

    4 weeks ago


    india Data Engineer Academy Full time

    Job Title: Operations Analyst Location : Remote Company Overview: Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary...

  • Operations Specialist

    4 weeks ago


    india Data Engineer Academy Full time

    Job Title: Operations Analyst Location : Remote Company Overview: Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary...


  • India Data Engineer Academy Full time

    Job Title: Operations Analyst Location : Remote Company Overview: Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary...


  • india Lapis Data Analytics Full time

    Company Description Lapis Data Analytics is a dynamic and innovative data engineering company founded in 2020 and located in Chennai. Our primary focus is on designing, building, and maintaining robust data pipelines that convert raw data into actionable insights. With a team of seasoned experts and cutting-edge technology, we deliver customized data...


  • india K2 Data & Analytics Full time

    Job Description : We are on the lookout for an enthusiastic ML Engineer with over five years of experience to be part of our team, which is focused on developing cutting-edge Video Ad Data technologies. The perfect fit for this role would be someone with a solid grasp of machine learning algorithms and a background in designing and executing large-scale...

  • Data Architect

    6 days ago


    India Aptus Data Labs Full time

    Role - Data Architect/Data Engineer Lead- AWSExp - 8+ YearsLocation - RemoteSkills - Data architecture, Data modelling & design, Data Governance, MDM, Python, SQL, ETL, AWS CloudWe are seeking a highly skilled and experienced Data Architect to join our team. The ideal candidate will have 8+ years of experience in data architecture, with a focus on AWS cloud...

  • Aptus Data Labs

    1 month ago


    india Aptus Data Labs Full time

    Role - Data Architect/Data Engineer Lead- AWSExp - 8+ YearsLocation - RemoteSkills - Data architecture, Data modelling & design, Data Governance, MDM, Python, SQL, ETL, AWS CloudWe are seeking a highly skilled and experienced Data Architect to join our team. The ideal candidate will have 8+ years of experience in data architecture, with a focus on AWS cloud...

  • MLOps Engineer

    1 month ago


    india GOOGNU DATA SERVICES PRIVATE LIMITED Full time

    Job Description :- Design and Implement MLOps Infrastructure: Build and maintain robust MLOps workflows using Azure Machine Learning and other Azure services to automate machine learning lifecycle from data preparation to model deployment and monitoring.- Collaborate with Cross-Functional Teams: Work closely with data scientists, software developers, and IT...

  • QA Engineer

    1 month ago


    india Data Unveil Full time

    Position Title: QA Engineer Level: Mid-Level Location: Hyderabad, Telangana. Hire Type: Full Time Start Date: Immediate Minimum 3+ years of QA experience in data projects. Collaborate with the Development/Business teams to understand the requirements. Analyzing Business Requirements/cases and developing/managing the positive/negative test scenarios cases....

  • Senior Engineer

    12 hours ago


    india NTT DATA Full time

    Job Description Make an impact with NTT DATA Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive. Your day at...

  • Tableau Developer

    3 days ago


    India The Data Family Full time

    Company Description The Data Family offers analytics and data visualization services designed to transform data into actionable insights for our clients. Through our service, customers can access expert analytics, robust data engineering, and captivating visualizations to drive better decision-making and uncover opportunities for growth. Our primary...

  • Tableau Developer

    3 days ago


    India The Data Family Full time

    Company DescriptionThe Data Family offers analytics and data visualization services designed to transform data into actionable insights for our clients. Through our service, customers can access expert analytics, robust data engineering, and captivating visualizations to drive better decision-making and uncover opportunities for growth. Our primary customers...


  • India NTT DATA Full time

    Job Description NTT is a leading global IT solutions and services organisation that brings together people, data and things to create a better and more sustainable future. In today's 'iNTTerconnected' world, connections matter more now than ever. By bringing together talented people, world-class technology partners and emerging innovators, we help our...

  • Data Engineer

    4 hours ago


    India krtrimaIQ Cognitive Solutions Full time

    Company DescriptionkrtrimaIQ Cognitive Solutions is a technology company specializing in Cognitive Process Automation, Data Engineering, Statistical Analysis and Optimization, Data Science, Natural Language Processing, and Computer Vision. Our expertise allows us to transform organizations into intelligent enterprises.Role DescriptionThis is a full-time...


  • india NTT DATA Full time

    Job Description NTT is a leading global IT solutions and services organisation that brings together people, data and things to create a better and more sustainable future. In today’s ‘iNTTerconnected’ world, connections matter more now than ever. By bringing together talented people, world-class technology partners and emerging innovators, we help...

  • Data Engineer

    6 days ago


    India Paralleldots Full time

    Job Description : As a Senior Data Engineer at ParallelDots, you will be responsible for overseeing the design and development of advanced data solutions.You will work closely with data scientists, analysts, and other stakeholders to ensure that our data infrastructure meets the highest standards of scalability, reliability, and : Lead the design,...

  • Data Engineer

    6 days ago


    India Perfecthire Full time

    Job Description : We are seeking a talented and experienced Data Engineer to join our team and play a key role in the development and implementation of our end-to-end 834 EDI solution. A robust level of experience or familiarity with 834 EDI (Electronic Data Interchange) transactions is critical for this role. As a Data Engineer, you will be responsible...

  • Data Engineer

    2 months ago


    india HTC Global Services Full time

    Position Description: • This role is for experienced Data Engineer that will be responsible for designing and building the foundational components required for our customer. This includes bringing disparate sources into our Data Factory and creating data products that will be used by the analytics and reporting teams. • Data engineers will work in small,...

  • Data Engineer

    6 days ago


    India Lingaro Full time

    Role: Data Engineer – Lead ConsultantLocation: IndiaAbout Lingaro:Lingaro Group is the end-to-end data services partner to global brands and enterprises. We lead our clients through their data journey, from strategy through development to operations and adoption, helping them to realize the full value of their data.Since 2008, Lingaro has been recognized...