Data Engineer

3 weeks ago


Bengaluru, India Talhive HR Management LLP Full time

About Loopio :

Loopio supercharges the way companies respond to Requests for Proposals (RFPs), Due Diligence Questionnaires (DDQs), and Security Questionnaires.

Our platform helps our 900 customers work faster, create higher-quality proposals, and win more business. Our mission is to empower people to focus on what matters.

We do this by giving both our customers and employees the tools they need to make an impact faster. Loopers as our team members are affectionately dubbed driven and passionate.

We're obsessed with feedback, personal growth, and doing work we're proud of. Empower people to focus on what matters.

From our Loopers (employees) to our Loopio Champions (customers), we aim to empower all of the people in Loopio's ecosystem to focus on winning, growth, differentiation, autonomy, mastery, purpose, and more of the things that matter

Job Description :

Function : IT Operations and Support - DevOps / Cloud, Software Engineering - Big Data / DWH / ETL Amazon RedshiftPythonAmazon S3MapReduceAWS Glue

As an AWS Data Engineer focused on our SaaS application, you will play a key role in designing, implementing, and maintaining data pipelines and infrastructure on the AWS platform.

You will collaborate closely with cross-functional teams, including software engineers and data scientists, to gather requirements, design data solutions, and ensure the availability of high-quality datasets for machine-learning analysis.

The ideal candidate will have a strong background in AWS services and data engineering.

Responsibilities :

- Design, develop, and deploy scalable data pipelines on AWS to support the creation of machine-learning-ready datasets for our SaaS application.

- Collaborate with software engineers to integrate data pipelines into our SaaS application architecture, ensuring seamless data ingestion and processing.

- Implement efficient ETL processes to extract, transform, and load data from various sources, including internal databases, third-party APIs, and streaming sources.

- Optimize data storage and retrieval for performance, scalability, and cost-effectiveness, leveraging AWS services such as S3 Glue, Redshift, Athena, etc.

- Work closely with data scientists to understand modeling requirements and ensure the availability of clean, curated datasets for training and evaluation.

- Monitor and troubleshoot data pipelines to ensure reliability, availability, and data quality, implementing automated testing and alerting mechanisms.

- Implement security best practices for data storage, transmission, and access control, ensuring compliance with relevant regulations and standards.

- Document design specifications, deployment procedures, and operational processes, facilitating knowledge sharing and collaboration within the team.

Requirements :

- Bachelor's degree in Computer Science, Engineering, or a related field.

- Proven experience as a Data Engineer or similar role, with at least 4 years of experience.

- Strong proficiency in AWS services such as S3 Glue, Redshift, Athena, EMR, Lambda, etc.

- Hands-on experience with data modeling, ETL development, and SQL.

- Excellent problem-solving skills and attention to detail.

- Strong communication and collaboration skills.

- AWS certification (e.g., AWS Certified Data Analytics - Specialty, AWS Certified Solutions Architect - Associate).

- Experience with programming languages such as Python, Scala, or Java.

- Experience with containerization and orchestration tools such as Docker and Kubernetes.

- Familiarity with DevOps practices and tools for CI/CD.

- Familiarity with machine learning concepts and workflows, including data preprocessing, feature engineering, and model evaluation.

- Experience with real-time data processing and streaming technologies.

(ref:hirist.tech)
  • Data Engineer

    6 days ago


    Bengaluru, Karnataka, India NTT DATA Full time

    Job DescriptionData Engineer - Snowflake, Oracle/MySQL, NoSQL, Python8 to 13 years of experience in Data engineeringExtensive experience in different database platforms both RDBMS (Oracle, MySQL) and NoSQL (MongoDB)Hands-on experience in SnowflakeProficient in Data Pipeline OrchestrationProficient in any one of the programing languages (python or...


  • Bengaluru, Karnataka, India NTT DATA Full time

    Job Description Lead Data Engineering Project Team, Expertise in Databricks, Expertise in Data Management & Data Governance,Expertise in Azure Cloud and its services, Experienced in Data Modelling and Data Pipelines,Experienced in Healthcare projects, Experience implementing FHIR Data model and FHIR Server Apply from local Career site Listen to the story...


  • Bengaluru, Karnataka, India NTT DATA Full time

    Job Description Lead Data Engineering Project Team, Expertise in Databricks,Expertise in Data Management & Data Governance,Expertise in Azure Cloud and its services, Experienced in Data Modelling and Data Pipelines,Experienced in Healthcare projects, Experience implementing FHIR Data model and FHIR Server Apply from local Career site Listen to the story of...

  • Data Engineer

    5 days ago


    Bengaluru, Karnataka, India NTT DATA Services Full time

    Data Engineer - Snowflake, Oracle/MySQL, NoSQL, Python • 8 to 13 years of experience in Data engineering• Extensive experience in different database platforms both RDBMS (Oracle, MySQL) and NoSQL (MongoDB)• Hands-on experience in Snowflake• Proficient in Data Pipeline Orchestration• Proficient in any one of the programing languages (python or go)...

  • Senior Data Engineer

    4 weeks ago


    Bengaluru, India NTT DATA Full time

    Job Description Lead Data Engineering Project Team, Expertise in Databricks,Expertise in Data Management & Data Governance,Expertise in Azure Cloud and its services, Experienced in Data Modelling and Data Pipelines,Experienced in Healthcare projects, Experience implementing FHIR Data model and FHIR Server Apply from local Career site Listen to the story...


  • Bengaluru, Karnataka, India NTT DATA Full time

    Job Description Azure Data Engineer Requirements4+ years' overall experience in data domain (data analysis, database developer)Minimum 3 years' experience as a cloud-based Data EngineerMinimum 3 years' experience and strong knowledge of Azure Data Services such as Azure Data Lake Storage, Blob Storage, Azure Data Factory, Minimum 3 years' experience on...


  • Bengaluru, India NTT DATA Full time

    Job Description Azure Data Engineer Requirements4+ years’ overall experience in data domain (data analysis, database developer)Minimum 3 years’ experience as a cloud-based Data EngineerMinimum 3 years’ experience and strong knowledge of Azure Data Services such as Azure Data Lake Storage, Blob Storage, Azure Data Factory, Minimum 3 years’ experience...


  • Bengaluru, Karnataka, India NTT DATA Full time

    Job Description Azure Data Engineer Requirements 4+ years' overall experience in data domain (data analysis, database developer) Minimum 3 years' experience as a cloud-based Data Engineer Minimum 3 years' experience and strong knowledge of Azure Data Services such as Azure Data Lake Storage, Blob Storage, Azure Data Factory, Minimum 3 years' experience on...


  • Bengaluru, Karnataka, India NTT DATA Services Full time

    Lead Data Engineering Project Team, Expertise in Databricks, Expertise in Data Management & Data Governance,Expertise in Azure Cloud and its services, Experienced in Data Modelling and Data Pipelines,Experienced in Healthcare projects, Experience implementing FHIR Data model and FHIR Server

  • Sr data engineer

    2 days ago


    Bengaluru, India NTT DATA Services Full time

    Req ID:286326NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Sr data engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Senior data engineerStrong...

  • Sr data engineer

    4 days ago


    Bengaluru, India NTT DATA Services Full time

    Req ID: 286326 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Sr data engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Senior data engineer  Strong...


  • Bengaluru, India NTT DATA Full time

    Job DescriptionAzure Data Engineer Requirements4+ years’ overall experience in data domain (data analysis, database developer)Minimum 3 years’ experience as a cloud-based Data EngineerMinimum 3 years’ experience and strong knowledge of Azure Data Services such as Azure Data Lake Storage, Blob Storage, Azure Data Factory,Minimum 3 years’ experience...


  • Bengaluru, Karnataka, India NTT DATA Services Full time

    Azure Data Engineer Requirements 4+ years' overall experience in data domain (data analysis, database developer) Minimum 3 years' experience as a cloud-based Data Engineer Minimum 3 years' experience and strong knowledge of Azure Data Services such as Azure Data Lake Storage, Blob Storage, Azure Data Factory, Minimum 3 years' experience on Apache Spark or...


  • Bengaluru, Karnataka, India NTT DATA Services Full time

    Azure Data Engineer Requirements4+ years' overall experience in data domain (data analysis, database developer)Minimum 3 years' experience as a cloud-based Data EngineerMinimum 3 years' experience and strong knowledge of Azure Data Services such as Azure Data Lake Storage, Blob Storage, Azure Data Factory,Minimum 3 years' experience on Apache Spark or Azure...


  • Bengaluru, India NTT DATA Services Full time

    Lead Data Engineering Project Team,Expertise in Databricks,Expertise in Azure Cloud and its services,Experienced in Healthcare projects,Experience implementing FHIR Data model and FHIR Server


  • Bengaluru, India NTT DATA Services Full time

    Lead Data Engineering Project Team, Expertise in Databricks, Expertise in Azure Cloud and its services, Experienced in Healthcare projects, Experience implementing FHIR Data model and FHIR Server

  • Data Architect

    6 days ago


    Bengaluru, Karnataka, India NTT DATA Full time

    Job Description: Data Modeler (8 to 12 years of experience)Summary:Do you thrive in the nexus of business needs and complex data landscapes? Do you possessthe vision to translate strategic goals into elegant and scalable data architectures? If so, thenstep into the role of Data Modeler and shape the future of data at SalesforceWe are seeking a Data Modeler...

  • Data Architect

    4 weeks ago


    Bengaluru, India NTT DATA Full time

    Job Description: Data Modeler (8 to 12 years of experience)Summary:Do you thrive in the nexus of business needs and complex data landscapes? Do you possessthe vision to translate strategic goals into elegant and scalable data architectures? If so, thenstep into the role of Data Modeler and shape the future of data at Salesforce!We are seeking a Data Modeler...

  • Data Engineer

    1 month ago


    Bengaluru, India NTT DATA Full time

    Job Description Data Engineer - Snowflake, Oracle/MySQL, NoSQL, Python• 8 to 13 years of experience in Data engineering• Extensive experience in different database platforms both RDBMS (Oracle, MySQL) and NoSQL (MongoDB)• Hands-on experience in Snowflake• Proficient in Data Pipeline Orchestration• Proficient in any one of the programing languages...

  • Data Engineer

    4 weeks ago


    Bengaluru, India NTT DATA Full time

    Job Description Data Engineer - Snowflake, Oracle/MySQL, NoSQL, Python• 8 to 13 years of experience in Data engineering• Extensive experience in different database platforms both RDBMS (Oracle, MySQL) and NoSQL (MongoDB)• Hands-on experience in Snowflake• Proficient in Data Pipeline Orchestration• Proficient in any one of the programing languages...