Data Engineer

3 weeks ago

Ahmedabad, India Infraveo Full time
Job Description

This is a remote position.

  • Develop and maintain data pipelines: Design, develop, and optimize ETL pipelines that extract, transform, and load mortgage-related data from various sources like JSON, XML, and databases into scalable data stores.
  • Work on data mapping and transformation: Collaborate with domain experts to ensure proper mapping of mortgage data fields (MISMO standards) from third-party sources into the company's data schema.
  • Architect scalable data solutions: Utilize best in class technology to create efficient, scalable data processing systems.
  • Collaborate with cross-functional teams: Work closely with product managers, senior engineers, and founders to understand the needs and contribute to designing software and data solutions that meet the organization’s objectives.
  • Ensure data governance and quality: Implement efficient data governance processes, ensuring data integrity, security, and compliance across multiple data sources.
  • Real-time data processing: Design systems for real-time data streaming, ensuring smooth integration with other systems and services.
  • Data pipeline optimization: Monitor and improve the performance of existing data pipelines and resolve data-related issues in collaboration with backend and database teams.
  • Stay updated on technology: Follow advancements in data engineering tools and techniques, adopting best practices to improve data processing, storage, and analysis.

Requirements
  • 5+ years of experience as a Data Engineer, focusing on large-scale data solutions.
  • Mortgage industry experience: Prior experience working with mortgage data systems financial services.
  • Proficiency in data processing tools: Hands-on experience with cloud services like Snowflake, S3, along with Redshift, Glue, etc.
  • Strong SQL/NoSQL skills: Familiarity with databases such as PostgreSQL to ensure accurate data handling and storage.
  • Experience with microservices: Knowledge of microservices architecture and real-time data processing using queues and pub-sub technologies.
  • Knowledge of ETL processes: Deep understanding of ETL workflows, with the ability to optimize and troubleshoot data pipelines.
  • Programming skills: Experience with programming languages such as Python (or Javascript) for developing data solutions.
  • Familiarity with MISMO standards: Knowledge of the MISMO (Mortgage Industry Standards Maintenance Organization) data schema is preferred.

Benefits
  • Work Location: Remote
  • 5 days working


Requirements
5+ years of experience as a Data Engineer, focusing on large-scale data solutions. Mortgage industry experience: Prior experience working with mortgage data systems financial services. Proficiency in data processing tools: Hands-on experience with cloud services like Snowflake, S3, along with Redshift, Glue, etc. Strong SQL/NoSQL skills: Familiarity with databases such as PostgreSQL to ensure accurate data handling and storage. Experience with microservices: Knowledge of microservices architecture and real-time data processing using queues and pub-sub technologies. Knowledge of ETL processes: Deep understanding of ETL workflows, with the ability to optimize and troubleshoot data pipelines. Programming skills: Experience with programming languages such as Python (or Javascript) for developing data solutions. Familiarity with MISMO standards: Knowledge of the MISMO (Mortgage Industry Standards Maintenance Organization) data schema is preferred.

  • Crest Data | Senior Software Engineer/Technical Lead

    4 weeks ago

    ahmedabad, India Crest Data Full time

    Company Overview: Crest Data is a leading provider of data center solutions and engineering/marketing services in the areas of Networking/SDN, Storage, Security, Virtualization, Cloud Computing, and Big Data / Data Analytics. The team has extensive experience in building and deploying various Data Center products from Cisco, VMware, NetApp, Amazon AWS, EMC,...

  • Crest Data | Senior Software Engineer/Technical Lead

    4 weeks ago

    ahmedabad, India Crest Data Full time

    Company Overview: Crest Data is a leading provider of data center solutions and engineering/marketing services in the areas of Networking/SDN, Storage, Security, Virtualization, Cloud Computing, and Big Data / Data Analytics. The team has extensive experience in building and deploying various Data Center products from Cisco, VMware, NetApp, Amazon AWS, EMC,...

  • Senior Data Engineer for Innovative Data Analytics

    2 weeks ago

    Ahmedabad, Gujarat, India ANBLICKS CLOUD DATA ENGG PRIVATE LIMITED Full time

    OverviewWe are seeking a highly skilled Senior Data Engineer to join our team at Anblicks Cloud Data Engg Private Limited in Hyderabad or Ahmedabad. The ideal candidate will have strong knowledge of Python and SQL, with a clear understanding of data warehouse fundamentals, data modeling, and ELT/ETL processes. Job DescriptionAs a Senior Data Engineer, you...

  • Anblicks - Senior Data Engineer - ETL

    2 months ago

    Ahmedabad, India ANBLICKS CLOUD DATA ENGG PRIVATE LIMITED Full time

    Position : Senior Data Engineer Product Engineering. Location : Hyderabad or Ahmedabad. No of Requirement : 5. Role Objective : We are seeking a highly skilled Data Engineer to join our innovations group. You will lead projects to build accelerators, Points of Views (POVs), Proof of Concepts (POCs), and conduct research on emerging technologies. Key...

  • Anblicks - Senior Data Engineer - ETL

    2 weeks ago

    Ahmedabad, India ANBLICKS CLOUD DATA ENGG PRIVATE LIMITED Full time

    Position : Senior Data Engineer Product Engineering. Location : Hyderabad or Ahmedabad. No of Requirement : 5. Role Objective : We are seeking a highly skilled Data Engineer to join our innovations group. You will lead projects to build accelerators, Points of Views (POVs), Proof of Concepts (POCs), and conduct research on emerging technologies. Key...

  • Data Engineer for Cloud Infrastructure

    3 weeks ago

    Ahmedabad, Gujarat, India ANBLICKS CLOUD DATA ENGG PRIVATE LIMITED Full time

    OverviewAt Anblicks Cloud Data Engg Private Limited, we are seeking a highly skilled Data Engineer to join our innovations group.About the RoleThe ideal candidate will lead projects to build accelerators, Points of Views (POVs), and Proof of Concepts (POCs), and conduct research on emerging technologies.Key ResponsibilitiesDesign, develop, and maintain...

  • Crest Data | Sr. Golang Engineer | ahmedabad

    3 weeks ago

    ahmedabad, India Crest Data Full time

    Job Description - Senior Software Engineer (Golang) We are looking for an experienced Golang Engineer to join our team as a Senior Software Engineer in Ahmedabad. Below are the key details of the role:Roles and Responsibilities:Review software requirements and develop test strategies and plans.Design and implement complex Golang modules and scalable,...

  • Lead Java Developer Position for Data Center Solutions

    2 weeks ago

    Ahmedabad, Gujarat, India Crest Data Full time

    Senior Software Engineer/Technical Lead OpportunityCrest Data Systems is seeking a highly skilled Senior Software Engineer/Technical Lead to join our team in Ahmedabad, Gujarat. This role offers a unique chance to work on cutting-edge data center solutions and contribute to the company's growth.About Us:Crest Data is a leading provider of engineering...

  • Senior Data Engineer

    2 months ago

    Ahmedabad, India ANBLICKS CLOUD DATA ENGG PRIVATE LIMITED Full time

    Data Engineering Team LeadWe are seeking a highly skilled Data Engineer to lead our innovations group.Key Responsibilities:Design, develop, and maintain innovative end-to-end data analytics and technology solutions.Work with data warehouses and data lakes, ensuring data is accurate, available, and easily accessible.Implement ELT/ETL processes using...

  • Big Data Engineering Leader

    7 days ago

    Ahmedabad, Gujarat, India ANBLICKS CLOUD DATA ENGG PRIVATE LIMITED Full time

    **Job Description:**We are seeking a highly skilled Senior Data Engineer to join our innovations group at Anblicks Cloud Data Engg Private Limited.**Location:** Hyderabad or Ahmedabad**Role Objective:The ideal candidate will lead projects to build accelerators, Points of Views (POVs), Proof of Concepts (POCs), and conduct research on emerging...

  • Crest Data | Senior Software Engineer/Lead

    2 weeks ago

    Ahmedabad, India Crest Data Full time

    Key Responsibilities:Component Creation:Create reusable and efficient Angular components, directives, and services to enhance the user interface and functionality of applications.UI/UX Implementation:Work closely with UX/UI designers to translate design mockups and wireframes into functional web pages with a focus on aesthetics and user experience.RESTful...

  • Software Engineering Team Lead

    2 weeks ago

    Ahmedabad, Gujarat, India Crest Data Full time

    Career Opportunities at Crest DataAs a leading provider of data center solutions and engineering services, we are constantly seeking talented individuals to join our team.Crest Data Systems provides various engineering services including software development, QA/automation, 3rd party integration, and building connectors. We also provide professional services...

  • Senior software engineer/technical lead

    3 weeks ago

    Ahmedabad, India Crest Data Full time

    Company Overview: Crest Data is a leading provider of data center solutions and engineering/marketing services in the areas of Networking/SDN, Storage, Security, Virtualization, Cloud Computing, and Big Data / Data Analytics. The team has extensive experience in building and deploying various Data Center products from Cisco, VMware, Net App, Amazon AWS,...

  • Senior Software Engineer/Technical Lead

    4 weeks ago

    Ahmedabad, India Crest Data Full time

    Company Overview:Crest Data is a leading provider of data center solutions and engineering/marketing services in the areas of Networking/SDN, Storage, Security, Virtualization, Cloud Computing, and Big Data / Data Analytics. The team has extensive experience in building and deploying various Data Center products from Cisco, VMware, NetApp, Amazon AWS, EMC,...

  • Crest Data | Senior Software Engineer/Lead

    2 weeks ago

    ahmedabad, India Crest Data Full time

    Key Responsibilities:Component Creation: Create reusable and efficient Angular components, directives, and services to enhance the user interface and functionality of applications.UI/UX Implementation: Work closely with UX/UI designers to translate design mockups and wireframes into functional web pages with a focus on aesthetics and user...

  • Senior software engineer/technical lead

    2 weeks ago

    Ahmedabad, India Crest Data Full time

    Company Overview:Crest Data is a leading provider of data center solutions and engineering/marketing services in the areas of Networking/SDN, Storage, Security, Virtualization, Cloud Computing, and Big Data / Data Analytics. The team has extensive experience in building and deploying various Data Center products from Cisco, VMware, Net App, Amazon AWS, EMC,...

  • Senior Software Engineer/Technical Lead

    4 weeks ago

    ahmedabad, India Crest Data Full time

    Company Overview:Crest Data is a leading provider of data center solutions and engineering/marketing services in the areas of Networking/SDN, Storage, Security, Virtualization, Cloud Computing, and Big Data / Data Analytics. The team has extensive experience in building and deploying various Data Center products from Cisco, VMware, NetApp, Amazon AWS, EMC,...

  • Senior software engineer/technical lead

    4 weeks ago

    Ahmedabad, India Crest Data Full time

    Company Overview:Crest Data is a leading provider of data center solutions and engineering/marketing services in the areas of Networking/SDN, Storage, Security, Virtualization, Cloud Computing, and Big Data / Data Analytics. The team has extensive experience in building and deploying various Data Center products from Cisco, VMware, Net App, Amazon AWS, EMC,...

  • Senior Software Engineer/Technical Lead

    4 weeks ago

    Ahmedabad, India Crest Data Full time

    Company Overview:Crest Data is a leading provider of data center solutions and engineering/marketing services in the areas of Networking/SDN, Storage, Security, Virtualization, Cloud Computing, and Big Data / Data Analytics. The team has extensive experience in building and deploying various Data Center products from Cisco, VMware, NetApp, Amazon AWS, EMC,...

  • Technical Lead

    5 days ago

    Ahmedabad, Gujarat, India Crest Data Full time

    Crest Data, a global leader in providing Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services, seeks an experienced Technical Lead to join our team.Job DescriptionWe are looking for a skilled Technical Lead with expertise in software development life cycle, architecture, design,...