Data Engineer

1 month ago

Gurugram, India TransOrg Analytics Full time

Location : Gurgaon/Mumbai

Job ID : DE2008

Job Type : Full time

Experience : 2-6 years

Why would you like to join us?

TransOrg Analytics, an award winning – Big Data and Predictive analytics- company, offers advanced analytics solutions to industry leaders and Fortune 500 companies across India, US, UK, Singapore and the Middle East. Our products – Clonizo’ (customer cloning) have yielded significant incremental benefits to our clients. We have been recognized by the CIO Review magazine as the – Predictive Analytics Company of the Year- and by TiE for excellence in entrepreneurship.

Overview

This position is for a Data Engineer with an experience in SQL/NoSQL, Cloud, Hadoop and/or Spark platforms

Responsibilities
  • Design and implement data engineering projects.
  • Integrate multiple data sources to create data lake/data mart Perform data ingestion and ETL processes using SQL, Scoop, Spark or Hive
  • Knowledge of new components and various emerging technologies in on-premises and Cloud (AWS/Azure/Google)
  • Collaborate with various cross-functional teams: infrastructure, network and database
  • Work with various teams to setup and manage users, secure and govern platforms and data and maintain business continuity through contingency plans (data archiving etc.)
  • Monitor job performances, manage file system/disk-space, cluster & database connectivity, log files, manage backup/security and troubleshoot various user issues
  • Design, implement, test and document performance benchmarking strategy for platforms as well as for different use cases
  • Setup, administer, monitor, tune, optimize and govern large scale implementations
  • Implement machine learning models on real time input data stream
  • Drive customer communication during critical events and participate/lead various operational improvement initiatives
Education & Skills Summary
  • 2 – 6 years relevant experience in data engineering
  • Exposure to any or all latest data engineering ecosystem platforms such as AWS, Azure, GCP, Cloudera and Data bricks
  • Sound knowledge of Python/Scala/Java
  • Good knowledge of SQL / NoSQL databases and data warehouse concepts
  • Hands on experience of working on databases such as Sql Servers, PostgreSql, Cloud infrastructure, etc.
  • Excellent knowledge of data backup, recovery, security and integrity
  • Sound knowledge on Spark, HDFS/HIVE/HBASE, Shell Scripting, and Spark Streaming
  • Excellent communication skills
  • Must be proficient with data ingestion tools like Sqoop, flume, talend, and Kafka

  • Eucloid - Data Engineer - Azure Databricks

    1 month ago

    Gurugram, India Eucloid Data Solutions Pvt Ltd Full time

    Job Description - Data Engineer (Databricks)About Eucloid : Eucloid Data Solutions is a fast-growing AI-consulting firm that enables business growth for its clients through advanced Data Analytics, Machine Learning and Data engineering. Eucloid offers bespoke, full stackand datadriven approach to solve highly complex and large-scale business problems for...

  • Eucloid - Data Engineer - Azure Databricks

    2 weeks ago

    gurugram, India Eucloid Data Solutions Pvt Ltd Full time

    Job Description - Data Engineer (Databricks)About Eucloid : Eucloid Data Solutions is a fast-growing AI-consulting firm that enables business growth for its clients through advanced Data Analytics, Machine Learning and Data engineering. Eucloid offers bespoke, full stackand datadriven approach to solve highly complex and large-scale business problems for...

  • Eucloid - Data Engineer - Azure Databricks

    3 weeks ago

    Gurugram, India Eucloid Data Solutions Pvt Ltd Full time

    Job Description - Data Engineer (Databricks)About Eucloid : Eucloid Data Solutions is a fast-growing AI-consulting firm that enables business growth for its clients through advanced Data Analytics, Machine Learning and Data engineering. Eucloid offers bespoke, full stackand datadriven approach to solve highly complex and large-scale business problems for...

  • Eucloid - Senior Data Engineer - Azure Databricks

    1 month ago

    gurugram, India Eucloid Data Solutions Pvt Ltd Full time

    Job Role : Sr. Data Engineer (Databricks) About Eucloid :Eucloid Data Solutions is a fast-growing AI-consulting firm that enables business growth for its clients through advanced Data Analytics, Machine Learning and Data engineering. Eucloid offers bespoke, full stackand datadriven approach to solve highly complex and large-scale business problems for some...

  • Eucloid - Senior Data Engineer - Azure Databricks

    2 weeks ago

    gurugram, India Eucloid Data Solutions Pvt Ltd Full time

    Job Role : Sr. Data Engineer (Databricks) About Eucloid :Eucloid Data Solutions is a fast-growing AI-consulting firm that enables business growth for its clients through advanced Data Analytics, Machine Learning and Data engineering. Eucloid offers bespoke, full stackand datadriven approach to solve highly complex and large-scale business problems for some...

  • Eucloid - Senior Data Engineer - Azure Databricks

    4 weeks ago

    Gurugram, India Eucloid Data Solutions Pvt Ltd Full time

    Job Role : Sr. Data Engineer (Databricks)About Eucloid :Eucloid Data Solutions is a fast-growing AI-consulting firm that enables business growth for its clients through advanced Data Analytics, Machine Learning and Data engineering. Eucloid offers bespoke, full stackand datadriven approach to solve highly complex and large-scale business problems for some of...

  • Aptus Data Labs

    5 days ago

    gurugram, India Aptus Data Labs Full time

    Description : We are seeking an experienced and talented individual for the position of Data Governance with Azure experience. In this role, you will be responsible for managing the data governance framework using Azure tools and technologies, and collaborating closely with cross-functional teams to implement and maintain best practices.Location : ...

  • Data Engineer

    2 months ago

    Gurugram, India NAB Full time

    Consultant - Data Engineer role exists to ensure the delivery of the Right data to the Right customer at the Right time and at the Right Cost using the Right tools and the Right Technology on NAB’s target state Marketing Platforms. You will enable the move, flow and processing of reusable data assets in the Technology and Enterprise Operations space for...

  • Data Engineer

    2 months ago

    Gurugram, India NAB Full time

    Consultant - Data Engineer role exists to ensure the delivery of the Right data to the Right customer at the Right time and at the Right Cost using the Right tools and the Right Technology on NAB’s target state Marketing Platforms. You will enable the move, flow and processing of reusable data assets in the Technology and Enterprise Operations space for...

  • Eucloid - Data Engineer - Azure Databricks

    1 month ago

    Gurgaon/Gurugram/Chennai, India Eucloid Data Solutions Pvt Ltd Full time

    Job Description - Data Engineer (Databricks)About Eucloid : Eucloid Data Solutions is a fast-growing AI-consulting firm that enables business growth for its clients through advanced Data Analytics, Machine Learning and Data engineering. Eucloid offers bespoke, full stackand datadriven approach to solve highly complex and large-scale business problems for...

  • Eucloid - Data Engineer - Azure Databricks

    4 weeks ago

    Gurgaon/Gurugram/Chennai, India Eucloid Data Solutions Pvt Ltd Full time

    Job Description - Data Engineer (Databricks)About Eucloid : Eucloid Data Solutions is a fast-growing AI-consulting firm that enables business growth for its clients through advanced Data Analytics, Machine Learning and Data engineering. Eucloid offers bespoke, full stackand datadriven approach to solve highly complex and large-scale business problems for...

  • Data Engineer

    2 weeks ago

    Gurugram, India GlobalLogic Full time

    Job Description We are seeking a highly skilled Data Engineer with expertise in Apache Spark, Scala, and Java to join our dynamic team. The ideal candidate will have a strong background in data engineering, a deep understanding of big data technologies, and the ability to design and implement scalable data processing solutions. Job Responsibilities ...

  • Data Engineer

    2 weeks ago

    Gurugram, India GlobalLogic Full time

    Job DescriptionWe are seeking a highly skilled Data Engineer with expertise in Apache Spark, Scala, and Java to join our dynamic team. The ideal candidate will have a strong background in data engineering, a deep understanding of big data technologies, and the ability to design and implement scalable data processing solutions.Job...

  • Data Engineer

    2 weeks ago

    gurugram, India AHEAD Full time

    AHEAD builds platforms for digital business. By weaving together advances in cloud infrastructure, automation and analytics, and software delivery, we help enterprises deliver on the promise of digital transformation.At AHEAD, we prioritize creating a culture of belonging, where all perspectives and voices are represented, valued, respected, and heard. We...

  • Data Engineer

    2 weeks ago

    Gurugram, India AHEAD Full time

    AHEAD builds platforms for digital business. By weaving together advances in cloud infrastructure, automation and analytics, and software delivery, we help enterprises deliver on the promise of digital transformation.At AHEAD, we prioritize creating a culture of belonging, where all perspectives and voices are represented, valued, respected, and heard. We...

  • Data Engineer

    2 days ago

    gurugram, India Virtusa Full time

    Data Engineer - CREQ188712 Description Skill: Data Engineer Role: T3, T2 Key responsibility: Role Name: Data EngineerMust have 5+ years of experience in below mentioned skills.Must Have: Big Data Concepts , Python, SQL, Shell Scripting, AWS S3Good to Have: Event-driven/AWA SQS, Microservices, API Development, Kafka, Kubernetes, Argo,...

  • Data Engineer

    3 days ago

    Gurugram, India Virtusa Full time

    Data Engineer - CREQ188712 Description Skill: Data Engineer Role: T3, T2 Key responsibility: Role Name: Data Engineer Must have 5+ years of experience in below mentioned skills. Must Have: Big Data Concepts , Python, SQL, Shell Scripting, AWS S3 Good to Have: Event-driven/AWA SQS, Microservices, API Development, Kafka, Kubernetes, Argo, Amazon...

  • Data Engineer

    2 months ago

    Gurugram, India Virtusa Full time

    Data Engineer - CREQ188856 Description Job Description Skill: Data Engineer Role: T3, T2 Key responsibility: Role Name: Data Engineer Must have 5+ years of experience in below mentioned skills. Must Have: Big Data Concepts , Python, SQL, Shell Scripting, AWS S3 Good to Have: Event-driven/AWA SQS, Microservices, API Development, Kafka,...

  • Data Engineer

    4 weeks ago

    Gurugram, India Virtusa Full time

    Data Engineer - CREQ188856 Description Job Description Skill: Data Engineer Role: T3, T2 Key responsibility: Role Name: Data Engineer Must have 5+ years of experience in below mentioned skills. Must Have: Big Data Concepts , Python, SQL, Shell Scripting, AWS S3 Good to Have: Event-driven/AWA SQS, Microservices, API Development, Kafka,...

  • Data Engineer

    2 months ago

    gurugram, India Virtusa Full time

    Data Engineer - CREQ188856 Description Job Description Skill: Data Engineer Role: T3, T2 Key responsibility: Role Name: Data EngineerMust have 5+ years of experience in below mentioned skills.Must Have: Big Data Concepts , Python, SQL, Shell Scripting, AWS S3Good to Have: Event-driven/AWA SQS, Microservices, API Development, Kafka,...