Senior Data Engineer

2 months ago

GurgaonGurugram, India Networkyard Consulting Full time

Skills : AWS DMS + Redshift


Job Description :

Must Have Experience :

- 4+ years of hands-on data engineering experience

- Expertise with AWS services: S3, DMS, Redshift, EMR, Glue, Kinesis, DynamoDB

- Building batch and real-time data pipelines

- Python, SQL coding for data processing and analysis

- Data modeling experience using Cloud based data platforms like Redshift

- Design and Develop ETL frameworks using AWS DMS

Nice-to-Have Experience :

- ETL development using tools like Informatica, Talend

- Knowledge of creating reusable data sources and dashboards for self-service analytics

- Experience using Databricks for Spark workloads or Redshift

- Working knowledge of Big Data Processing

- Knowledge of DevOps, DataOps, Data Governance

- Any one of the AWS Professional Certification or Snowpro Core Certification

Must have skills :

- Cloud Knowledge

- Expertise with AWS Cloud Data Services

- Data Integration

- Batch & real-time data integration

- Data Warehousing

- Star and Snowflake Schema, Partitioning, Incremental Load setup, ETL Framework

- Data Lakes/Lakehouse

- Building data lake and Lakehouse using Redshift or native services of AWS

- BI & Analytics

- QuickSight/Tableau/Power BI/Qlik

- Orchestration

- Step Big Data/ML

- Building data pipelines using Spark

- Knowledge of ML concepts ,Scripting

- SQL, Python , Scala, Java , Streaming

- Knowledge of Real-time pipelines with tools like Kafka/Kinesis

- Data Governance , Metadata Management

- Data Lineage Setup

- Security

- Data Encryption

- Data Security best practices like PII data masking, etc.

(ref:hirist.tech)

  • Senior Data Engineer

    3 weeks ago

    Gurgaon/Gurugram, India Optivalue tek consulting Full time

    Company Description : OptiValueTek is a leading provider of IT solutions specializing in Application & Process Integration, API Management, Data Engineering, Data Science/MLOps, DevOps & SRE, Cloud Solutions, and Web/Mobile & Application Development. With a focus on innovation, we have developed in-house tools/accelerators for Test Automation, API...

  • Senior Data Engineer

    2 weeks ago

    Gurgaon/Gurugram, IN Optivalue tek consulting Full time

    Company Description : OptiValueTek is a leading provider of IT solutions specializing in Application & Process Integration, API Management, Data Engineering, Data Science/MLOps, DevOps & SRE, Cloud Solutions, and Web/Mobile & Application Development. With a focus on innovation, we have developed in-house tools/accelerators for Test Automation, API...

  • Senior Data Engineer

    2 weeks ago

    Gurgaon/Gurugram, IN Optivalue tek consulting Full time

    Company Description : OptiValueTek is a leading provider of IT solutions specializing in Application & Process Integration, API Management, Data Engineering, Data Science/MLOps, DevOps & SRE, Cloud Solutions, and Web/Mobile & Application Development. With a focus on innovation, we have developed in-house tools/accelerators for Test Automation, API...

  • Senior Data Engineer

    1 week ago

    Gurgaon/Gurugram, India Optivalue tek consulting Full time

    Company Description : OptiValueTek is a leading provider of IT solutions specializing in Application & Process Integration, API Management, Data Engineering, Data Science/MLOps, DevOps & SRE, Cloud Solutions, and Web/Mobile & Application Development. With a focus on innovation, we have developed in-house tools/accelerators for Test Automation, API...

  • Eucloid - Senior Data Engineer - Azure Databricks

    3 weeks ago

    Chennai/Gurgaon/Gurugram, India Eucloid Data Solutions Pvt Ltd Full time

    Job Role : Sr. Data Engineer (Databricks) About Eucloid :Eucloid Data Solutions is a fast-growing AI-consulting firm that enables business growth for its clients through advanced Data Analytics, Machine Learning and Data engineering. Eucloid offers bespoke, full stackand datadriven approach to solve highly complex and large-scale business problems for some...

  • Eucloid - Senior Data Engineer - Azure Databricks

    1 week ago

    Chennai/Gurgaon/Gurugram, India Eucloid Data Solutions Pvt Ltd Full time

    Job Role : Sr. Data Engineer (Databricks) About Eucloid :Eucloid Data Solutions is a fast-growing AI-consulting firm that enables business growth for its clients through advanced Data Analytics, Machine Learning and Data engineering. Eucloid offers bespoke, full stackand datadriven approach to solve highly complex and large-scale business problems for some...

  • Senior Data Engineer

    3 weeks ago

    Gurugram, India True Tech Professionals Full time

    Senior Data EngineerLocation: Gurgaon (Hybrid Mode)Experience: 5 years and above. Immediate Joiners Preferred (Notice Period: 10 - 15 days)We are seeking a skilled Senior Data Engineer to join our dynamic team. The ideal candidate should have a strong background in data engineering with expertise in Python, Pyspark, AWS Glue, Athena, Redshift, and SQL. The...

  • Senior Data Engineer

    3 weeks ago

    Gurugram, India True Tech Professionals Full time

    Senior Data EngineerLocation: Gurgaon (Hybrid Mode)Experience: 5 years and above. Immediate Joiners Preferred (Notice Period: 10 - 15 days)We are seeking a skilled Senior Data Engineer to join our dynamic team. The ideal candidate should have a strong background in data engineering with expertise in Python, Pyspark, AWS Glue, Athena, Redshift, and SQL. The...

  • Eucloid - Senior Data Consultant

    2 weeks ago

    Gurugram, India Eucloid Data Solutions Pvt Ltd Full time

    Senior Data description:We are looking for a high-energy individual for the role of Senior Data Analyst at Eucloid. The candidate will collaborate with client stakeholders on multiple projects in the eCommerce team. The candidate is expected to lead following work-streams:- Drive client meetings with data-driven insights and observations on key website/app...

  • Eucloid - Senior Data Engineer - Azure Databricks

    3 weeks ago

    gurugram, India Eucloid Data Solutions Pvt Ltd Full time

    Job Role : Sr. Data Engineer (Databricks) About Eucloid :Eucloid Data Solutions is a fast-growing AI-consulting firm that enables business growth for its clients through advanced Data Analytics, Machine Learning and Data engineering. Eucloid offers bespoke, full stackand datadriven approach to solve highly complex and large-scale business problems for some...

  • Eucloid - Senior Data Engineer - Azure Databricks

    1 week ago

    Gurugram, India Eucloid Data Solutions Pvt Ltd Full time

    Job Role : Sr. Data Engineer (Databricks)About Eucloid :Eucloid Data Solutions is a fast-growing AI-consulting firm that enables business growth for its clients through advanced Data Analytics, Machine Learning and Data engineering. Eucloid offers bespoke, full stackand datadriven approach to solve highly complex and large-scale business problems for some of...

  • Eucloid - Senior Data Engineer - Azure Databricks

    12 hours ago

    gurugram, India Eucloid Data Solutions Pvt Ltd Full time

    Job Role : Sr. Data Engineer (Databricks) About Eucloid :Eucloid Data Solutions is a fast-growing AI-consulting firm that enables business growth for its clients through advanced Data Analytics, Machine Learning and Data engineering. Eucloid offers bespoke, full stackand datadriven approach to solve highly complex and large-scale business problems for some...

  • Senior Data Engineer

    3 weeks ago

    gurugram, India Optivalue tek consulting Full time

    Company Description : OptiValueTek is a leading provider of IT solutions specializing in Application & Process Integration, API Management, Data Engineering, Data Science/MLOps, DevOps & SRE, Cloud Solutions, and Web/Mobile & Application Development. With a focus on innovation, we have developed in-house tools/accelerators for Test Automation, API...

  • Senior Data Engineer

    3 weeks ago

    Gurugram, India Optivalue tek consulting Full time

    Company Description : OptiValueTek is a leading provider of IT solutions specializing in Application & Process Integration, API Management, Data Engineering, Data Science/MLOps, DevOps & SRE, Cloud Solutions, and Web/Mobile & Application Development. With a focus on innovation, we have developed in-house tools/accelerators for Test Automation, API...

  • Senior Data Engineer

    1 week ago

    Gurugram, India Optivalue tek consulting Full time

    Company Description : OptiValueTek is a leading provider of IT solutions specializing in Application & Process Integration, API Management, Data Engineering, Data Science/MLOps, DevOps & SRE, Cloud Solutions, and Web/Mobile & Application Development. With a focus on innovation, we have developed in-house tools/accelerators for Test Automation, API...

  • Eucloid - Data Engineer - Azure Databricks

    3 weeks ago

    Gurgaon/Gurugram/Chennai, India Eucloid Data Solutions Pvt Ltd Full time

    Job Description - Data Engineer (Databricks)About Eucloid : Eucloid Data Solutions is a fast-growing AI-consulting firm that enables business growth for its clients through advanced Data Analytics, Machine Learning and Data engineering. Eucloid offers bespoke, full stackand datadriven approach to solve highly complex and large-scale business problems for...

  • Eucloid - Data Engineer - Azure Databricks

    1 week ago

    Gurgaon/Gurugram/Chennai, India Eucloid Data Solutions Pvt Ltd Full time

    Job Description - Data Engineer (Databricks)About Eucloid : Eucloid Data Solutions is a fast-growing AI-consulting firm that enables business growth for its clients through advanced Data Analytics, Machine Learning and Data engineering. Eucloid offers bespoke, full stackand datadriven approach to solve highly complex and large-scale business problems for...

  • Senior Data Engineer

    2 weeks ago

    gurgaon, India Xebia Full time

    Who Are We?With over 20 years of experience, our global network of passionate technologists and pioneering craftsmen deliver cutting-edge technology and game-changing consulting to companies on the brink of transformation. Since 2001, we have grown from a Java company into a full-service digital consulting company with 4500+ professionals working on a...

  • Senior Data Engineer

    1 week ago

    gurgaon, India Xebia Full time

    Who Are We?With over 20 years of experience, our global network of passionate technologists and pioneering craftsmen deliver cutting-edge technology and game-changing consulting to companies on the brink of transformation. Since 2001, we have grown from a Java company into a full-service digital consulting company with 4500+ professionals working on a...

  • Coforge - Data Engineer - Data Pipeline

    1 month ago

    Gurgaon/Gurugram, India COFORGE Full time

    Job Description : As a Senior Data Engineer, you'll be at the forefront of developing and optimizing data pipelines, ensuring the seamless flow of data across our systems. Bring your expertise in Java, Python, and a range of big data technologies including Hadoop, Cassandra, Kafka, Spark, HBase, and MySQL to drive innovation and efficiency in our data...