Data Engineer

Found in: Whatjobs IN C2 - 2 weeks ago


noida, India RI Jobs Full time

This is a remote position.

Requirement Name: AWS Data Engineer
Experience: 7+ years
Location: Remote
Notice Period: Immediate
Job Description:
We are seeking an experienced AWS Data Engineer for a remote position. The ideal candidate will have extensive experience in AWS services, particularly Redshift, Airflow, and Python scripting. The candidate should also have a strong understanding of data engineering best practices and be able to collaborate effectively with business analysts and stakeholders.
Key Responsibilities:
- Collaborate with business analysts to gather requirements for existing or new ETL pipelines. - Connect with stakeholders daily to discuss project progress and updates. - Work within an Agile process to deliver projects in a timely and efficient manner. - Design and manage Redshift data workloads, including performance tuning techniques. - Develop Airflow Directed Acyclic Graphs (DAGs) to schedule and manage ETL workflows. - Implement best practices for data engineering, including data modeling, data warehousing, and data pipeline architecture. - Monitor and troubleshoot ETL pipelines to ensure smooth operation. - Develop custom Python functions to handle data quality and validation. - Proficiency in AWS services such as S3, CloudFormation, CloudWatch, Service Catalog, and IAM Roles. - Perform data validation and ensure data accuracy and completeness through automated tests and validation processes. - Knowledge of Tableau, including creating Tableau Published Datasets and managing access. - Write PySpark scripts to process data and perform transformations (Good to have). - Run Spark jobs on AWS EMR cluster using Airflow DAGs (Good to have).
Requirements

Requirements:

- Minimum of 7 years of experience in data engineering.


- Strong expertise in AWS services, particularly Redshift, Airflow, and Python scripting.


- Proficiency in data engineering best practices, data modeling, and data pipeline architecture.


- Experience with Tableau for data visualization and access management.


- Knowledge of PySpark and running Spark jobs on AWS EMR cluster (Good to have).


This is an immediate opportunity for a highly skilled AWS Data Engineer to join our team and contribute to the success of our projects.



  • Digital Engineering Staff Engineer

    Found in: beBee S IN - 4 weeks ago


    Noida, India NTT DATA Services Full time

    Req ID: 268061  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Digital Engineering Staff Engineer to join our team in Noida, Uttar Pradesh (IN-UP), India...

  • Network Engineering Advisor

    Found in: beBee S IN - 3 weeks ago


    Noida, India NTT DATA Services Full time

    Req ID: 266233  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Network Engineering Advisor to join our team in Noida, Uttar Pradesh (IN-UP), India (IN). JOB...

  • Data Engineer

    Found in: Whatjobs IN C2 - 2 weeks ago


    noida, India Hexaconcepts Full time

    The Company : A data-sciences company, serving clients across industries across geographies. A fast growing organisation witnessing huge demand for their services, covering Business Intelligence, Data warehousing, Data engineering and Predictive analytics (AI/ML). On this growth trajectory, they are looking to onboard smart data science and data engineering...

  • Data Engineer

    Found in: Talent IN C2 - 2 weeks ago


    Noida, India Hexaconcepts Full time

    The Company :A data-sciences company, serving clients across industries across geographies. A fast growing organisation witnessing huge demand for their services, covering Business Intelligence, Data warehousing, Data engineering and Predictive analytics (AI/ML). On this growth trajectory, they are looking to onboard smart data science and data engineering...

  • Digital Engineering Staff Engineer

    Found in: beBee S IN - 4 weeks ago


    Noida, India NTT DATA Services Full time

    Req ID: 248735  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Digital Engineering Staff Engineer to join our team in Noida, Uttar Pradesh (IN-UP), India...

  • Data Engineer

    Found in: Appcast Linkedin IN C2 - 8 hours ago


    Noida, India Infogain Full time

    Experience : 6 to 9 yearsRequirement : Immediate Joiner or one month notice period only.Location : BangaloreWork Mode : HybridTitle:Big Data Engineer (Senior): As a Big Data Engineer (Senior), you will be responsible for designing and implementing complex big data solutions. You will work closely with clients and team members to understand their requirements...

  • Data Engineer

    Found in: Whatjobs IN C2 - 10 hours ago


    noida, India Infogain Full time

    Experience : 6 to 9 years Requirement : Immediate Joiner or one month notice period only. Location : Bangalore Work Mode : Hybrid Title: Big Data Engineer (Senior): As a Big Data Engineer (Senior), you will be responsible for designing and implementing complex big data solutions. You will work closely with clients and team members to understand their...

  • Data Engineer

    Found in: Talent IN 2A C2 - 7 hours ago


    Noida, India Infogain Full time

    Experience : 6 to 9 yearsRequirement : Immediate Joiner or one month notice period only.Location : BangaloreWork Mode : HybridTitle:Big Data Engineer (Senior): As a Big Data Engineer (Senior), you will be responsible for designing and implementing complex big data solutions. You will work closely with clients and team members to understand their requirements...

  • Data Engineer

    Found in: Whatjobs IN C2 - 2 weeks ago


    noida, India XpertHunt Full time

    Job Overview We are looking for a skilled Data Engineer to join for our client. As a Data Engineer, you will be responsible for Migrating, designing, developing, and maintaining our data infrastructure and systems. You will also work closely with data scientists, analysts, and stakeholders to understand their data needs and implement solutions that enable...

  • Data Engineer

    Found in: Talent IN C2 - 8 hours ago


    Noida, India SAM Manpower and Career Services LLP Full time

    Role: DataEngineerExperience: 57YearsLocation:NoidaNotice: Immediate joinersonlyJobDescription We arelooking for an experienced data engineer to join our team. You willuse various methods to transform raw data into useful data systems.For example you ll create algorithms and conduct statisticalanalysis. Overall you ll strive for efficiency by aligning...

  • Data Engineer

    Found in: Talent IN C2 - 2 weeks ago


    Noida, India XpertHunt Full time

    Job OverviewWe are looking for a skilled Data Engineer to join for our client. As a Data Engineer, you will be responsible for Migrating, designing, developing, and maintaining our data infrastructure and systems. You will also work closely with data scientists, analysts, and stakeholders to understand their data needs and implement solutions that enable...

  • Data Engineer

    Found in: Whatjobs IN C2 - 2 weeks ago


    noida, India Network18 Media & Investments Limited Full time

    Key Responsibilities  Lead the design and implementation of the data & analytics architecture ensuring compliance, quality, and sustainable platform growth  Build scalable end-to-end data pipelines to integrate and model datasets from different sources that meet functional and non-functional requirements  Manage the technical scope and architecture...

  • Data Engineer

    Found in: Talent IN 2A C2 - 2 weeks ago


    Noida, India Network18 Media & Investments Limited Full time

    Key Responsibilities Lead the design and implementation of the data & analytics architecture ensuringcompliance, quality, and sustainable platform growth Build scalable end-to-end data pipelines to integrate and model datasets from differentsources that meet functional and non-functional requirements Manage the technical scope and architecture of...

  • Data Engineer

    Found in: Appcast Linkedin IN C2 - 2 weeks ago


    Noida, India Network18 Media & Investments Limited Full time

    Key Responsibilities Lead the design and implementation of the data & analytics architecture ensuringcompliance, quality, and sustainable platform growth Build scalable end-to-end data pipelines to integrate and model datasets from differentsources that meet functional and non-functional requirements Manage the technical scope and architecture of...

  • Network Engineering Advisor

    Found in: beBee S IN - 4 weeks ago


    noida, India NTT DATA Services Full time

    Req ID: 272284  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Network Engineering Advisor to join our team in noida, Uttar Pradesh (IN-UP), India (IN). ole...

  • Data Engineer

    Found in: Whatjobs IN C2 - 6 days ago


    noida, India Transaction Network Services Full time

    An extraordinarily talented group of individuals work together every day to drive TNS' success, from both professional and personal perspectives.Come join the excellence! Overview Transaction Network Services (TNS), a Koch Industries company is seeking a talented and motivated data engineer to work within our AI Labs, India. As a Data Engineer you...

  • Data Engineer

    Found in: Talent IN C2 - 1 week ago


    Noida, India Transaction Network Services Full time

    An extraordinarily talented group of individuals work together every day to drive TNS' success, from both professional and personal perspectives.Come join the excellence! Overview Transaction Network Services (TNS), a Koch Industries company is seeking a talented and motivated data engineer to work within our AI Labs, India. As a Data Engineer you will...

  • SFDC Quality Engineer

    Found in: beBee S IN - 3 weeks ago


    Noida, India NTT DATA Services Full time

    NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a SFDC Quality Engineer to join our team in Hyderabad, Telangana, ​​​​​​​India. Once You Are Here, You...

  • Network Engineering Senior Specialist

    Found in: beBee S IN - 4 weeks ago


    noida, India NTT DATA Services Full time

    Req ID: 272284  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Network Engineering Senior Specialist to join our team in noida, Uttar Pradesh (IN-UP), India...

  • Senior Data Engineer

    Found in: Whatjobs IN C2 - 1 week ago


    noida, India CloudAngles Inc Full time

    Data Engineer HealthComp is hiring an experienced Data Engineer who will design, develop, and maintain data pipelines for core data storage in our Analytics Engineering team. This person will support the success of the analytics engineering team by developing high quality, robust data pipelines and refining system architectures to support quality,...