Data Engineer

4 weeks ago


india RI Jobs Full time
Job Description

This is a remote position.

Requirement Name: AWS Data Engineer
Experience: 7+ years
Location: Remote
Notice Period: Immediate
Job Description:
We are seeking an experienced AWS Data Engineer for a remote position. The ideal candidate will have extensive experience in AWS services, particularly Redshift, Airflow, and Python scripting. The candidate should also have a strong understanding of data engineering best practices and be able to collaborate effectively with business analysts and stakeholders.
Key Responsibilities:
- Collaborate with business analysts to gather requirements for existing or new ETL pipelines. - Connect with stakeholders daily to discuss project progress and updates. - Work within an Agile process to deliver projects in a timely and efficient manner. - Design and manage Redshift data workloads, including performance tuning techniques. - Develop Airflow Directed Acyclic Graphs (DAGs) to schedule and manage ETL workflows. - Implement best practices for data engineering, including data modeling, data warehousing, and data pipeline architecture. - Monitor and troubleshoot ETL pipelines to ensure smooth operation. - Develop custom Python functions to handle data quality and validation. - Proficiency in AWS services such as S3, CloudFormation, CloudWatch, Service Catalog, and IAM Roles. - Perform data validation and ensure data accuracy and completeness through automated tests and validation processes. - Knowledge of Tableau, including creating Tableau Published Datasets and managing access. - Write PySpark scripts to process data and perform transformations (Good to have). - Run Spark jobs on AWS EMR cluster using Airflow DAGs (Good to have).
Requirements

Requirements:

- Minimum of 7 years of experience in data engineering.


- Strong expertise in AWS services, particularly Redshift, Airflow, and Python scripting.


- Proficiency in data engineering best practices, data modeling, and data pipeline architecture.


- Experience with Tableau for data visualization and access management.


- Knowledge of PySpark and running Spark jobs on AWS EMR cluster (Good to have).


This is an immediate opportunity for a highly skilled AWS Data Engineer to join our team and contribute to the success of our projects.


Requirements
- Strong expertise in AWS services, particularly Redshift, Airflow, and Python scripting. - Proficiency in data engineering best practices, data modeling, and data pipeline architecture. - Experience with Tableau for data visualization and access management. - Knowledge of PySpark and running Spark jobs on AWS EMR cluster (Good to have). Requirements: - Minimum of 7 years of experience in data engineering. - Strong expertise in AWS services, particularly Redshift, Airflow, and Python scripting. - Proficiency in data engineering best practices, data modeling, and data pipeline architecture. - Experience with Tableau for data visualization and access management. - Knowledge of PySpark and running Spark jobs on AWS EMR cluster (Good to have). This is an immediate opportunity for a highly skilled AWS Data Engineer to join our team and contribute to the success of our projects.

  • india K2 Data & Analytics Full time

    Job Description : We are on the lookout for an enthusiastic ML Engineer with over five years of experience to be part of our team, which is focused on developing cutting-edge Video Ad Data technologies. The perfect fit for this role would be someone with a solid grasp of machine learning algorithms and a background in designing and executing large-scale...


  • india NTT DATA Full time

    The role of Critical Facilities Maintenance Engineer is responsible for working with all major systems within a facility or building such as electrical and HVAC systems and performs regular maintenance on all systems. This position performs hands-on operations and maintenance which includes all physical and administrative operations tasks, service, and...

  • Data Engineer

    16 hours ago


    india JRD Systems Full time

    Role : Data Engineer - AWS and Oracle Expert Job Summary: We are seeking a highly skilled and experienced Data Engineer with expertise in data development in AWS and Oracle. The ideal candidate will have a minimum of 5 years of experience in data engineering, with a strong focus on AWS and Oracle technologies. The Data Engineer will be responsible for...

  • Data Engineer

    3 weeks ago


    india TekJobs Full time

    Responsibilities: We are seeking a dedicated Senior Data Engineer to join our data engineering team to build and maintain scalable and reliable data engineering solutions that support our enterprise data warehouse and business analytics. ·In this position, you will be responsible for designing, developing, and deploying data pipelines, workflows, and data...

  • Data Engineer

    2 weeks ago


    india HTC Global Services Full time

    Position Description: • This role is for experienced Data Engineer that will be responsible for designing and building the foundational components required for our customer. This includes bringing disparate sources into our Data Factory and creating data products that will be used by the analytics and reporting teams. • Data engineers will work in small,...

  • Data Engineer

    3 weeks ago


    india Joveo Full time

    We are looking for talented Data Engineers who are passionate about data engineering and have strong experience in building scalable data pipelines. As a Data Engineer at Joveo, you will play a leading role in designing and building datasets that power analytics for teams across Joveo. You will also be working closely with Data Analysts, Data Scientists, and...

  • Data Engineer

    3 weeks ago


    india Straive Full time

    Job Role- AWS Data Engineer Experience- 4 to 6 years Mode- Remote The Data Engineering team is looking for a Data Engineer with experience in building modern data platforms from the ground up. The successful candidate will build and maintain cloud-centric data processing capabilities that unleash the value of the data assets to gain competitive advantage in...

  • Data Engineer

    3 weeks ago


    India Straive Full time

    Job Role- AWS Data EngineerExperience- 4 to 6 yearsMode- RemoteThe Data Engineering team is looking for a Data Engineer with experience in building modern data platforms from the ground up. The successful candidate will build and maintain cloud-centric data processing capabilities that unleash the value of the data assets to gain competitive advantage in the...

  • Data Engineer

    3 weeks ago


    india ValueLabs Full time

    Experience - 6+Years Primary Skills - ADF, SQL Server, Databricks NoteBooks, Data Pipelines, SPROCs, Data Warehouse, Databricks DataLake Secondary Skills - PowerBl, Data modeling Notice Period - Immediate - 15 days Job Description: The Data Engineer is responsible for designing, developing, and maintaining data pipelines and data warehouses to support...

  • Data Engineer

    5 days ago


    india NAB Full time

    Consultant - Data Engineer role exists to ensure the delivery of the Right data to the Right customer at the Right time and at the Right Cost using the Right tools and the Right Technology on NAB’s target state Marketing Platforms. You will enable the move, flow and processing of reusable data assets in the Technology and Enterprise Operations space for...

  • Data Engineer

    4 weeks ago


    india Artefact Full time

    Artefact is a new generation of data service providers specialising in data consulting and data-driven digital marketing. It is dedicated to transforming data into business impact across the entire value chain of organisations. We are proud to say we’re enjoying skyrocketing growth. The backbone of our consulting missions, today our Data consulting team...

  • Data Engineer

    16 hours ago


    india D2N Solutions Full time

    Company Description D2N Solutions is a talent and solutions provider based in Hyderabad. Our team consists of enthusiastic experts in recruitment, compliance, finance, and marketing who understand the challenges faced by both clients and candidates in today's employment climate. We offer all-inclusive support to our clients and candidates, focusing on their...

  • Data Engineer

    2 weeks ago


    India SourceBae Full time

    Job Title: Data Engineer Exp-5+ years experienceResponsibilities:Design, develop, and maintain scalable and efficient data pipelines and ETL processes using Python and PySpark.Build and optimize data pipelines for large-scale data processing and analytics.Implement data processing algorithms and data transformations for cleansing, aggregation, and...

  • Data Engineer

    1 week ago


    india SourceBae Full time

    Job Title: Data Engineer Exp-5+ years experience Responsibilities: Design, develop, and maintain scalable and efficient data pipelines and ETL processes using Python and PySpark. Build and optimize data pipelines for large-scale data processing and analytics. Implement data processing algorithms and data transformations for cleansing, aggregation, and...

  • Data Engineer

    1 week ago


    india Lancesoft India Pvt Ltd Full time

    Hiring for an experienced data engineer to join our team. You will use various methods to transform raw data into useful data systems. For example, you'll create algorithms and conduct statistical analysis. Overall, you'll strive for efficiency by aligning data systems with business goals. To succeed in this data engineering position, you should have strong...

  • Data Engineer

    5 days ago


    india UNO Digital Bank Full time

    Overview: We are looking for an experienced data engineer to join our team. You will use various methods to transform raw data into useful data systems. Overall, you’ll strive for efficiency by aligning data systems with business goals. To succeed in this data engineering position, you should have strong analytical skills and the ability to combine data...

  • Data Engineer

    3 days ago


    India Coffeee.io Full time

    Key Qualifications: Experience: Minimum 5+ years of experience in data engineering or a related field. Technical Skills: Strong expertise in PySpark, Databricks, Python, Pandas, Hadoop, and AWS data technologies. ETL Tools: Hands-on experience with ETL frameworks and tools. Cloud Platforms: Proven experience working with AWS (S3, Redshift, Glue, etc.) or...

  • Data Engineer

    4 days ago


    India Coffeee.io Full time

    Key Qualifications:Experience: Minimum 5+ years of experience in data engineering or a related field.Technical Skills: Strong expertise in PySpark, Databricks, Python, Pandas, Hadoop, and AWS data technologies.ETL Tools: Hands-on experience with ETL frameworks and tools.Cloud Platforms: Proven experience working with AWS (S3, Redshift, Glue, etc.) or similar...

  • Data Engineer

    2 weeks ago


    India CareerXperts Consulting Full time

    We are searching for a skilled and passionate Data Engineer to join our growing team. You will play a pivotal role in designing, building, and maintaining the data pipelines that power our analytics and machine learning initiatives. Responsibilities: Design, develop, and implement scalable data pipelines to extract, transform, and load (ETL) data from...

  • Data Engineers

    4 weeks ago


    india Cubiccode Digital Media LLP Full time

    We are searching for an accountable, multitalented data engineer to facilitate the operations of our data scientists. The data engineer will be responsible for employing machine learning techniques to create and sustain structures that allow for the analysis of data while remaining familiar with dominant programming and deployment strategies in the field....