Data Engineering Specialist

4 days ago


India Recro Full time

We are seeking a highly skilled Recro team member to fill the role of AWS Data Engineer.

This position is based in Remote. The ideal candidate must possess deep expertise in PySpark, Python, SQL, and AWS services (Glue, S3, Redshift).

The salary for this position will be around $120000 per year.

Job Description:

The Data Engineer will design, develop, and optimize data pipelines and data assets using PySpark and Python.

Key Responsibilities:

  • Design, develop, and optimize data pipelines and data assets using PySpark and Python.
  • Perform code optimization using Spark SQL and PySpark for enhanced performance.
  • Work closely with AWS services, especially S3, Glue, Redshift, Lambda, and EC2, and explain the benefits of each.
  • Conduct code refactorization of legacy codebases for better readability and maintainability.
  • Apply unit testing and Test-Driven Development (TDD) practices to ensure code quality.
  • Debug and fix complex bugs, addressing performance, concurrency, or logic issues.

Mandatory Skills:

• PySpark and Python

• Strong expertise in SQL and experience in Spark SQL for data optimization.

• AWS services knowledge, particularly in Glue, S3, Redshift, and Lambda.

• Proficiency in code versioning tools (Git) and artifact repositories like JFrog Artifactory.

• Code refactorization and modernization skills for maintaining code quality.

• Experience with Unit Testing and TDD.

Benefits:

• Salary range: $120000/year

Others:



  • India Manuh Technologies Full time

    About the Role:As a Data Engineering Specialist at Manuh Technologies, you will be responsible for designing, developing, and maintaining large-scale data processing systems using technologies like Cloudera, Hadoop, and Spark. With a strong focus on data processing and analytics, you will work with our team to develop and implement robust data solutions that...


  • Northeast India ScS - Sofa Carpet Specialist Full time

    About the RoleWe are seeking a talented Business Intelligence Developer to join our team at ScS, a leading sofa specialist in the UK. As a Business Intelligence Developer, you will play a crucial role in helping us make data-driven decisions to drive business growth and success.Key ResponsibilitiesDesign and develop business intelligence solutions to support...


  • Anywhere in India/Multiple Locations/Bangalore Infometry Full time

    Data Engineering Specialist OpportunityWe are seeking a highly skilled Data Engineering Specialist to join our team at Infometry Inc. This role involves designing, developing, and maintaining data pipelines and infrastructure to support our data warehousing and analytics initiatives.- Design and develop scalable and efficient data pipelines using Matillion...


  • Northeast India ScS - Sofa Carpet Specialist Full time

    About the RoleWe are seeking a talented Business Intelligence Developer to join our team at ScS - Sofa Carpet Specialist.Key Responsibilities:Develop and maintain business intelligence solutions to support our home furnishings business.Collaborate with cross-functional teams to identify and prioritize business needs.Analyze data to inform business decisions...


  • Northeast India ScS - Sofa Carpet Specialist Full time

    OverviewScS, a leading UK-based sofa specialist, offers an exciting opportunity for a Business Intelligence Data Analyst to join their team in Sunderland.As one of the country's largest retailers, ScS operates over 500 stores and is serviced by 9 distribution centres. With a rich history spanning over a century, the company has established itself as a...


  • India McLaren Strategic Solutions (MSS) Full time

    About the Role:We are seeking a highly skilled Data Engineering Specialist to join our team at McLaren Strategic Solutions (MSS) and play a key role in migrating and modernizing ETL processes from IBM DataStage to Informatica PowerCenter. This is an exciting opportunity for a talented professional to work closely with a team of data engineers, senior...

  • Lead data engineer

    6 days ago


    India Wavicle Data Solutions Full time

    Job Description: We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering. As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, Py Spark, AWS, Databricks, SQL, and leadership skills will be crucial for success. Key...


  • Anywhere in India/Multiple Locations Coders Brain Technology Pvt. Ltd. Full time

    **Job Title:** Data Engineering Specialist**About the Role:**Coders Brain Technology Pvt. Ltd. is seeking a skilled Data Engineering Specialist to join our modernization initiative team. The ideal candidate will have experience in designing and implementing efficient data handling systems using Java and Spark.**Key Responsibilities:**Design and implement...

  • Lead Data Engineer

    2 weeks ago


    India Wavicle Data Solutions Full time

    Job Description:We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering.As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions.Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success.Key Responsibilities:Lead...

  • Lead Data Engineer

    2 weeks ago


    India Wavicle Data Solutions Full time

    Job Description: We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering. As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success. Key...

  • Aws data engineer

    3 days ago


    India ITI Data Full time

    Job Description We are looking for an AWS Data with primary skills on Py Spark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....

  • AWS Data Engineer

    3 months ago


    India ITI Data Full time

    Job Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....

  • AWS Data Engineer

    3 weeks ago


    India ITI Data Full time

    Job Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....

  • AWS Data Engineer

    3 weeks ago


    india ITI Data Full time

    Job Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....

  • AWS Data Engineer

    3 months ago


    India ITI Data Full time

    Job DescriptionWe are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources. There...

  • AWS Data Engineer

    3 months ago


    India ITI Data Full time

    Job Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....


  • Anywhere in India/Multiple Locations TalentXO Full time

    Key Responsibilities :As a Data Engineering Specialist at TalentXO, you will be responsible for designing and implementing data pipelines using AWS Glue and AWS MWAA (Airflow). You will work collaboratively with cross-functional teams and stakeholders to deliver high-impact data engineering projects.Required Qualifications :7-8 years of experience as a Data...


  • Anywhere in India/Multiple Locations TalentXO Full time

    Data Engineering Role OverviewTalentXO is seeking a highly skilled Data Engineering Specialist to join our team. This is a critical role that will be responsible for designing and implementing data pipelines using AWS Glue and AWS Airflow.Key ResponsibilitiesDesign, develop, and deploy data pipelines using AWS Glue and AWS AirflowCollaborate with...


  • India Wavicle Data Solutions Full time

    Wavicle Data Solutions is seeking an experienced Lead Data Engineer to play a pivotal role in architecting and implementing data solutions.About the RoleThis position offers a competitive salary of $180,000 - $220,000 per annum, commensurate with experience. Key ResponsibilitiesDesign and develop scalable and efficient data pipelines using Python and...


  • india Wavicle Data Solutions Full time

    Job Description: We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering. As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success. Key Responsibilities:...