Data Engineering Specialist
4 days ago
We are seeking a highly skilled Recro team member to fill the role of AWS Data Engineer.
This position is based in Remote. The ideal candidate must possess deep expertise in PySpark, Python, SQL, and AWS services (Glue, S3, Redshift).
The salary for this position will be around $120000 per year.
Job Description:
The Data Engineer will design, develop, and optimize data pipelines and data assets using PySpark and Python.
Key Responsibilities:
- Design, develop, and optimize data pipelines and data assets using PySpark and Python.
- Perform code optimization using Spark SQL and PySpark for enhanced performance.
- Work closely with AWS services, especially S3, Glue, Redshift, Lambda, and EC2, and explain the benefits of each.
- Conduct code refactorization of legacy codebases for better readability and maintainability.
- Apply unit testing and Test-Driven Development (TDD) practices to ensure code quality.
- Debug and fix complex bugs, addressing performance, concurrency, or logic issues.
Mandatory Skills:
• PySpark and Python
• Strong expertise in SQL and experience in Spark SQL for data optimization.
• AWS services knowledge, particularly in Glue, S3, Redshift, and Lambda.
• Proficiency in code versioning tools (Git) and artifact repositories like JFrog Artifactory.
• Code refactorization and modernization skills for maintaining code quality.
• Experience with Unit Testing and TDD.
Benefits:
• Salary range: $120000/year
Others:
-
Data Engineering Specialist
3 weeks ago
India Manuh Technologies Full timeAbout the Role:As a Data Engineering Specialist at Manuh Technologies, you will be responsible for designing, developing, and maintaining large-scale data processing systems using technologies like Cloudera, Hadoop, and Spark. With a strong focus on data processing and analytics, you will work with our team to develop and implement robust data solutions that...
-
Business Intelligence Data Analyst
4 weeks ago
Northeast India ScS - Sofa Carpet Specialist Full timeAbout the RoleWe are seeking a talented Business Intelligence Developer to join our team at ScS, a leading sofa specialist in the UK. As a Business Intelligence Developer, you will play a crucial role in helping us make data-driven decisions to drive business growth and success.Key ResponsibilitiesDesign and develop business intelligence solutions to support...
-
Data Engineering Specialist
3 weeks ago
Anywhere in India/Multiple Locations/Bangalore Infometry Full timeData Engineering Specialist OpportunityWe are seeking a highly skilled Data Engineering Specialist to join our team at Infometry Inc. This role involves designing, developing, and maintaining data pipelines and infrastructure to support our data warehousing and analytics initiatives.- Design and develop scalable and efficient data pipelines using Matillion...
-
Business Intelligence Data Analyst
3 weeks ago
Northeast India ScS - Sofa Carpet Specialist Full timeAbout the RoleWe are seeking a talented Business Intelligence Developer to join our team at ScS - Sofa Carpet Specialist.Key Responsibilities:Develop and maintain business intelligence solutions to support our home furnishings business.Collaborate with cross-functional teams to identify and prioritize business needs.Analyze data to inform business decisions...
-
Business Intelligence Data Analyst
2 weeks ago
Northeast India ScS - Sofa Carpet Specialist Full timeOverviewScS, a leading UK-based sofa specialist, offers an exciting opportunity for a Business Intelligence Data Analyst to join their team in Sunderland.As one of the country's largest retailers, ScS operates over 500 stores and is serviced by 9 distribution centres. With a rich history spanning over a century, the company has established itself as a...
-
India McLaren Strategic Solutions (MSS) Full timeAbout the Role:We are seeking a highly skilled Data Engineering Specialist to join our team at McLaren Strategic Solutions (MSS) and play a key role in migrating and modernizing ETL processes from IBM DataStage to Informatica PowerCenter. This is an exciting opportunity for a talented professional to work closely with a team of data engineers, senior...
-
Lead data engineer
6 days ago
India Wavicle Data Solutions Full timeJob Description: We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering. As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, Py Spark, AWS, Databricks, SQL, and leadership skills will be crucial for success. Key...
-
Data Engineering Specialist
4 weeks ago
Anywhere in India/Multiple Locations Coders Brain Technology Pvt. Ltd. Full time**Job Title:** Data Engineering Specialist**About the Role:**Coders Brain Technology Pvt. Ltd. is seeking a skilled Data Engineering Specialist to join our modernization initiative team. The ideal candidate will have experience in designing and implementing efficient data handling systems using Java and Spark.**Key Responsibilities:**Design and implement...
-
Lead Data Engineer
2 weeks ago
India Wavicle Data Solutions Full timeJob Description:We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering.As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions.Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success.Key Responsibilities:Lead...
-
Lead Data Engineer
2 weeks ago
India Wavicle Data Solutions Full timeJob Description: We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering. As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success. Key...
-
Aws data engineer
3 days ago
India ITI Data Full timeJob Description We are looking for an AWS Data with primary skills on Py Spark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....
-
AWS Data Engineer
3 months ago
India ITI Data Full timeJob Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....
-
AWS Data Engineer
3 weeks ago
India ITI Data Full timeJob Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....
-
AWS Data Engineer
3 weeks ago
india ITI Data Full timeJob Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....
-
AWS Data Engineer
3 months ago
India ITI Data Full timeJob DescriptionWe are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources. There...
-
AWS Data Engineer
3 months ago
India ITI Data Full timeJob Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....
-
Data Engineering Specialist
1 month ago
Anywhere in India/Multiple Locations TalentXO Full timeKey Responsibilities :As a Data Engineering Specialist at TalentXO, you will be responsible for designing and implementing data pipelines using AWS Glue and AWS MWAA (Airflow). You will work collaboratively with cross-functional teams and stakeholders to deliver high-impact data engineering projects.Required Qualifications :7-8 years of experience as a Data...
-
Data Engineering Specialist
4 weeks ago
Anywhere in India/Multiple Locations TalentXO Full timeData Engineering Role OverviewTalentXO is seeking a highly skilled Data Engineering Specialist to join our team. This is a critical role that will be responsible for designing and implementing data pipelines using AWS Glue and AWS Airflow.Key ResponsibilitiesDesign, develop, and deploy data pipelines using AWS Glue and AWS AirflowCollaborate with...
-
Lead Data Engineer: Strategic Data Architect
2 weeks ago
India Wavicle Data Solutions Full timeWavicle Data Solutions is seeking an experienced Lead Data Engineer to play a pivotal role in architecting and implementing data solutions.About the RoleThis position offers a competitive salary of $180,000 - $220,000 per annum, commensurate with experience. Key ResponsibilitiesDesign and develop scalable and efficient data pipelines using Python and...
-
india Wavicle Data Solutions Full timeJob Description: We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering. As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success. Key Responsibilities:...