Python Pyspark and AWS TL Position

2 weeks ago

hyderabad, India Alignity Solutions Full time
Do you love a career where you Experience Grow & Contribute at the same time while earning at least 10% above the market If so we are excited to have bumped onto you.
Learn how we are redefining the meaning of work and be a part of the team raved by Clients Jobseekers and Employees.
  • Jobseeker Video Testimonials
  • Employee Glassdoor Reviews
If you are a Python Pyspark and AWS TL Position looking for excitement challenge and stability in your work then you would be glad to come across this page.

We are an IT Solutions Integrator/Consulting Firm helping our clients hire the right professional for an exciting long term project. Here are a few details.

Check if you are up for maximizing your earning/growth potential leveraging our Disruptive Talent Solution.
Role:Python Pyspark and AWS TL Position
Location: Hyderabad/Bangalore/Gurgaon/Mumbai/Pune
Hybrid Mode Position
Exp: 5 6 years
Requirements We are seeking a Python Pyspark and AWS TL Position highly skilled with expertise in Python PySpark and AWS cloud services. The ideal candidate will have a strong background in Business Intelligence (BI) and data warehousing technologies with a focus on ETL processes and RDBMS. You will work closely with the application development teams to design build and optimize data pipelines and workflows throughout the development lifecycle. Additionally you will lead a small team of engineers to ensure the successful delivery of datadriven solutions.
Key Responsibilities:

  • Design and Develop Data Pipelines:

    • Create and maintain robust scalable data pipelines using Python PySpark and Spark SQL.
    • Build Airflow DAG pipelines for seamless data ingestion and workflow automation.

  • Data Management and Processing:

    • Work with large datasets processing them into usable formats using PySpark and DataFrames.
    • Leverage your expertise in SQL for data extraction transformation and loading (ETL) ensuring optimal performance of queries and data models.

  • Cloud Services and Architecture:

    • Implement and maintain data solutions on AWS using services like S3 Glue Redshift Lambda IAM EMR Athena and Spectrum.
    • Ensure data security scalability and costeffectiveness within the AWS environment.

  • Collaboration and Support:

    • Work closely with application development teams to align data engineering solutions with business requirements and development lifecycles.
    • Gather requirements from key business stakeholders and translate them into actionable data solutions.
    • Mentor and lead a team of 4 or more engineers ensuring best practices in coding testing and deployment.

  • Performance Optimization and Monitoring:

    • Conduct performance tuning and optimization of SQL queries to ensure efficient data access and transformation processes.
    • Monitor and troubleshoot issues within data pipelines ensuring data integrity and operational efficiency.

  • Leadership and Ownership:

    • Take full ownership of tasks and drive them to successful completion showing initiative in problemsolving and improving existing processes.
    • Contribute to continuous improvement efforts by identifying and implementing automation opportunities and enhancing existing workflows.

Required Skills and Qualifications:

  • Technical Skills:

    • Proficiency in Python PySpark Spark SQL and working with DataFrames .
    • Strong understanding of ETL processes data warehousing concepts and relational databases (RDBMS ).
    • Handson experience with Airflow for managing and automating data pipelines.
    • Extensive knowledge of AWS cloud services such as S3 Glue Redshift Lambda IAM EMR Athena and Spectrum.
    • Solid experience in SQL query optimization and performance tuning.

  • Experience:

    • Minimum 56 years of experience in data engineering or related fields.
    • Proven track record of leading teams of at least 4 members with handson involvement in project delivery.
    • Experience working within agile development environments collaborating with crossfunctional teams.

  • Soft Skills:

    • Strong written and verbal communication skills capable of translating technical concepts for nontechnical stakeholders.
    • Excellent problemsolving skills with a proactive attitude and ability to take initiative.
    • Skilled at gathering and understanding business requirements and aligning them with technical solutions.

Benefits Visit us at . Alignity Solutions is an Equal Opportunity Employer M/F/V/D.
CEO Message: Click Here
Clients Testimonial: Click Here

  • Python, Pyspark and AWS

    4 weeks ago

    Hyderabad, India Alignity Solutions Full time

    Do you love a career where you Experience, Grow & Contribute at the same time, while earning at least 10% above the market? If so, we are excited to have bumped onto you.Learn how we are redefining the meaning of work, and be a part of the team raved by Clients, Job-seekers and Employees.Jobseeker Video Testimonials Employee Glassdoor ReviewsIf you are...

  • Python Pyspark and AWS TL Position

    2 weeks ago

    Hyderabad, India Alignity Solutions Full time

    Do you love a career where you Experience Grow & Contribute at the same time while earning at least 10% above the market If so we are excited to have bumped onto you.Learn how we are redefining the meaning of work and be a part of the team raved by Clients Jobseekers and Employees.Jobseeker Video Testimonials Employee Glassdoor ReviewsIf you are a Python...

  • Python Pyspark and AWS TL Position

    2 weeks ago

    hyderabad, India Alignity Solutions Full time

    Do you love a career where you Experience Grow & Contribute at the same time while earning at least 10% above the market If so we are excited to have bumped onto you.Learn how we are redefining the meaning of work and be a part of the team raved by Clients Jobseekers and Employees.Jobseeker Video Testimonials Employee Glassdoor ReviewsIf you are a Python...

  • Python, Pyspark and AWS

    4 weeks ago

    Hyderabad, India Alignity Solutions Full time

    Do you love a career where you Experience, Grow & Contribute at the same time, while earning at least 10% above the market? If so, we are excited to have bumped onto you.Learn how we are redefining the meaning of work, and be a part of the team raved by Clients, Job-seekers and Employees.Jobseeker Video Testimonials Employee Glassdoor ReviewsIf you are...

  • Python Pyspark and AWS TL Position

    4 weeks ago

    Hyderabad, India Alignity Solutions Full time

    Doyou love a career where youExperienceGrow & Contributeatthe same time while earning at least 10% above the market If so weare excited to have bumped ontoyou.Learnhow we are redefiningthemeaningofworkand be a part of the team raved by Clients Jobseekers andEmployees.JobseekerVideoTestimonialsEmployeeGlassdoorReviewsIfyou are aPythonPyspark and AWS TL...

  • Senior Data Engineer

    3 weeks ago

    Hyderabad, Telangana, India Alignity Solutions Full time

    Job Title: Senior Data Engineer - Python, PySpark, and AWSAlignity Solutions is seeking a highly skilled Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data pipelines using Python, PySpark, and AWS cloud services.Key Responsibilities:Design and develop data...

  • Senior Data Engineer

    3 weeks ago

    Hyderabad, Telangana, India Alignity Solutions Full time

    Job Title: Senior Data Engineer - Python, PySpark, and AWSWe are seeking a highly skilled Senior Data Engineer to join our team at Alignity Solutions. As a Senior Data Engineer, you will be responsible for designing, building, and optimizing data pipelines and workflows using Python, PySpark, and AWS cloud services.Key Responsibilities:Design and develop...

  • Senior Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Alignity Solutions Full time

    Job Title: Senior Data Engineer - Python Pyspark and AWSJob Summary:We are seeking a highly skilled Senior Data Engineer to join our team at Alignity Solutions. As a Senior Data Engineer, you will be responsible for designing, building, and optimizing data pipelines using Python, PySpark, and AWS cloud services.Key Responsibilities:Design and develop data...

  • Senior Data Engineer

    3 weeks ago

    Hyderabad, Telangana, India Alignity Solutions Full time

    Job Title: Senior Data Engineer - Python, PySpark and AWSWe are seeking a highly skilled Senior Data Engineer to join our team at Alignity Solutions. As a Senior Data Engineer, you will be responsible for designing, building, and optimizing data pipelines and workflows using Python, PySpark, and AWS cloud services.Key Responsibilities:Design and develop data...

  • AWS Data Engineer

    2 weeks ago

    Hyderabad, India I square soft Full time

    Job Description : - Develop, deploy, and maintain robust ETL pipelines using Python and PySpark to process large-scale datasets efficiently.- Utilize PySpark to perform complex data transformations and processing tasks, ensuring data accuracy and quality. - Write and optimize advanced SQL queries to extract, manipulate, and analyze data from relational...

  • AWS Data Engineer

    2 months ago

    Hyderabad, India I square soft Full time

    Job Description : - Develop, deploy, and maintain robust ETL pipelines using Python and PySpark to process large-scale datasets efficiently.- Utilize PySpark to perform complex data transformations and processing tasks, ensuring data accuracy and quality. - Write and optimize advanced SQL queries to extract, manipulate, and analyze data from relational...

  • AWS Data Engineer

    1 month ago

    Hyderabad, Telangana, India I square soft Full time

    Job Description : - Develop, deploy, and maintain robust ETL pipelines using Python and PySpark to process large-scale datasets efficiently.- Utilize PySpark to perform complex data transformations and processing tasks, ensuring data accuracy and quality. - Write and optimize advanced SQL queries to extract, manipulate, and analyze data from relational...

  • Senior Data Engineer

    3 weeks ago

    Hyderabad, Telangana, India Alignity Solutions Full time

    Job Title: Senior Data Engineer - Python, PySpark, and AWSWe are seeking a highly skilled Senior Data Engineer to join our team at Alignity Solutions. As a Senior Data Engineer, you will be responsible for designing, building, and optimizing data pipelines and workflows using Python, PySpark, and AWS cloud services.Key Responsibilities:Design and Develop...

  • Senior Data Engineer

    3 weeks ago

    Hyderabad, Telangana, India Alignity Solutions Full time

    Job Title: Senior Data Engineer - Python, PySpark and AWSJob Description: We are seeking a highly skilled Senior Data Engineer to lead our data engineering team. The ideal candidate will have a strong background in Business Intelligence (BI) and data warehousing technologies, with a focus on ETL processes and RDBMS.Key Responsibilities:* Design and Develop...

  • Senior Data Engineer Python Pyspark AWS

    2 weeks ago

    Hyderabad, Telangana, India Alignity Solutions Full time

    Data Engineer (Senior) - Python, Pyspark, AWSAbout the Role:We are seeking a highly skilled Data Engineer to join our team at Alignity Solutions. The ideal candidate will have a strong background in data engineering and experience working with Python, Pyspark, and AWS cloud services.Key Responsibilities:Design and Develop Data Pipelines:Create and maintain...

  • Senior Data Engineer

    3 weeks ago

    Hyderabad, Telangana, India Alignity Solutions Full time

    Job Title: Senior Data Engineer - Python, PySpark and AWSWe are seeking a highly skilled Senior Data Engineer to join our team at Alignity Solutions. As a Senior Data Engineer, you will be responsible for designing, building, and optimizing data pipelines and workflows using Python, PySpark, and AWS cloud services.Key Responsibilities:Design and Develop Data...

  • Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India AppSierra Solutions Pvt Ltd Full time

    We are seeking an experienced Data Engineer to develop, test, and maintain scalable data pipelines and systems. This role is crucial for ensuring that data is collected, stored, and transformed efficiently and accurately to meet the needs of our organization.Responsibilities:Develop, test, and maintain data pipelines using AWS services, Python, and...

  • Pyspark, Aws

    1 month ago

    Hyderabad, Telangana, India Cognizant Full time

    **Exp: 4 to 13 years** **Skill: Pyspark, AWS** **Location : Bangalore/Hyderabad/Kolkata/Pune/Chennai** **Technical Skills**: Python,AWS Glue Studio,AWS Glue ETL,AWS Glue Catalog,Amazon S3,Apache Spark **Responsibilities : -** Develop and maintain data pipelines using AWS Glue Studio and AWS Glue ETL. - Ensure data quality and integrity by implementing...

  • Senior AWS Data Engineer

    1 month ago

    Chennai/Bangalore/Hyderabad/Pune, India ProgressX Full time

    Role : AWS Data : India Type : Full-time Experience : 5-9 yearsFunctions : Consulting, Finance, Information Technology, Data Engineering & AnalyticsIndustries : Capital Markets, Investment Banking, Alternative Investments, Financial Services, Management Consulting, Information Technology and Services, Business Travel Healthcare Job Description : We...

  • Senior Cloud Data Engineer

    5 months ago

    Hyderabad/Bangalore/Chennai/Vishakhapatnam/Vizag, IN Mouri Tech Ltd Full time

    Senior Cloud Data Engineer (AWS, Python, Pyspark) Job Title : Senior AWS Cloud Data EngineerWork Location : Hyderabad/Kolhapur/Bangalore/Chennai Experience : 6 to 9 yearsRequired Skills : Python, Pyspark, AWS services such as DMS, SAM, Glue, Redshift, Lamda S3 with Apache Airflow, CI/CD, :- Minimum of 6-9 Experience with the core AWS Services and setting up...