Python Pyspark with AWS

1 week ago


Hyderabad, Telangana, India Virtusa Full time
Python Pyspark with AWS - CREQ188741

Description Responsibilities:1.Analyze various data sources present with the client, including structured and unstructured data formatsentities across different data sources to identify relationships and data inconsistencies3.Analyze existing reports created with Tableau and other tools to understand data usage and identify gaps4.Colloborate with data engineers to define data extraction, transformation, and Loading (ETL) processes5.Develop a target data model with tables and relationships representing the business domain6.Document data model and its components for future reference7.

support data viz efforts providing insights and analysisRequired skills:


analytical and problem-solving skills2.Experience with data analysis tools and techniques (SQL, Python, Excel)3.Proficient in data visualization tools (Tableau, Power BI)4.

Understanding of data modeling concepts5.

Excellent communication and collaboration skillsGood to have:
Familiarity with querying data from salesforce.understanding of data integration tools like Informatica and their use in data analysis projects.
Primary Location Hyderabad, Andhra Pradesh, India Job Type Experienced Primary Skills ETL, Data Visualization, PySpark, Python Years of Experience 8 Qualification


Responsibilities:1.Analyze various data sources present with the client, including structured and unstructured data formatsentities across different data sources to identify relationships and data inconsistencies3.Analyze existing reports created with Tableau and other tools to understand data usage and identify gaps4.Colloborate with data engineers to define data extraction, transformation, and Loading (ETL) processes5.Develop a target data model with tables and relationships representing the business domain6.Document data model and its components for future reference7.

support data viz efforts providing insights and analysisRequired skills:


analytical and problem-solving skills2.Experience with data analysis tools and techniques (SQL, Python, Excel)3.Proficient in data visualization tools (Tableau, Power BI)4.

Understanding of data modeling concepts5.

Excellent communication and collaboration skillsGood to have:
Familiarity with querying data from salesforce.understanding of data integration tools like Informatica and their use in data analysis projects.

Travel No

  • Hyderabad, Telangana, India Virtusa Full time

    Python Pyspark with AWS - CREQ188741 DescriptionResponsibilities:Analyze various data sources present with the client, including structured and unstructured data formats entities across different data sources to identify relationships and data inconsistenciesAnalyze existing reports created with Tableau and other tools to understand data usage and identify...


  • Hyderabad, Telangana, India Xpetize Full time

    Years of Experience : 3+ Years**Joining Time frame :immediate to 1 Week**Positions: 4Mandatory skills:Mandatory skills: Experience in Python/Pyspark/Scala SQL GCP/AWS/Azure Hadoop / HDFS/Other Databases Airflow/Other Automation tools Linux/ Bash scripting Kafka/Flume/Kinesis/Data StreamingJob Type : Full Time**About Us


  • Hyderabad, Telangana, India Virtusa Full time

    Pyspark, AWS Engineer Lead - CREQ187058 Description 6-8 years of relevant work experience showing growth as a Data Engineer.Hands On programming experienceImplementation Experience on Kafka, Kinesis, Spark, AWS Glue, AWS LakeFormation.Experience of performance optimization in Batch and Real time processing applicationsExpertise in Data Governance and Data...


  • Hyderabad, Telangana, India Virtusa Full time

    Pyspark, AWS Engineer Lead CREQ187058 Description 6 8 years of relevant work experience showing growth as a Data Engineer.Hands On programming experienceImplementation Experience on Kafka, Kinesis, Spark, AWS Glue, AWS LakeFormation.Experience of performance optimization in Batch and Real time processing applicationsExpertise in Data Governance and Data...

  • Python Developer

    7 days ago


    Hyderabad, Telangana, India PURVIEW Full time

    Purview is hiring Python Developers with one of our valued clients. If you're interested, please reply for more details.Job Details:Role: Python Developer (Python+Pyspark+AWS)Location: HyderabadDuration: Permanent with PurviewWe are looking for 6-7 years experience with (Python+Pyspark+AWS).Job Description:Strong knowledge ofPython/Pyspark and Bash...

  • Python Developer

    7 days ago


    Hyderabad, Telangana, India PURVIEW Full time

    Purview is hiring Python Developers with one of our valued clients. If you're interested, please reply for more details.Job Details:Role: Python Developer (Python+Pyspark+AWS)Location: HyderabadDuration: Permanent with PurviewWe are looking for 6-7 years experience with (Python+Pyspark+AWS).Job Description:Strong knowledge of Python/Pyspark and Bash...

  • AWS Data Engineer

    3 weeks ago


    Hyderabad, Telangana, India DATABUZZPRIVATE LIMITED Full time

    Job Description : As a Data Engineer, you will play a crucial role in designing, developing, and maintaining data architecture and infrastructure. The successful candidate should possess a strong foundation in Python, pyspark, SQL, and ETL processes, with a demonstrated ability to implement solutions in a cloud environment.Mandatory Skills : - Design, build,...


  • Hyderabad, Telangana, India Selsoft Full time

    Job role : Python Pyspark developerExperience : 5+ yearsLocation : Hyderabad, WFOResponsibilities :Ability to design and build Python-based code generation framework and runtime engine by reading Business Rules repository in order to.Requirements :Minimum 3 years of experience in build & deployment of Bigdata applications using Spark SQL, Spark Streaming in...

  • Data Engineer

    7 days ago


    Hyderabad, Telangana, India WALLERO TECHNOLOGIES PRIVATE LIMITED Full time

    Roles & Responsibilities :- Tech Stack Expertise : Proficiency in Python, Pyspark, and Databricks, utilizing these tools to develop robust data pipelines, perform data transformations, and optimize data workflows within the Supply Chain realm.- Innovative Problem Solving : Demonstrate technical expertise by thinking creatively and providing innovative...

  • AWS Data Engineer

    1 week ago


    Hyderabad, Telangana, India ProArch Full time

    ProArch is seeking an experienced AWS Data Engineer to join our team. As an AWS Data Engineer, you will be responsible for designing, building, and maintaining data solutions on the AWS platform.Job Description:Must to Have Skills : AWS - Data Engineer - PySpark, Glue, S3, Athena To work in the capacity of AWS Cloud developer. Scripting/programming in...

  • AWS Data Engineer

    7 days ago


    Hyderabad, Telangana, India ProArch Full time

    ProArch is seeking an experienced AWS Data Engineer to join our team. As an AWS Data Engineer, you will be responsible for designing, building, and maintaining data solutions on the AWS platform.Job Description:Must to Have Skills : AWS Data EngineerPySpark, Glue, S3, AthenaTo work in the capacity of AWS Cloud developer.Scripting/programming in...

  • Pyspark Lead

    7 days ago


    Hyderabad, Telangana, India CIEL HR Services Full time

    We are hiring for our client-An International IT service provider Role- Pyspark Lead Mandatory skill set- Python+Spark+Scala(experience in all 3 skill sets should be strong & mandatory) ,Data Engineering+ AWS Exp. Level- 5-12 yrs Location- Bangalore & Hyderabad Notice Period-Immediate to 15days Job Description Design and implement scalable and...

  • AWS Data Engineer

    1 week ago


    Hyderabad, Telangana, India Corporate Resources Full time

    Job DescriptionDataEngineer on AWS who is adept in cloud friendly tech such as Python and PySpark.Goodknowledge of AWS services such as S3, Lambda, Glue, AthenaIndustryIT-Software / Software ServicesFunctional AreaIT Software - Application Programming, MaintenanceJob RoleSoftware DeveloperJob TypePermanentQualificationUG QualificationB.Tech/B.E - CivilPG...

  • AWS Data Architect

    1 week ago


    Hyderabad, Telangana, India HuQuo Full time

    Role Description: Data Engineer - Big Data The ideal candidate is a hands-on technology developer with experience in developing scalable applications and platforms. They must be at ease working in an agile environment with little supervision. The person should be a self-motivated person with a passion for problem solving and continuous learning. Role and...


  • Hyderabad, Telangana, India Virtusa Full time

    Pyspark Data Engineer CREQ187054 Description 6 8 years of relevant work experience showing growth as a Data Engineer.Hands On programming experienceImplementation Experience on Kafka, Kinesis, Spark, AWS Glue, AWS LakeFormation.Experience of performance optimization in Batch and Real time processing applicationsExpertise in Data Governance and Data Security...


  • Hyderabad, Telangana, India Virtusa Full time

    Pyspark Data Engineer CREQ190586 Description 4 to 6 years of relevant work experience showing growth as a Data EngineerHands On programming experienceImplementation Experience on Kafka, Kinesis, Spark, AWS Glue, AWS LakeFormation.Experience of performance optimization in Batch and Real time processing applicationsExpertise in Data Governance and Data...


  • Hyderabad, Telangana, India Virtusa Full time

    Pyspark Data Engineer - CREQ190586 Description 4 to 6 years of relevant work experience showing growth as a Data Engineer Hands On programming experience Implementation Experience on Kafka, Kinesis, Spark, AWS Glue, AWS LakeFormation. Experience of performance optimization in Batch and Real time processing applications Expertise in Data Governance and Data...

  • Pyspark

    7 days ago


    Hyderabad, Telangana, India Nityo Infotech Full time

    Lead and guide development activities of data ingestions to AWS cloud and Databricks data harmonization meeting the functional and non-functional requirements.Collaborate with SME and business SME to develop architectural requirements to ensure client satisfaction with productDefine the standards processes and the best practices to be followed for...

  • AWS Data Engineer

    1 week ago


    Hyderabad, Telangana, India Corporate Resources Full time

    Job Description DataEngineer on AWS who is adept in cloud friendly tech such as Python and PySpark. Goodknowledge of AWS services such as S3, Lambda, Glue, Athena Industry IT-Software / Software Services Functional Area IT Software - Application Programming, Maintenance Job Role Software Developer Job Type Permanent Qualification UG...


  • Hyderabad, Telangana, India Selsoft Full time

    Job role : Python Pyspark developerExperience : 5+ yearsLocation : Hyderabad, WFOResponsibilities :- Ability to design and build Python-based code generation framework and runtime engine by reading Business Rules repository in order to.Requirements :- Minimum 3 years of experience in build & deployment of Bigdata applications using Spark SQL, Spark Streaming...