Pyspark Data Engineer

1 week ago


Hyderabad, Telangana, India Virtusa Full time
Pyspark Data Engineer
  • CREQ190586 Description 4 to 6 years of relevant work experience showing growth as a Data EngineerHands On programming experienceImplementation Experience on Kafka, Kinesis, Spark, AWS Glue, AWS LakeFormation.

Experience of performance optimization in Batch and Real time processing applicationsExpertise in Data Governance and Data Security Implementation .Good hands-on design and programming skills building reusable tools and products.

Experience developing in AWS or similar cloud platforms.

Preferred:
, ECS, EKS, S3, EMR, DynamoDB, Aurora, Redshift, QuickSight or similar. Familiarity with systems with very high volume of transactions, micro service design, or data processing pipelines (Spark). Knowledge and hands-on experience with server-less technologies such as Lambda, MSK, MWAA, Kinesis Analytics a plus. Expertise in practices like Agile, Peer reviews, Continuous Integration. Primary Location Hyderabad, Andhra Pradesh, India Job Type Experienced Primary Skills DynamoDB, AWS Lake Formation, Python, Amazon Redshift, AWS Glue, Kafka, Java, Spark Years of Experience 6 Qualification


4 to 6 years of relevant work experience showing growth as a Data EngineerHands On programming experienceImplementation Experience on Kafka, Kinesis, Spark, AWS Glue, AWS LakeFormation.

Experience of performance optimization in Batch and Real time processing applicationsExpertise in Data Governance and Data Security Implementation .Good hands-on design and programming skills building reusable tools and products.

Experience developing in AWS or similar cloud platforms.

Preferred:
, ECS, EKS, S3, EMR, DynamoDB, Aurora, Redshift, QuickSight or similar. Familiarity with systems with very high volume of transactions, micro service design, or data processing pipelines (Spark). Knowledge and hands-on experience with server-less technologies such as Lambda, MSK, MWAA, Kinesis Analytics a plus. Expertise in practices like Agile, Peer reviews, Continuous Integration.
Travel No
  • Data Engineer

    1 week ago


    Hyderabad, Telangana, India WALLERO TECHNOLOGIES PRIVATE LIMITED Full time

    Roles & Responsibilities :- Tech Stack Expertise : Proficiency in Python, Pyspark, and Databricks, utilizing these tools to develop robust data pipelines, perform data transformations, and optimize data workflows within the Supply Chain realm.- Innovative Problem Solving : Demonstrate technical expertise by thinking creatively and providing innovative...

  • Data Engineer

    1 week ago


    Hyderabad, Telangana, India Risk Resources LLP Full time

    Job Description :The Cloud Engineer will focus on Capture data and transforming the data as per business needs. We receive data from multiple internal and external sources which is maintained in Data marts within Data lakeMandatory Skills :- 5 + years of experience on Apachespark, Databricks, Elastic Search, PySpark, Delta Lake, Data Factory, Data Bricks,...

  • Pyspark

    1 week ago


    Hyderabad, Telangana, India Cognizant Technology Solutions Full time

    Job descriptionPySpark Developer / PySpark Data EngineerShould have at least three years of strong experience in PySparkStrong SQL ExpertiseStrong communication and client-facing skillsEmployee Status :Full Time EmployeeShift :Day JobTravel :NoJob Posting :Jun **About Cognizant


  • Hyderabad, Telangana, India Virtusa Full time

    Pyspark Data Engineer - CREQ190586 Description 4 to 6 years of relevant work experience showing growth as a Data Engineer Hands On programming experience Implementation Experience on Kafka, Kinesis, Spark, AWS Glue, AWS LakeFormation. Experience of performance optimization in Batch and Real time processing applications Expertise in Data Governance and Data...


  • Hyderabad, Telangana, India data Full time

    What can you tell your friendswhen they ask you what you do?We're looking for an experienced Big Data Engineer who can create innovative new products in the analytics and data space. You will participate in the development that creates the world's #1 mobile app analytics service. Together with the team, you will build out new product features and...


  • Hyderabad, Telangana, India data Full time

    What can you tell your friends when they ask you what you do? We're looking for an experienced Big Data Engineer who can create innovative new products in the analytics and data space. You will participate in the development that creates the world's #1 mobile app analytics service. Together with the team, you will build out new product features and...


  • Hyderabad, Telangana, India Virtusa Full time

    Pyspark Data Engineer CREQ187054 Description 6 8 years of relevant work experience showing growth as a Data Engineer.Hands On programming experienceImplementation Experience on Kafka, Kinesis, Spark, AWS Glue, AWS LakeFormation.Experience of performance optimization in Batch and Real time processing applicationsExpertise in Data Governance and Data Security...

  • Big Data Engineer

    2 months ago


    Hyderabad, Telangana, India RENOIRCE TECHNOLOGIES PRIVATE LIMITED Full time

    Job Description :Primary & mandatory : PYSPARKSecondary : GCP- At least 5 years of experience in Big Data, Hadoop Data Platform (HDP) and ETL and capable of configuring data pipelines.- Possess the following technical skills - SQL, Python, Pyspark, Hive, Unix, ETL, Control-M (or similar)- At least 2 years of experience in Cloudera Data Platform (CDP)- Skills...

  • Big Data Engineer

    4 weeks ago


    Hyderabad, Telangana, India RENOIRCE TECHNOLOGIES PRIVATE LIMITED Full time

    Job Description :Primary & mandatory : PYSPARKSecondary : GCP- At least 5 years of experience in Big Data, Hadoop Data Platform (HDP) and ETL and capable of configuring data pipelines.- Possess the following technical skills - SQL, Python, Pyspark, Hive, Unix, ETL, Control-M (or similar)- At least 2 years of experience in Cloudera Data Platform (CDP)- Skills...


  • Hyderabad, Telangana, India KPI Partners Full time

    We are looking for a PySpark solutions developer and data engineer that is able to design and build solutions for one of our Fortune 500 Client programs, which aims to build a data standardized and curation-based Hadoop cluster. This high visibility, fast-paced key initiative will integrate data across internal and external sources, provide analytical...


  • Hyderabad, Telangana, India Saxon AI Full time

    Only Immediate Joiners Azure Data Engineer Hyderabad, TG Looking for people with strong technical expertise in Microsoft Azure Cloud data platform to join the group of our Modern Data Solutions team. This is a fantastic opportunity to be part of a startup culture whilst being instrumental in the growth of new service offering. Key Responsibilities: ...

  • Data Engineer

    1 week ago


    Hyderabad, Telangana, India EDGESOFT Full time

    Job Description:The perfect candidate needs to have a solid understanding and practical experience in PySpark and various DataBricks components. As a key member of our data team, you will have a vital role in developing, improving, and managing our data infrastructure to ensure smooth and effective data processing.Responsibilities:Design, develop, and...


  • Hyderabad, Telangana, India Virtusa Full time

    Python Pyspark with AWS - CREQ188741 Description Responsibilities:1.Analyze various data sources present with the client, including structured and unstructured data formatsentities across different data sources to identify relationships and data inconsistencies3.Analyze existing reports created with Tableau and other tools to understand data usage and...

  • Pyspark Lead

    1 week ago


    Hyderabad, Telangana, India CIEL HR Services Full time

    We are hiring for our client-An International IT service provider Role- Pyspark Lead Mandatory skill set- Python+Spark+Scala(experience in all 3 skill sets should be strong & mandatory) ,Data Engineering+ AWS Exp. Level- 5-12 yrs Location- Bangalore & Hyderabad Notice Period-Immediate to 15days Job Description Design and implement scalable and...

  • Data Engineer

    1 week ago


    Hyderabad, Telangana, India Nisum Full time

    What You'll DoAs an experienced data engineer of expertise in data engineering technologies such as PySpark, Python, Scala, Java, SQL, Databricks, RESTful Web Services, and Microservices Architecture, your responsibilities will include:Collaborate with cross-functional teams to develop and implement data solutions.Assist in managing architecture, platforms,...


  • Hyderabad, Telangana, India EMentor Enterprises Private Limited Full time

    Skills Required: Azure ADFDatabricks with Pyspark PythonData Engineer with Pyspark Databricksskillset 8 yearsof experience Data Engineering with min 5 years hands on experiencein Pyspark for datatransformations.Sound Knowledge on Azure DataBricks Azure DataLake. Soundknowledge in Data Bricks & Logic AppsDelta Lake Azure SQLand Azure blob storage Azure logic...

  • Data Engineer

    1 week ago


    Hyderabad, Telangana, India Tech Mahindra Full time

    Title: Data EngineerLocation: Hyderabad /Pan IndiaExperience: 7-12yearsNP: Immediate to 15daysCompany Profile:Tech Mahindra represents the connected world, offering innovative and customer-centric information technology experiences. We #Rise together to create sustainable businesses that can bring about lasting change in our communities – to create an...

  • AWS Data Engineer

    1 week ago


    Hyderabad, Telangana, India ProArch Full time

    ProArch is seeking an experienced AWS Data Engineer to join our team. As an AWS Data Engineer, you will be responsible for designing, building, and maintaining data solutions on the AWS platform.Job Description:Must to Have Skills : AWS - Data Engineer - PySpark, Glue, S3, Athena To work in the capacity of AWS Cloud developer. Scripting/programming in...

  • AWS Data Engineer

    1 week ago


    Hyderabad, Telangana, India ProArch Full time

    ProArch is seeking an experienced AWS Data Engineer to join our team. As an AWS Data Engineer, you will be responsible for designing, building, and maintaining data solutions on the AWS platform.Job Description:Must to Have Skills : AWS Data EngineerPySpark, Glue, S3, AthenaTo work in the capacity of AWS Cloud developer.Scripting/programming in...

  • Data Engineer

    1 week ago


    Hyderabad, Telangana, India HNM Solutions Full time

    Note : Only immediate joiner Role : Pyspark Experience : 8+ years Location : Hyderabad, Chennia Interview mode is Walkin drive Requirements : Mandatory skills : (8+ Years of experience in Data engineering with 5+ Years on Pyspark/NoSQL is Mandatory) Person should be strong in PysparkShould have hands on in MWAA (Airflow) / AWS EMR(Hadoop, Hive)...