Pyspark Data Engineer
1 week ago
- CREQ190586 Description 4 to 6 years of relevant work experience showing growth as a Data EngineerHands On programming experienceImplementation Experience on Kafka, Kinesis, Spark, AWS Glue, AWS LakeFormation.
Experience of performance optimization in Batch and Real time processing applicationsExpertise in Data Governance and Data Security Implementation .Good hands-on design and programming skills building reusable tools and products.
Experience developing in AWS or similar cloud platforms.Preferred:
, ECS, EKS, S3, EMR, DynamoDB, Aurora, Redshift, QuickSight or similar. Familiarity with systems with very high volume of transactions, micro service design, or data processing pipelines (Spark). Knowledge and hands-on experience with server-less technologies such as Lambda, MSK, MWAA, Kinesis Analytics a plus. Expertise in practices like Agile, Peer reviews, Continuous Integration. Primary Location Hyderabad, Andhra Pradesh, India Job Type Experienced Primary Skills DynamoDB, AWS Lake Formation, Python, Amazon Redshift, AWS Glue, Kafka, Java, Spark Years of Experience 6 Qualification
4 to 6 years of relevant work experience showing growth as a Data EngineerHands On programming experienceImplementation Experience on Kafka, Kinesis, Spark, AWS Glue, AWS LakeFormation.
Experience of performance optimization in Batch and Real time processing applicationsExpertise in Data Governance and Data Security Implementation .Good hands-on design and programming skills building reusable tools and products.
Experience developing in AWS or similar cloud platforms.Preferred:
, ECS, EKS, S3, EMR, DynamoDB, Aurora, Redshift, QuickSight or similar. Familiarity with systems with very high volume of transactions, micro service design, or data processing pipelines (Spark). Knowledge and hands-on experience with server-less technologies such as Lambda, MSK, MWAA, Kinesis Analytics a plus. Expertise in practices like Agile, Peer reviews, Continuous Integration.
Travel No
-
Data Engineer
1 week ago
Hyderabad, Telangana, India WALLERO TECHNOLOGIES PRIVATE LIMITED Full timeRoles & Responsibilities :- Tech Stack Expertise : Proficiency in Python, Pyspark, and Databricks, utilizing these tools to develop robust data pipelines, perform data transformations, and optimize data workflows within the Supply Chain realm.- Innovative Problem Solving : Demonstrate technical expertise by thinking creatively and providing innovative...
-
Data Engineer
1 week ago
Hyderabad, Telangana, India Risk Resources LLP Full timeJob Description :The Cloud Engineer will focus on Capture data and transforming the data as per business needs. We receive data from multiple internal and external sources which is maintained in Data marts within Data lakeMandatory Skills :- 5 + years of experience on Apachespark, Databricks, Elastic Search, PySpark, Delta Lake, Data Factory, Data Bricks,...
-
Pyspark
1 week ago
Hyderabad, Telangana, India Cognizant Technology Solutions Full timeJob descriptionPySpark Developer / PySpark Data EngineerShould have at least three years of strong experience in PySparkStrong SQL ExpertiseStrong communication and client-facing skillsEmployee Status :Full Time EmployeeShift :Day JobTravel :NoJob Posting :Jun **About Cognizant
-
Pyspark Data Engineer
1 week ago
Hyderabad, Telangana, India Virtusa Full timePyspark Data Engineer - CREQ190586 Description 4 to 6 years of relevant work experience showing growth as a Data Engineer Hands On programming experience Implementation Experience on Kafka, Kinesis, Spark, AWS Glue, AWS LakeFormation. Experience of performance optimization in Batch and Real time processing applications Expertise in Data Governance and Data...
-
Big Data Engineer, Data Modeling
1 week ago
Hyderabad, Telangana, India data Full timeWhat can you tell your friendswhen they ask you what you do?We're looking for an experienced Big Data Engineer who can create innovative new products in the analytics and data space. You will participate in the development that creates the world's #1 mobile app analytics service. Together with the team, you will build out new product features and...
-
Big Data Engineer, Data Modeling
1 week ago
Hyderabad, Telangana, India data Full timeWhat can you tell your friends when they ask you what you do? We're looking for an experienced Big Data Engineer who can create innovative new products in the analytics and data space. You will participate in the development that creates the world's #1 mobile app analytics service. Together with the team, you will build out new product features and...
-
Pyspark Data Engineer
1 week ago
Hyderabad, Telangana, India Virtusa Full timePyspark Data Engineer CREQ187054 Description 6 8 years of relevant work experience showing growth as a Data Engineer.Hands On programming experienceImplementation Experience on Kafka, Kinesis, Spark, AWS Glue, AWS LakeFormation.Experience of performance optimization in Batch and Real time processing applicationsExpertise in Data Governance and Data Security...
-
Big Data Engineer
2 months ago
Hyderabad, Telangana, India RENOIRCE TECHNOLOGIES PRIVATE LIMITED Full timeJob Description :Primary & mandatory : PYSPARKSecondary : GCP- At least 5 years of experience in Big Data, Hadoop Data Platform (HDP) and ETL and capable of configuring data pipelines.- Possess the following technical skills - SQL, Python, Pyspark, Hive, Unix, ETL, Control-M (or similar)- At least 2 years of experience in Cloudera Data Platform (CDP)- Skills...
-
Big Data Engineer
4 weeks ago
Hyderabad, Telangana, India RENOIRCE TECHNOLOGIES PRIVATE LIMITED Full timeJob Description :Primary & mandatory : PYSPARKSecondary : GCP- At least 5 years of experience in Big Data, Hadoop Data Platform (HDP) and ETL and capable of configuring data pipelines.- Possess the following technical skills - SQL, Python, Pyspark, Hive, Unix, ETL, Control-M (or similar)- At least 2 years of experience in Cloudera Data Platform (CDP)- Skills...
-
PySpark/Databricks Engineer
1 week ago
Hyderabad, Telangana, India KPI Partners Full timeWe are looking for a PySpark solutions developer and data engineer that is able to design and build solutions for one of our Fortune 500 Client programs, which aims to build a data standardized and curation-based Hadoop cluster. This high visibility, fast-paced key initiative will integrate data across internal and external sources, provide analytical...
-
Azure Data Engineer with PySpark, Databricks
1 week ago
Hyderabad, Telangana, India Saxon AI Full timeOnly Immediate Joiners Azure Data Engineer Hyderabad, TG Looking for people with strong technical expertise in Microsoft Azure Cloud data platform to join the group of our Modern Data Solutions team. This is a fantastic opportunity to be part of a startup culture whilst being instrumental in the growth of new service offering. Key Responsibilities: ...
-
Data Engineer
1 week ago
Hyderabad, Telangana, India EDGESOFT Full timeJob Description:The perfect candidate needs to have a solid understanding and practical experience in PySpark and various DataBricks components. As a key member of our data team, you will have a vital role in developing, improving, and managing our data infrastructure to ensure smooth and effective data processing.Responsibilities:Design, develop, and...
-
Python Pyspark with AWS
1 week ago
Hyderabad, Telangana, India Virtusa Full timePython Pyspark with AWS - CREQ188741 Description Responsibilities:1.Analyze various data sources present with the client, including structured and unstructured data formatsentities across different data sources to identify relationships and data inconsistencies3.Analyze existing reports created with Tableau and other tools to understand data usage and...
-
Pyspark Lead
1 week ago
Hyderabad, Telangana, India CIEL HR Services Full timeWe are hiring for our client-An International IT service provider Role- Pyspark Lead Mandatory skill set- Python+Spark+Scala(experience in all 3 skill sets should be strong & mandatory) ,Data Engineering+ AWS Exp. Level- 5-12 yrs Location- Bangalore & Hyderabad Notice Period-Immediate to 15days Job Description Design and implement scalable and...
-
Data Engineer
1 week ago
Hyderabad, Telangana, India Nisum Full timeWhat You'll DoAs an experienced data engineer of expertise in data engineering technologies such as PySpark, Python, Scala, Java, SQL, Databricks, RESTful Web Services, and Microservices Architecture, your responsibilities will include:Collaborate with cross-functional teams to develop and implement data solutions.Assist in managing architecture, platforms,...
-
Azure Databricks Data Engineer
1 week ago
Hyderabad, Telangana, India EMentor Enterprises Private Limited Full timeSkills Required: Azure ADFDatabricks with Pyspark PythonData Engineer with Pyspark Databricksskillset 8 yearsof experience Data Engineering with min 5 years hands on experiencein Pyspark for datatransformations.Sound Knowledge on Azure DataBricks Azure DataLake. Soundknowledge in Data Bricks & Logic AppsDelta Lake Azure SQLand Azure blob storage Azure logic...
-
Data Engineer
1 week ago
Hyderabad, Telangana, India Tech Mahindra Full timeTitle: Data EngineerLocation: Hyderabad /Pan IndiaExperience: 7-12yearsNP: Immediate to 15daysCompany Profile:Tech Mahindra represents the connected world, offering innovative and customer-centric information technology experiences. We #Rise together to create sustainable businesses that can bring about lasting change in our communities – to create an...
-
AWS Data Engineer
1 week ago
Hyderabad, Telangana, India ProArch Full timeProArch is seeking an experienced AWS Data Engineer to join our team. As an AWS Data Engineer, you will be responsible for designing, building, and maintaining data solutions on the AWS platform.Job Description:Must to Have Skills : AWS - Data Engineer - PySpark, Glue, S3, Athena To work in the capacity of AWS Cloud developer. Scripting/programming in...
-
AWS Data Engineer
1 week ago
Hyderabad, Telangana, India ProArch Full timeProArch is seeking an experienced AWS Data Engineer to join our team. As an AWS Data Engineer, you will be responsible for designing, building, and maintaining data solutions on the AWS platform.Job Description:Must to Have Skills : AWS Data EngineerPySpark, Glue, S3, AthenaTo work in the capacity of AWS Cloud developer.Scripting/programming in...
-
Data Engineer
1 week ago
Hyderabad, Telangana, India HNM Solutions Full timeNote : Only immediate joiner Role : Pyspark Experience : 8+ years Location : Hyderabad, Chennia Interview mode is Walkin drive Requirements : Mandatory skills : (8+ Years of experience in Data engineering with 5+ Years on Pyspark/NoSQL is Mandatory) Person should be strong in PysparkShould have hands on in MWAA (Airflow) / AWS EMR(Hadoop, Hive)...