Aws Pyspark
1 week ago
Experience on AWS and its web service offering S3, Redshift, EC2, EMR, Lambda, CloudWatch, RDS, Step functions, Spark streaming etc.
Good knowledge of Configuring and working on Multi node clusters and distributed data processing framework Spark.Hands on experience with EMR Apache Spark Hadoop technologies
Experience with must have Linux, Python and PySpark, Spark SQL.
Experience in working with large volumes of data Tera-bytes, analyze the data structures
Experience in designing scalable data pipelines, complex event processing, analytics components using big data technology SparkPythonScalaPySpark,
Expert in SQL, NoSQL database
Experience in process orchestration tools Apache Airflow, Apache NiFi etc.
Hands on knowledge of design, development and enhancement of Data Lakes, constantly evolve with emerging tools and technologies
Employee Status :
Full Time Employee
Shift :
Day Job
Travel :
No
Job Posting :
Jan
**About Cognizant
-
AWS Data Engineer with PySpark
1 week ago
Bengaluru, Karnataka, India NAM Info Inc Full timeAWS Data Engineer with PySpark Domain: Clinical / pharma/ healthcare Location: Bangalore or Chennai / Kolkata / Hyderabad Preferred Skills: AWS and Python and or PySpark AWS Redshift, Aurora, AWS Glue , AWS Lambda, etc. Extensive experience with Data gathering and ingestion (from multiple sources), and manipulation, orchestration and optimization on...
-
AWS Data Engineer with PySpark
1 week ago
Bengaluru, Karnataka, India NAM Info Inc Full timeAWS Data Engineer with PySparkDomain: Clinical / pharma/ healthcareLocation: Bangalore or Chennai / Kolkata / Hyderabad Preferred Skills:AWS and Python and or PySparkAWS Redshift, Aurora, AWS Glue, AWS Lambda, etc.Extensive experience with Data gathering and ingestion (from multiple sources), and manipulation, orchestration and optimization on AWS CloudSpark...
-
Python Pyspark Lead
1 week ago
Bengaluru, Karnataka, India Virtusa Full timePython Pyspark Lead - CREQ187226 Description Design and develop on Hadoop applications,Hands on in developing Jobs in pySpark with Python/ SCALA (Preferred) or Java/ SCALAExperience on Core Java, Experience on Map Reduce programs, Hive programming, Hive queries performance conceptsExperience on source code management with Git repositoriesSecondary...
-
AWS Data Engineer
1 week ago
Bengaluru, Karnataka, India Global Pharma Tek Full timeSkillsInformatica, AWS Glue + dbt, pySpark, Python shell and SQL, GitHub Actions, Terraform, S + Amazon Redshift, IdP + IAM, IdP +LakeFormation, AWS Native services – AWSCloudWatch and ApacheAirflow, AWS Eventbridge
-
AWS Data Engineer
1 week ago
Bengaluru, Karnataka, India Xcelyst Full timeAWS Data EngineerExperience: 5-8 YearsLocation: Bangalore, PuneNotice Period : Immediate Joiner - 30 daysExp - 4+ Yrs in Data Engineering4+ Yrs in AWS ServicesSkills - Hands on exp in Glue is mandatory.Exposure to Lambda,Redshift,RDS,S3+ Python/Scala/Pyspark + SQL. Experience in solution designing.Job Description : Strong AWS development experience for data...
-
AWS Data Engineer
1 week ago
Bengaluru, Karnataka, India Change leaders Full timeJob Description : AWS Glue + Python PysparkJob Overview : Candidate should be responsible for the configuration, administration, and optimization of the AWS Glue + Python Pyspark platform. This role involves ensuring the smooth operation of AWS Glue + Python Pyspark for data integration, transformation, and loading tasks in alignment with the organization's...
-
PySpark Data Engineer
1 week ago
Bengaluru, Karnataka, India Edstem Technologies Full timeWe are seeking a talented and experienced PySpark Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data engineering, a passion for big data technologies, and the ability to work in a fast-paced, collaborative environment.Willing to work inLocation: Trivandrum, Bengaluru, ChennaiKey Responsibilities:Data Pipeline...
-
AWS Architect
1 week ago
Bengaluru, Karnataka, India Freelancer Recruiter Full timeOver 10-14 years of IT experience Deep expertise in S3, Redshift, Spectrum, Glue, SQS, and SNS services. Very good Data lake concepts and at least 1 end to end project of data lake using AWS Deep understanding of architecture and work experience on Databricks, handson programming with Data Frames, Python, Scala. Experience with large data sets, data...
-
Aws/talend
1 week ago
Bengaluru, Karnataka, India Nityo Infotech Full timeAWS/Talend: Key responsibilities: Owning Assignments for Dev/Maintenance tasks for AWS, Managing scheduling with Talend,AutomateNow,Airflow scheduler. Should have Hands on Experience of Development on Cloudera Platform. Developing Unix Shell scripts Handling Nifi ingestions Good understating of Technologies such as Spark,Kafka. Should able to analyze the...
-
Aws big data engineer
1 week ago
Bengaluru, Karnataka, India Global Pharma Tek Full timeob DescriptionTechnical skills. Having ETL development experience with overall to years in AWS , Big data engineering related application Minimum end to end ETL project implementation Proficient in PySpark, Python. Proficient in Big Data technologies - Hadoop, Spark, Hive, Databricks. Expert in AWS to develop, deploy and maintain ETL applications using...
-
Aws big data engineer
1 week ago
Bengaluru, Karnataka, India Global Pharma Tek Full timeob Description Technical skills . Having ETL development experience with overall to years in AWS , Big data engineering related application Minimum end to end ETL project implementation Proficient in PySpark, Python. Proficient in Big Data technologies - Hadoop, Spark, Hive, Databricks. Expert in AWS to develop, deploy and maintain ETL applications...
-
Aws Glue
1 week ago
Bengaluru, Karnataka, India Cognizant Full time3. Work Experience :6-11 yearsWork location : Off ShoreMust Have Skills : AWS, Glue, DMS, Data integrations and Data OpsJob Requirements:Key Responsibilities : 5 years of work experience with ETL, Data Modelling,and Data Architecture Proficient in ETL optimization, designing, coding, andtuning big data processes using Pyspark Extensive experience to build...
-
Bengaluru, Karnataka, India Mresult Services Private Limited Full timeWhat are we looking for Proven experience in implementing and delivering data solutions and pipelines on AWS. Cloud Platform by using services AWS Glue, Lambda, Redshift. Strong SQL, Python & Pyspark knowledge. Hands-on experience in AWS, Databricks, Snowflake Snowflake Integration experience is must. Familiar with Snowflake architecture warehouse...
-
AWS Data Engg Specialist
1 week ago
Bengaluru, Karnataka, India Bosch Full timeJob DescriptionMandatory RequirementOverall 8+ years of experience in IT3+ year experience working on Data Engineering using Databricks, Redshift, Glue, EMR.Atleast 4 Project experience in Building and maintaining ETL / ELT pipelines for large data sets , complex data and feature engineering processesMust Have skills : AWS Glue, Databricks (DB), AWS...
-
Pyspark QA
1 week ago
Bengaluru, Karnataka, India Virtusa Full timeJobDescription: Experience with BIG Data technology mentioned below Hadoop Big Data HDFS,PYTHON,SPARK SQL MapReduce with PYSpark.Experience - 4 to 7 YearsHands on experience in build CI CD pipelines is required Outstanding coding, debugging and analytical skills,Core problem solving skills and data migration from different databases.Good knowledge at using...
-
AWS Glue developer
1 week ago
Bengaluru, Karnataka, India Gainwell Technologies LLC Full timeSummaryAs aAWS Glue developerat Gainwell, you can contribute your skills as we harness the power of technology to help our clients improve the health and well-being of the members they serve — a community's most vulnerable. Connect your passion with purpose, teaming with people who thrive on finding innovative solutions to some of healthcare's biggest...
-
AWS Data Engg Specialist
1 week ago
Bengaluru, Karnataka, India Global Pharma Tek Full timeREQ. - REFNAWS Data Engg SpecialistNo Industrial Layout Hosur Road Koramangala, Bengaluru, inFull-timeLegal Entity: Bosch Global Software Technologies Private LimitedCompany DescriptionBosch Global Software Technologies Private Limitedis a % owned subsidiary of Robert Bosch GmbH, one of the world's leading global supplier of technology and services, offering...
-
Aws De
1 week ago
Bengaluru, Karnataka, India Virtusa Full timeMust Have Strong hands-on Experience inAWS Native ServicesPython, PysparkData EngineeringS3 EMR Glue SqoopServerless Experience(Lambda, Step FunctionsStrong SQLAWS Athena, Cloud Formation Templates, CrawlerStrong Data analysis and troubleshooting skillDatamart Data WarehousingMultiDimensional OLAPStarSnowflake Schema DesignAbout VirtusaTeamwork, quality of...
-
AWS Data engineer
1 week ago
Bengaluru, Karnataka, India Anicalls (Pty) Ltd Full timeCandidate should have:Clear, concise communication abilities - writing, verbal, presentation - to all levels of technical and non-technical audiences with the ability to collaborateStrong experience in CICD technologies including Python, SQL, Airflow, and Git in a cloud settingUnderstanding of ELK stack is a plus for logging and reporting purposesExperience...
-
AWS Glue developer
1 week ago
Bengaluru, Karnataka, India Gainwell Technologies LLC Full timeSummary As a AWS Glue developer at Gainwell, you can contribute your skills as we harness the power of technology to help our clients improve the health and well-being of the members they serve — a community's most vulnerable. Connect your passion with purpose, teaming with people who thrive on finding innovative solutions to some of healthcare's...