Aws Pyspark

1 week ago


Bengaluru, Karnataka, India Cognizant Full time
Mandatory skills AWS, Python and PySpark, Spark SQL, NoSQL Data Bricks

Experience on AWS and its web service offering S3, Redshift, EC2, EMR, Lambda, CloudWatch, RDS, Step functions, Spark streaming etc.

Good knowledge of Configuring and working on Multi node clusters and distributed data processing framework Spark.
Hands on experience with EMR Apache Spark Hadoop technologies
Experience with must have Linux, Python and PySpark, Spark SQL.
Experience in working with large volumes of data Tera-bytes, analyze the data structures
Experience in designing scalable data pipelines, complex event processing, analytics components using big data technology SparkPythonScalaPySpark,
Expert in SQL, NoSQL database
Experience in process orchestration tools Apache Airflow, Apache NiFi etc.
Hands on knowledge of design, development and enhancement of Data Lakes, constantly evolve with emerging tools and technologies

Employee Status :
Full Time Employee

Shift :
Day Job

Travel :
No

Job Posting :
Jan

**About Cognizant

  • Bengaluru, Karnataka, India NAM Info Inc Full time

    AWS Data Engineer with PySpark Domain: Clinical / pharma/ healthcare Location: Bangalore or Chennai / Kolkata / Hyderabad Preferred Skills: AWS and Python and or PySpark AWS Redshift, Aurora, AWS Glue , AWS Lambda, etc. Extensive experience with Data gathering and ingestion (from multiple sources), and manipulation, orchestration and optimization on...


  • Bengaluru, Karnataka, India NAM Info Inc Full time

    AWS Data Engineer with PySparkDomain: Clinical / pharma/ healthcareLocation: Bangalore or Chennai / Kolkata / Hyderabad Preferred Skills:AWS and Python and or PySparkAWS Redshift, Aurora, AWS Glue, AWS Lambda, etc.Extensive experience with Data gathering and ingestion (from multiple sources), and manipulation, orchestration and optimization on AWS CloudSpark...

  • Python Pyspark Lead

    1 week ago


    Bengaluru, Karnataka, India Virtusa Full time

    Python Pyspark Lead - CREQ187226 Description Design and develop on Hadoop applications,Hands on in developing Jobs in pySpark with Python/ SCALA (Preferred) or Java/ SCALAExperience on Core Java, Experience on Map Reduce programs, Hive programming, Hive queries performance conceptsExperience on source code management with Git repositoriesSecondary...

  • AWS Data Engineer

    1 week ago


    Bengaluru, Karnataka, India Global Pharma Tek Full time

    SkillsInformatica, AWS Glue + dbt, pySpark, Python shell and SQL, GitHub Actions, Terraform, S + Amazon Redshift, IdP + IAM, IdP +LakeFormation, AWS Native services – AWSCloudWatch and ApacheAirflow, AWS Eventbridge

  • AWS Data Engineer

    1 week ago


    Bengaluru, Karnataka, India Xcelyst Full time

    AWS Data EngineerExperience: 5-8 YearsLocation: Bangalore, PuneNotice Period : Immediate Joiner - 30 daysExp - 4+ Yrs in Data Engineering4+ Yrs in AWS ServicesSkills - Hands on exp in Glue is mandatory.Exposure to Lambda,Redshift,RDS,S3+ Python/Scala/Pyspark + SQL. Experience in solution designing.Job Description : Strong AWS development experience for data...

  • AWS Data Engineer

    1 week ago


    Bengaluru, Karnataka, India Change leaders Full time

    Job Description : AWS Glue + Python PysparkJob Overview : Candidate should be responsible for the configuration, administration, and optimization of the AWS Glue + Python Pyspark platform. This role involves ensuring the smooth operation of AWS Glue + Python Pyspark for data integration, transformation, and loading tasks in alignment with the organization's...


  • Bengaluru, Karnataka, India Edstem Technologies Full time

    We are seeking a talented and experienced PySpark Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data engineering, a passion for big data technologies, and the ability to work in a fast-paced, collaborative environment.Willing to work inLocation: Trivandrum, Bengaluru, ChennaiKey Responsibilities:Data Pipeline...

  • AWS Architect

    1 week ago


    Bengaluru, Karnataka, India Freelancer Recruiter Full time

    Over 10-14 years of IT experience Deep expertise in S3, Redshift, Spectrum, Glue, SQS, and SNS services. Very good Data lake concepts and at least 1 end to end project of data lake using AWS Deep understanding of architecture and work experience on Databricks, handson programming with Data Frames, Python, Scala. Experience with large data sets, data...

  • Aws/talend

    1 week ago


    Bengaluru, Karnataka, India Nityo Infotech Full time

    AWS/Talend: Key responsibilities: Owning Assignments for Dev/Maintenance tasks for AWS, Managing scheduling with Talend,AutomateNow,Airflow scheduler. Should have Hands on Experience of Development on Cloudera Platform. Developing Unix Shell scripts Handling Nifi ingestions Good understating of Technologies such as Spark,Kafka. Should able to analyze the...


  • Bengaluru, Karnataka, India Global Pharma Tek Full time

    ob DescriptionTechnical skills. Having ETL development experience with overall to years in AWS , Big data engineering related application Minimum end to end ETL project implementation Proficient in PySpark, Python. Proficient in Big Data technologies - Hadoop, Spark, Hive, Databricks. Expert in AWS to develop, deploy and maintain ETL applications using...


  • Bengaluru, Karnataka, India Global Pharma Tek Full time

    ob Description Technical skills . Having ETL development experience with overall to years in AWS , Big data engineering related application Minimum end to end ETL project implementation Proficient in PySpark, Python. Proficient in Big Data technologies - Hadoop, Spark, Hive, Databricks. Expert in AWS to develop, deploy and maintain ETL applications...

  • Aws Glue

    1 week ago


    Bengaluru, Karnataka, India Cognizant Full time

    3. Work Experience :6-11 yearsWork location : Off ShoreMust Have Skills : AWS, Glue, DMS, Data integrations and Data OpsJob Requirements:Key Responsibilities : 5 years of work experience with ETL, Data Modelling,and Data Architecture Proficient in ETL optimization, designing, coding, andtuning big data processes using Pyspark Extensive experience to build...


  • Bengaluru, Karnataka, India Mresult Services Private Limited Full time

    What are we looking for Proven experience in implementing and delivering data solutions and pipelines on AWS. Cloud Platform by using services AWS Glue, Lambda, Redshift. Strong SQL, Python & Pyspark knowledge. Hands-on experience in AWS, Databricks, Snowflake Snowflake Integration experience is must. Familiar with Snowflake architecture warehouse...


  • Bengaluru, Karnataka, India Bosch Full time

    Job DescriptionMandatory RequirementOverall 8+ years of experience in IT3+ year experience working on Data Engineering using Databricks, Redshift, Glue, EMR.Atleast 4 Project experience in Building and maintaining ETL / ELT pipelines for large data sets , complex data and feature engineering processesMust Have skills : AWS Glue, Databricks (DB), AWS...

  • Pyspark QA

    1 week ago


    Bengaluru, Karnataka, India Virtusa Full time

    JobDescription: Experience with BIG Data technology mentioned below Hadoop Big Data HDFS,PYTHON,SPARK SQL MapReduce with PYSpark.Experience - 4 to 7 YearsHands on experience in build CI CD pipelines is required Outstanding coding, debugging and analytical skills,Core problem solving skills and data migration from different databases.Good knowledge at using...

  • AWS Glue developer

    1 week ago


    Bengaluru, Karnataka, India Gainwell Technologies LLC Full time

    SummaryAs a​AWS Glue developerat Gainwell, you can contribute your skills as we harness the power of technology to help our clients improve the health and well-being of the members they serve — a community's most vulnerable. Connect your passion with purpose, teaming with people who thrive on finding innovative solutions to some of healthcare's biggest...


  • Bengaluru, Karnataka, India Global Pharma Tek Full time

    REQ. - REFNAWS Data Engg SpecialistNo Industrial Layout Hosur Road Koramangala, Bengaluru, inFull-timeLegal Entity: Bosch Global Software Technologies Private LimitedCompany DescriptionBosch Global Software Technologies Private Limitedis a % owned subsidiary of Robert Bosch GmbH, one of the world's leading global supplier of technology and services, offering...

  • Aws De

    1 week ago


    Bengaluru, Karnataka, India Virtusa Full time

    Must Have Strong hands-on Experience inAWS Native ServicesPython, PysparkData EngineeringS3 EMR Glue SqoopServerless Experience(Lambda, Step FunctionsStrong SQLAWS Athena, Cloud Formation Templates, CrawlerStrong Data analysis and troubleshooting skillDatamart Data WarehousingMultiDimensional OLAPStarSnowflake Schema DesignAbout VirtusaTeamwork, quality of...

  • AWS Data engineer

    1 week ago


    Bengaluru, Karnataka, India Anicalls (Pty) Ltd Full time

    Candidate should have:Clear, concise communication abilities - writing, verbal, presentation - to all levels of technical and non-technical audiences with the ability to collaborateStrong experience in CICD technologies including Python, SQL, Airflow, and Git in a cloud settingUnderstanding of ELK stack is a plus for logging and reporting purposesExperience...

  • AWS Glue developer

    1 week ago


    Bengaluru, Karnataka, India Gainwell Technologies LLC Full time

    Summary As a ​AWS Glue developer at Gainwell, you can contribute your skills as we harness the power of technology to help our clients improve the health and well-being of the members they serve — a community's most vulnerable. Connect your passion with purpose, teaming with people who thrive on finding innovative solutions to some of healthcare's...