Aws Pyspark

2 weeks ago


Bengaluru, India Cognizant Full time

Mandatory skills AWS, Python and PySpark, Spark SQL, NoSQL Data Bricks
Experience on AWS and its web service offering S3, Redshift, EC2, EMR, Lambda, CloudWatch, RDS, Step functions, Spark streaming etc.
Good knowledge of Configuring and working on Multi node clusters and distributed data processing framework Spark.
Hands on experience with EMR Apache Spark Hadoop technologies
Experience with must have Linux, Python and PySpark, Spark SQL.
Experience in working with large volumes of data Tera-bytes, analyze the data structures
Experience in designing scalable data pipelines, complex event processing, analytics components using big data technology SparkPythonScalaPySpark,
Expert in SQL, NoSQL database
Experience in process orchestration tools Apache Airflow, Apache NiFi etc.
Hands on knowledge of design, development and enhancement of Data Lakes, constantly evolve with emerging tools and technologies

**Employee Status **:Full Time Employee

**Shift **:Day Job

**Travel **:No

**Job Posting **:Jan 19 2023

**About Cognizant



  • Bengaluru, India Natobotics Technologies Private Limited Full time

    **INFOSYS IS HIRING PYTHON,PYSPARK WITH AWS FOR BANGALORE & MUMBAI** Exp : 5+ Yrs Role : Python,Pyspark With AWS Location : Bangalore & Mumbai Payroll : Natobotics Client : Infosys Below is JD. Skill Set (any 1 as primary pls mention) 1. Python 2. PySpark 3. AWS 4. SQL 5. Snowflake, 6. DevOps JD details 1. Design and develop data integration...


  • Bengaluru, India EMPASYS INFO SOLUTIONS PVT LTD Full time

    Job Role: SoftwareDeveloper (Python Pyspark AWSDevops)Experience: 5 YearsMandatory Skills: Python Pyspark AWSDevopsLocation: Pune Work mode: HybridBudget: 16 LPA Education:GraduateTechnologySkills: Strongknowledge of Python/Pyspark and Bash scriptingExperience working with Data frames PandasScipy Numpy libraries is a plus Strong handsonworking knowledge in...

  • Python, Pyspark

    2 months ago


    Bengaluru, India Ziniosedge Full time

    Python, Pyspark 5 Technology Lead (Data Engineer) BE - 8+ years of industry experience as Lead Developer - Experience in implementing ETL and ELT data pipelines with PySpark - Spark Structured API, SPARK SQL & Spark Performance tuning are highly preferred. - Experience in building data pipelines on data lake or Lakehouse(AWS Databricks) & handling...

  • Python/pyspark

    1 week ago


    Bengaluru, India Cognizant Technology Solutions Full time

    **Python/Pyspark Engineer** **Job Location: Bangalore/Willing to relocate to Bangalore** **Exp: 4 to 12 years** **Introduction**: We work with customers who need to improve their capacity to respond on computerized world and empower adaptability, evacuate execution boundaries, empower advancement, and modernize center frameworks and rethink their business...

  • Data Streaming

    6 days ago


    Bengaluru, India ACE Talent Consulting Full time

    Job Description: Spark/Scala/PySpark developer who knows how to fully exploit the potential of our Spark cluster. Should have ability to clean, transform, and analyze vast amounts of raw data from various systems using Spark to provide ready-to-use data. **Responsibilities**: Create Scala/Spark/Pyspark jobs for data transformation and aggregation Produce...

  • Data Streaming

    6 days ago


    Bengaluru, India ACE Talent Consulting Full time

    ob Description: Spark/Scala/PySpark developer who knows how to fully exploit the potential of our Spark cluster. Should have ability to clean, transform, and analyze vast amounts of raw data from various systems using Spark to provide ready-to-use data. **Responsibilities**: Create Scala/Spark/Pyspark jobs for data transformation and aggregation Produce...

  • Software Engineer III

    3 weeks ago


    Bengaluru, India JPMorgan Chase & Co. Full time

    We have an exciting and rewarding opportunity for you to take your software engineering career to the next level.  As a Software Engineer III at JPMorgan Chase within the Consumer and Community Banking- JP Wealth Management, you serve as a seasoned member of an agile team to design and deliver trusted market-leading technology products in a secure,...


  • Bengaluru, India Changeleaders Full time

    Job Overview:- Candidate should be responsible for the configuration, administration, and optimization of the AWS Glue + Python Pyspark platform.- This role involves ensuring the smooth operation of AWS Glue + Python Pyspark for data integration, transformation, and loading tasks in alignment with the organization's data requirements.Location: India...


  • Bengaluru, India Black & White Business Solutions Full time

    **Job Information**: Industry **IT Services** *** Province **Karnataka** *** City **Bangalore** *** Postal Code **560040** *** Country **India** - 5+ years of experience working with cloud or on-prem Big Data/MPP analytics platform (i.e. AWS Glue/EMR, Google BigQuery, Azure Data Warehouse, Databricks, Snowflake, Hortonworks/Cloudera Clusters) - 3+...


  • Bengaluru, Karnataka, India Black & White Business Solutions Full time

    **Job Information**: Industry **IT Services*** Province **Karnataka*** City **Bangalore North*** Postal Code **560001*** Country **India*** Apache Pyspark, python, sql JD: Key Skills/Experience: SQL, Python and Pyspark are required with AWS Cloud exposure preferable - Working experience and strong knowledge in Databricks.Knowledge in Cloud...


  • Bengaluru, India RARR Technologies Full time

    For LTIMINDTREE - 5 - 12 Years- Full Time- HYDERABAD, BANGALORE/BENGALURU, MUMBAI, PUNE, CHENNAI**Job Skills**: PYTHON PYSPARK GLUE AWS - Experience on data migration from On-Prem databases to AWS Cloud on S3, Glue - Understands where to obtain information needed to make the appropriate decisions - Demonstrates ability to break down a problem to...

  • Data Engineer

    2 months ago


    Bengaluru, India HNM Solutions Full time

    Note : Only immediate joinerRole : PysparkExperience : 8+ yearsLocation : Hyderabad, ChenniaInterview mode is Walkin driveRequirements :Mandatory skills : (8+ Years of experience in Data engineering with 5+ Years on Pyspark/NoSQL is Mandatory)1. Person should be strong in Pyspark2. Should have hands on in MWAA (Airflow) / AWS EMR(Hadoop, Hive) framework3....

  • Data Engineer

    2 weeks ago


    Bengaluru, India HNM Solutions Full time

    Note : Only immediate joinerRole : PysparkExperience : 8+ yearsLocation : Hyderabad, ChenniaInterview mode is Walkin driveRequirements :Mandatory skills : (8+ Years of experience in Data engineering with 5+ Years on Pyspark/NoSQL is Mandatory)1. Person should be strong in Pyspark2. Should have hands on in MWAA (Airflow) / AWS EMR(Hadoop, Hive) framework3....

  • Software Engineer III

    2 months ago


    Bengaluru, India JPMorgan Chase & Co. Full time

    We have an exciting and rewarding opportunity for you to take your software engineering career to the next level.As a Software Engineer III at JPMorgan Chase within the Consumer and Community Banking- JP Wealth Management, you serve as a seasoned member of an agile team to design and deliver trusted market-leading technology products in a secure, stable, and...


  • Bengaluru, India JPMorgan Chase & Co. Full time

    We have an exciting and rewarding opportunity for you to take your software engineering career to the next level.As a Software Engineer III at JPMorgan Chase within the Consumer and Community Banking- JP Wealth Management, you serve as a seasoned member of an agile team to design and deliver trusted market-leading technology products in a secure, stable, and...

  • AWS Data Engineer

    1 month ago


    Bengaluru, India Global Pharma Tek Full time

    Skills Informatica, AWS Glue + dbt, pySpark, Python shell and SQL, GitHub Actions, Terraform, S + Amazon Redshift, IdP + IAM, IdP + LakeFormation, AWS Native services – AWS CloudWatch and Apache Airflow, AWS Eventbridge

  • AWS Data Engineer

    4 weeks ago


    Bengaluru, India Global Pharma Tek Full time

    SkillsInformatica, AWS Glue + dbt, pySpark, Python shell and SQL, GitHub Actions, Terraform, S + Amazon Redshift, IdP + IAM, IdP +LakeFormation, AWS Native services – AWSCloudWatch and ApacheAirflow, AWS Eventbridge

  • Data Engineer

    4 weeks ago


    Bengaluru, India WIZSTAFFING PRIVATE LIMITED Full time

    Job Description :We at Captain Fresh, are building smart supply chain to deliver the highest quality seafood and meat for the Indian consumer.Our innovations in process management and workforce orchestration along with strong industry credentials are enabling us to deliver the fastest harvest-to-fork in the industry. Our endeavor is to leverage experience...


  • Bengaluru, India USEFULBI CORPORATION Full time

    Experience Required :- Minimum 7+ years Experience in Data Engineering.- Must have good knowledge and experience in Python.- Mush have good Knowledge of Pyspark.- Mush have good Knowledge of Databricks.- Must have good experience in AWS (Glue, Athena, Redshift, EMR)- Typically requires relevant analysis work and domain-area work experience.- Expert in the...


  • Bengaluru, India Spruce IT Pvt. Ltd. Full time

    Job Role: Sr Python Developer. Skills: PySpark / Flink / Apache Spark / Scala. Experience: 6+ years. Location: Pan India. JD: - Sr Python Developer.- Must have Hands on experience- in python.- Develop pipeline objects using PySpark / Flink / Apache Spark / Scala. - Candidates preferred who have experience in building real-time data streams using Flink and...