Aws Pyspark
2 weeks ago
Mandatory skills AWS, Python and PySpark, Spark SQL, NoSQL Data Bricks
Experience on AWS and its web service offering S3, Redshift, EC2, EMR, Lambda, CloudWatch, RDS, Step functions, Spark streaming etc.
Good knowledge of Configuring and working on Multi node clusters and distributed data processing framework Spark.
Hands on experience with EMR Apache Spark Hadoop technologies
Experience with must have Linux, Python and PySpark, Spark SQL.
Experience in working with large volumes of data Tera-bytes, analyze the data structures
Experience in designing scalable data pipelines, complex event processing, analytics components using big data technology SparkPythonScalaPySpark,
Expert in SQL, NoSQL database
Experience in process orchestration tools Apache Airflow, Apache NiFi etc.
Hands on knowledge of design, development and enhancement of Data Lakes, constantly evolve with emerging tools and technologies
**Employee Status **:Full Time Employee
**Shift **:Day Job
**Travel **:No
**Job Posting **:Jan 19 2023
**About Cognizant
-
Python,pyspark with Aws
7 hours ago
Bengaluru, India Natobotics Technologies Private Limited Full time**INFOSYS IS HIRING PYTHON,PYSPARK WITH AWS FOR BANGALORE & MUMBAI** Exp : 5+ Yrs Role : Python,Pyspark With AWS Location : Bangalore & Mumbai Payroll : Natobotics Client : Infosys Below is JD. Skill Set (any 1 as primary pls mention) 1. Python 2. PySpark 3. AWS 4. SQL 5. Snowflake, 6. DevOps JD details 1. Design and develop data integration...
-
Software Developer Python Pyspark AWS Devops
2 months ago
Bengaluru, India EMPASYS INFO SOLUTIONS PVT LTD Full timeJob Role: SoftwareDeveloper (Python Pyspark AWSDevops)Experience: 5 YearsMandatory Skills: Python Pyspark AWSDevopsLocation: Pune Work mode: HybridBudget: 16 LPA Education:GraduateTechnologySkills: Strongknowledge of Python/Pyspark and Bash scriptingExperience working with Data frames PandasScipy Numpy libraries is a plus Strong handsonworking knowledge in...
-
Python, Pyspark
2 months ago
Bengaluru, India Ziniosedge Full timePython, Pyspark 5 Technology Lead (Data Engineer) BE - 8+ years of industry experience as Lead Developer - Experience in implementing ETL and ELT data pipelines with PySpark - Spark Structured API, SPARK SQL & Spark Performance tuning are highly preferred. - Experience in building data pipelines on data lake or Lakehouse(AWS Databricks) & handling...
-
Python/pyspark
1 week ago
Bengaluru, India Cognizant Technology Solutions Full time**Python/Pyspark Engineer** **Job Location: Bangalore/Willing to relocate to Bangalore** **Exp: 4 to 12 years** **Introduction**: We work with customers who need to improve their capacity to respond on computerized world and empower adaptability, evacuate execution boundaries, empower advancement, and modernize center frameworks and rethink their business...
-
Data Streaming
6 days ago
Bengaluru, India ACE Talent Consulting Full timeJob Description: Spark/Scala/PySpark developer who knows how to fully exploit the potential of our Spark cluster. Should have ability to clean, transform, and analyze vast amounts of raw data from various systems using Spark to provide ready-to-use data. **Responsibilities**: Create Scala/Spark/Pyspark jobs for data transformation and aggregation Produce...
-
Data Streaming
6 days ago
Bengaluru, India ACE Talent Consulting Full timeob Description: Spark/Scala/PySpark developer who knows how to fully exploit the potential of our Spark cluster. Should have ability to clean, transform, and analyze vast amounts of raw data from various systems using Spark to provide ready-to-use data. **Responsibilities**: Create Scala/Spark/Pyspark jobs for data transformation and aggregation Produce...
-
Software Engineer III
3 weeks ago
Bengaluru, India JPMorgan Chase & Co. Full timeWe have an exciting and rewarding opportunity for you to take your software engineering career to the next level. As a Software Engineer III at JPMorgan Chase within the Consumer and Community Banking- JP Wealth Management, you serve as a seasoned member of an agile team to design and deliver trusted market-leading technology products in a secure,...
-
Senior Cloud Data Engineer
2 months ago
Bengaluru, India Changeleaders Full timeJob Overview:- Candidate should be responsible for the configuration, administration, and optimization of the AWS Glue + Python Pyspark platform.- This role involves ensuring the smooth operation of AWS Glue + Python Pyspark for data integration, transformation, and loading tasks in alignment with the organization's data requirements.Location: India...
-
Weekday - (Bigdata,pyspark, Python, Aws)
2 months ago
Bengaluru, India Black & White Business Solutions Full time**Job Information**: Industry **IT Services** *** Province **Karnataka** *** City **Bangalore** *** Postal Code **560040** *** Country **India** - 5+ years of experience working with cloud or on-prem Big Data/MPP analytics platform (i.e. AWS Glue/EMR, Google BigQuery, Azure Data Warehouse, Databricks, Snowflake, Hortonworks/Cloudera Clusters) - 3+...
-
Pyspark, Python, SQL
2 days ago
Bengaluru, Karnataka, India Black & White Business Solutions Full time**Job Information**: Industry **IT Services*** Province **Karnataka*** City **Bangalore North*** Postal Code **560001*** Country **India*** Apache Pyspark, python, sql JD: Key Skills/Experience: SQL, Python and Pyspark are required with AWS Cloud exposure preferable - Working experience and strong knowledge in Databricks.Knowledge in Cloud...
-
Aws Glue + Pyspark + Python(Rarr Job 3485)
7 days ago
Bengaluru, India RARR Technologies Full timeFor LTIMINDTREE - 5 - 12 Years- Full Time- HYDERABAD, BANGALORE/BENGALURU, MUMBAI, PUNE, CHENNAI**Job Skills**: PYTHON PYSPARK GLUE AWS - Experience on data migration from On-Prem databases to AWS Cloud on S3, Glue - Understands where to obtain information needed to make the appropriate decisions - Demonstrates ability to break down a problem to...
-
Data Engineer
2 months ago
Bengaluru, India HNM Solutions Full timeNote : Only immediate joinerRole : PysparkExperience : 8+ yearsLocation : Hyderabad, ChenniaInterview mode is Walkin driveRequirements :Mandatory skills : (8+ Years of experience in Data engineering with 5+ Years on Pyspark/NoSQL is Mandatory)1. Person should be strong in Pyspark2. Should have hands on in MWAA (Airflow) / AWS EMR(Hadoop, Hive) framework3....
-
Data Engineer
2 weeks ago
Bengaluru, India HNM Solutions Full timeNote : Only immediate joinerRole : PysparkExperience : 8+ yearsLocation : Hyderabad, ChenniaInterview mode is Walkin driveRequirements :Mandatory skills : (8+ Years of experience in Data engineering with 5+ Years on Pyspark/NoSQL is Mandatory)1. Person should be strong in Pyspark2. Should have hands on in MWAA (Airflow) / AWS EMR(Hadoop, Hive) framework3....
-
Software Engineer III
2 months ago
Bengaluru, India JPMorgan Chase & Co. Full timeWe have an exciting and rewarding opportunity for you to take your software engineering career to the next level.As a Software Engineer III at JPMorgan Chase within the Consumer and Community Banking- JP Wealth Management, you serve as a seasoned member of an agile team to design and deliver trusted market-leading technology products in a secure, stable, and...
-
Software Engineer III
6 days ago
Bengaluru, India JPMorgan Chase & Co. Full timeWe have an exciting and rewarding opportunity for you to take your software engineering career to the next level.As a Software Engineer III at JPMorgan Chase within the Consumer and Community Banking- JP Wealth Management, you serve as a seasoned member of an agile team to design and deliver trusted market-leading technology products in a secure, stable, and...
-
AWS Data Engineer
1 month ago
Bengaluru, India Global Pharma Tek Full timeSkills Informatica, AWS Glue + dbt, pySpark, Python shell and SQL, GitHub Actions, Terraform, S + Amazon Redshift, IdP + IAM, IdP + LakeFormation, AWS Native services – AWS CloudWatch and Apache Airflow, AWS Eventbridge
-
AWS Data Engineer
4 weeks ago
Bengaluru, India Global Pharma Tek Full timeSkillsInformatica, AWS Glue + dbt, pySpark, Python shell and SQL, GitHub Actions, Terraform, S + Amazon Redshift, IdP + IAM, IdP +LakeFormation, AWS Native services – AWSCloudWatch and ApacheAirflow, AWS Eventbridge
-
Data Engineer
4 weeks ago
Bengaluru, India WIZSTAFFING PRIVATE LIMITED Full timeJob Description :We at Captain Fresh, are building smart supply chain to deliver the highest quality seafood and meat for the Indian consumer.Our innovations in process management and workforce orchestration along with strong industry credentials are enabling us to deliver the fastest harvest-to-fork in the industry. Our endeavor is to leverage experience...
-
Senior AWS Data Engineer
2 months ago
Bengaluru, India USEFULBI CORPORATION Full timeExperience Required :- Minimum 7+ years Experience in Data Engineering.- Must have good knowledge and experience in Python.- Mush have good Knowledge of Pyspark.- Mush have good Knowledge of Databricks.- Must have good experience in AWS (Glue, Athena, Redshift, EMR)- Typically requires relevant analysis work and domain-area work experience.- Expert in the...
-
Senior Python Developer
2 months ago
Bengaluru, India Spruce IT Pvt. Ltd. Full timeJob Role: Sr Python Developer. Skills: PySpark / Flink / Apache Spark / Scala. Experience: 6+ years. Location: Pan India. JD: - Sr Python Developer.- Must have Hands on experience- in python.- Develop pipeline objects using PySpark / Flink / Apache Spark / Scala. - Candidates preferred who have experience in building real-time data streams using Flink and...