Python Pyspark

AIA-Pune **Job Summary** Data Engineer 4 to 9 Years **Responsibilities** Data Engineering design experience (to support with HLD review LLD build out etc.) Azure experience confident in working with Azure Cloud and Data Engineering capabilities ( e.g. ADLS Gen2 Synapse ADF etc.) Advanced SQL experience query writing & optimisation data aggregation...

**Skills - AWS +Pyspark** **Experience: 4 to 9 years** **Location: AIA-Pune** **As an AWS Data Engineer, you will design, build, and manage robust data pipelines on the AWS cloud platform. You will leverage your expertise in AWS data services and programming languages to ingest, process, transform, and store data efficiently, enabling data-driven insights...

7+ years of experience in Big Data with strong expertise in Spark and Scala Mandatory Skills: Big Data Primarily Spark and Scala Strong Knowledge in HDFS, Hive, Impala with knowledge on Unix, Oracle, Autosys, Good to Have : Agile Methodology and Banking Expertise Strong Communication Skills Not limited to Spark batch, need Spark streaming experience No SQL...

Job Description Key Responsibilities: - Design, develop, and maintain ETL pipelines using Python, PySpark, and SQL on distributed data platforms. - Write clean, efficient, and scalable PySpark code for big data transformation and processing. - Develop reusable scripts and tools for data ingestion, cleansing, validation, and aggregation. - Work with...

**Responsibilities**: - Consult with users, clients, and other technology groups on issues, and recommend programming solutions, install, and support customer exposure systems - Serve as advisor or coach to new or lower level analysts - Identify problems, analyze information, and make evaluative judgements to recommend and implement solutions - Has the...

We are looking for a skilled professional with expertise in Pyspark, Python, and SQL to join our team. The ideal candidate should have 6-9 years of experience.Roles and ResponsibilityDesign, develop, and implement data processing pipelines using Pyspark.Collaborate with cross-functional teams to identify and prioritize project requirements.Develop and...

Job SummaryAs a Sr. Developer you will play a pivotal role in optimizing and enhancing our data processing capabilities using PySpark and AWS technologies. Your expertise in Python and domain knowledge in Cards & Payments will drive impactful solutions. This hybrid role offers the flexibility of day shifts ensuring a balanced work-life...

Dear Applicants,Greeting from TCS!I hope your day is going well!At Tata Consultancy Services, were looking for someone like you for an Associate Consultant position. This opportunity aligns nicely with your experience in creating immersive technologies and innovative solutions.TCS has urgent requirements for "Python Pyspark"Education: Minimum 15 years of...

**Job Summary** **Responsibilities** - Develop and maintain scalable data pipelines using Python and PySpark. - Optimize and manage Databricks SQL queries to ensure efficient data retrieval. - Implement and manage Databricks Delta Lake for data storage and processing. - Design and execute Databricks Workflows to automate data processing tasks. - Collaborate...

Build up data pipelines for consumption by the data science team.Clear understanding and experience with Python and PySpark.Experience in writing Python programs and SQL queries.Experience in SQL Query tuning.Build and maintain data pipelines in Pyspark with SQL and Python.Knowledge of Cloud (Azure/AWS) technologies is additional. Suggest and implement best...