Python Pyspark

Responsibilities Design, develop, and deploy scalable data processing applications using Python and PySpark. Collaborate with data scientists and analysts to understand requirements and translate them into technical solutions. Write efficient and optimized code to process and analyze large volumes of data. Implement data ingestion processes from various data...

Overview:The role of a Pyspark developer is crucial in our organization as they are responsible for developing and maintaining efficient scalable data processing applications using Pyspark.Key Responsibilities:Experience working in big data platforms for implementing projects with high SLA of data availability and data quality exposure to Azure cloud...

Overall Eight plus years of experience with min of five plus years experience in required technical skills Required technical skills: Python, PySpark, SQL AWS Cloud experience and Healthcare domain knowledge is desired **About Virtusa** Teamwork, quality of life, professional and personal development: values that Virtusa is proud to embody. When you join...

PySpark Developer Strong experience in technical leadership, mentoring MDM team of size approx. 10. Work experience 6+ years with skillset in Python (Pandas/ NumPy), PySpark Developer. Hands-on experience in generating/parsing XML, JSON documents, and REST API request/responses Hands-on experience writing complex SQL queries, exporting and importing large...

Job Title : Data EngineerExperience : 3-8 YearsLocation : Chennai / BangaloreJob Type : Full-timeRequire Skills : Data Engineer, AWS, Airflow, PySpark, Hadoop, Big data, Glue, Athena, Lambda, PythonJob Description :We are seeking a highly skilled and experienced Data Engineer with 3 to 8 years of experience.- Strong experience with AWS services: Glue,...

Data engineer 1) Overall 8+ years in IT Experience with relevant 5+ years of experience in Data Engineering. Required technical skills: Python, PySpark, SQL, AWS 2) Required Domain: Healthcare Insurance 4) Extensive data analysis skills and Good communication skills 5) Experience working in Agile **About Virtusa** Teamwork, quality of life,...

Data engineer 1) Overall 7+ in IT Experience with relevant 5+ years of experience in Data Engineering. Required technical skills: Python, PySpark, SQL, AWS 2) Required Domain: Healthcare Insurance 4) Extensive data analysis skills and Good communication skills 5) Experience working in Agile **About Virtusa** Teamwork, quality of life, professional and...

Job Description :Roles and Responsibilities :We are seeking an experienced Data Engineer to join our team. The ideal candidate will have 5 to 8 years of experience in data engineering and a strong background in building data pipelines, data warehousing, and data management solutions. In this role, you will work closely with data scientists, analysts, and...

Job Description :- Strong knowledge of UNIX systems and shell scripting.- Proficiency in SQL for database management and manipulation.- Hands-on experience with SPARK for big data processing.Methodologies : - Understanding and application of Agile practices.Communication : - Excellent verbal and written communication skills, with the ability to collaborate...

Job Title: Data Engineer (Python, Pyspark, OLAP, Pandas, Scala, Databricks)Experience: 2-5 yearsLocation: ChennaiJob Summary: We are looking for a talented Data Engineer to join our growing team. In this role, you will design, implement, and optimize data pipelines and architectures to facilitate efficient data processing and analysis. You will collaborate...

Job Title: Data Engineer (Python, Pyspark, OLAP, Pandas, Scala, Databricks)Experience: 2-5 yearsLocation: ChennaiJob Summary: We are looking for a talented Data Engineer to join our growing team. In this role, you will design, implement, and optimize data pipelines and architectures to facilitate efficient data processing and analysis. You will collaborate...

Job Title: Data Engineer (Python, Pyspark, OLAP, Pandas, Scala, Databricks) Experience: 2-5 years Location: Chennai Job Summary: We are looking for a talented Data Engineer to join our growing team. In this role, you will design, implement, and optimize data pipelines and architectures to facilitate efficient data processing and analysis. You will...

Skill Set : Pyspark / Scala Spark, Python, Azure Databricks and Azure Data FactoryRoles And Responsibilities:- Should have programming skills with the ability to write optimized and reusable high-quality code.- Design, develop and maintain scalable data pipelines using Pyspark / Scala Spark, Databricks, Python, SQL.- Optimize SQL queries for efficient data...

Pyspark Dev & QA Mandatory Skills BIG Data technology mentioned below Hadoop / Big Data (HDFS, PYTHON, SPARK-SQL, MapReduce) with PySpark Build CI/CD pipelines is required Outstanding coding, debugging and analytical skills Spark APIs to cleanse, explore, aggregate, transform, store & analyse available data Knowledge of installing, configuring, debugging...

Responsibilities :- Design, build, and operationalize large-scale enterprise data solutions and applications using one or more AWS data and analytics services - Glue, RedShift, Lambda, S3 Table Partition mechanism, Types of Partitions, column store index.- Maintenance and optimization of existing processes.- Requirement gathering and feasibility analysis,...

SRM Technologies is a global IT services provider offering Cloud and Infrastructure, Digital Transformation, Data and AI, Application Lifecycle, Technology Consulting, Quality Assurance, eCommerce and Product Engineering services. The key industries that benefit from our offerings include Automotive, Manufacturing and Consumer Goods. We offer our customers...

Role : Data EngineerLocation : Chennai (Candidate will work from Client office)Experience : 7 years( Relevant - 4.5 year Mandatory)NOTE : Only immediate joinersCandidate current location should be Chennai only....Description : We are seeking a Data Engineer who will build and maintain data pipelines across business areas such as subscriptions, video,...

Skill: Bigdata with Python & Pyspark Yrs of experience: 5+ yrs Notice: preferable immediate **Job Types**: Full-time, Temporary Contract length: 6 months Pay: ₹60,000.00 - ₹82,000.00 per month Schedule: - Monday to Friday **Experience**: - Big data: 5 years (required) - python: 5 years (required) - pyspark: 5 years (required) Work Location: In...

Primary Skills:Technical:Hands on experience in creating PySpark jobs for data transformation and aggregation in Financial Market domain.Experience in querying and processing from column oriented databases using python.Strong understanding of Hadoop architecture and design best practices.Thorough understanding of fundamental software engineering and computer...

Primary Skills:Technical:Hands on experience in creating PySpark jobs for data transformation and aggregation in Financial Market domain.Experience in querying and processing from column oriented databases using python.Strong understanding of Hadoop architecture and design best practices.Thorough understanding of fundamental software engineering and computer...