Python Pyspark with Aws

**JOB DESCRIPTION** **Skill: PySpark QA** **Role / Tier: Lead Software Engineer/Tier 2** **Experience: 6 - 9 years** Primary Skills BIG Data technology mentioned below Hadoop / Big Data (HDFS, PYTHON, SPARK-SQL, MapReduce) with PYSpark. build CI/CD pipelines Spark APIs to cleanse, explore, aggregate, transform, store & analyse installing, configuring,...

Knowledge of Google Cloud Platform Google Cloud : GCP cloud storage, Data proc, Big query SQL - Strong SQL & Advanced SQL Spark - writing skills on Py spark DWH - Data warehousing concepts & dimension modeling (Good to have) Python GIT Any GCP Certification **About Virtusa** Teamwork, quality of life, professional and personal development: values...

Must have 7plus years of experience total IT experience in Data engineering DW area Must have 3plus yrs of exposure on AWS ecosystem specifically DataBricks, Redshift Lambda Glue Starbust Minimum 5 yrs of technical expertise with data models data mining and segmentation techniques Expert on programming languages SQL Python Pyspark Must be good at...

**Skills**:Python Knowledge with Pyspark, Pandas and Python Objects Knowledge of Google Cloud Platform Google Cloud : GCP cloud storage, Data proc, Big query SQL - Strong SQL & Advanced SQL Spark - writing skills on Pyspark DWH - Data warehousing concepts & dimension modeling GIT Any GCP Certification Roles & Responsibilities: Perform data analytics,...

Job Summary : We are seeking an experienced Senior ETL Developer with expertise in designing, implementing, and maintaining ETL processes using AWS services, specifically - AWS Glue- and - EventBridge- . The ideal candidate will play a key role in transforming and integrating complex data systems, ensuring data quality, and optimizing performance across...

Sr. Software Engineer - AWSExperience: 4 - 12 years of ExperienceWhat should you have?Job Description-Explore and learn the latest Data & Analytics and Databricks Platform features /technologies to provide new capabilities and increase efficiency.Build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and...

5+ years of hands on in JAVA Experience of SA and designs using AWS platform and services design, usage, security, performance, etc. Experience of IAM, S3, Athena, Python or NodeJS, Glue, Lambda, DMS, RDS, Redshift ,Cloud Formation and other AWS serverless resources. IAC using AWS CDK AWS experience solution Architect associate is a big plus with the...

Python Scripting Led Primary Skills Python scripting Data Scikit learn Py Spark Data mining, AI JD Design and build new tools as well as enhancements to existing our surveillance and monitoring tools for the compliance business community Develop solutions using Python, Hadoop, Spark, and HIVE/SQL Work on projects that require deep knowledge of Python and...

At least 5+ years of AWS cloud experience. Must have experience in working and implementing Amazon Connect Agent Workspace for contact centres. Should have knowledge on Natural language processing (NLP) is mandatory. Should be capable of writing Cloud formation templates. Experience developing solutions and passion for getting hands dirty with...

P1-C2-TSTS Design cloud infrastructure/platform/services that is secure, scalable, and highly available on AWS. Build and maintain operational tools for CI/CD, monitoring, and analysis of AWS infrastructure and systems. Proficient in containerization technology and assist in administration and operation of container platform or container services such as...

Job title - Data Engineering LeadExp - 6 to 8 yearsJob Location : Coimbatore / Hyderabad (Work from Office)Do you love building the infrastructure that fuels data-driven decision making? Are you passionate about wrangling raw data into a usable format? If so, then we want to hear from you!We are searching for a Data Engineering Lead to join our growing team....

AWS Tech Lead (Architect) with 10+ years of experience in IT or Business Project role for analysis, development, or testing. Primary skills: 1. Strong AWS Glue, Athena, Ingestion services, Strong experience using Python programming language and Strong SQL experience 2. Act as a SPOC Technical Resource to the development team 3. Analytic Solutions spanning...

Experience : 7-12 years Desirable Skills : • AWS Data & Analytics Specialty Certification • AWS Solution Architect Associate Certification • Databricks Certification Primary Skills : • Masters / Bachelors Degree in Computer Science, Information Technology or other relevant fields. • Minimum 7+ Years of Mandatory experience in Advance Data &...

Responsibilities :- Design, develop, and maintain robust and scalable backend services using Python.- Collaborate with frontend developers to build efficient and user-friendly web applications.- Implement RESTful APIs and microservices architecture.- Optimize database performance and query optimization.- Work closely with DevOps teams to deploy and manage...

Experience : 7-12 yearsDesirable Skills :• AWS Data & Analytics Specialty Certification• AWS Solution Architect Associate Certification• Databricks CertificationPrimary Skills :• Masters / Bachelors Degree in Computer Science, Information Technology or other relevant fields.• Minimum 7+ Years of Mandatory experience in Advance Data & Analytics...

Key Responsibilities: Backend Development: Design, develop, and maintain backend systems using Python, with a focus on either Flask or Django. Frontend Development: Develop user interfaces using Angular or React, ensuring a seamless and responsive user experience. Qualifications: Bachelor's or Master's degree in Computer Science or a related field. 5+...

Job SummaryWe are seeking an experienced Senior ETL Developer to join our team at nfolks Software. The ideal candidate will have expertise in designing, implementing, and maintaining ETL processes using AWS services, specifically AWS Glue and EventBridge.Key ResponsibilitiesDesign and develop scalable, efficient ETL workflows using AWS Glue to extract,...

15 years of Architecting & Developing Experience working in Big Data Technologies using Apache, Hadoop, Spark & SQL etc. 5 years of strong Development/ Coding experience using Spark with Python Minimum 3 Years experience working on Databricks on AWS based Cloud Services 5 years of strong experience in Big Data design, modelling & Development such as star...

Job Summary:We are seeking an experienced Senior ETL Developer to play a key role in our team at nfolks Software. The ideal candidate will have expertise in designing, implementing, and maintaining ETL processes using AWS services, specifically - AWS Glue and EventBridge.Responsibilities:- Design and Develop ETL Pipelines: Build scalable, efficient ETL...

Must have 7+ years of total IT experience in Data engineering and 3 years as MLOps engineer. Designing, developing, and implementing robust MLOps pipelines using industry-leading tools like MLflow, Apache Airflow etc. Working Experience with AWS and Databricks. Must have strong Proficiency in Python, Pyspark, SQL, Machine Learning, NLP, Deep Learning,...