Python Pyspark

**JOB DESCRIPTION** **Skill: PySpark QA** **Role / Tier: Lead Software Engineer/Tier 2** **Experience: 6 - 9 years** Primary Skills BIG Data technology mentioned below Hadoop / Big Data (HDFS, PYTHON, SPARK-SQL, MapReduce) with PYSpark. build CI/CD pipelines Spark APIs to cleanse, explore, aggregate, transform, store & analyse installing, configuring,...

**Skills**:Python Knowledge with Pyspark, Pandas and Python Objects Knowledge of Google Cloud Platform Google Cloud : GCP cloud storage, Data proc, Big query SQL - Strong SQL & Advanced SQL Spark - writing skills on Pyspark DWH - Data warehousing concepts & dimension modeling GIT Any GCP Certification Roles & Responsibilities: Perform data analytics,...

**Responsibilities**: 1.Analyze various data sources present with the client, including structured and unstructured data formats 2.Map entities across different data sources to identify relationships and data inconsistencies 3.Analyze existing reports created with Tableau and other tools to understand data usage and identify gaps 4.Colloborate with data...

Python Scripting Led Primary Skills Python scripting Data Scikit learn Py Spark Data mining, AI JD Design and build new tools as well as enhancements to existing our surveillance and monitoring tools for the compliance business community Develop solutions using Python, Hadoop, Spark, and HIVE/SQL Work on projects that require deep knowledge of Python and...

Responsibilities -Expertly perform tasks under supervision.Develop and maintain end-to-end data pipelines using cloud-native solutions to extract, load, and transform data from disparate data sources to a cloud data warehouse.Capable of formatting and distributing custom data extracts through various means (e.g., custom SFTPs, APIs (e.g., RESTful), and other...

Role: QA Automation Engineer Data Engineering Team **Job Description**: As a QA Automation Engineer, you will be an integral part of the data engineering team, ensuring the quality and reliability of the lakehouse infrastructure and data pipelines. You will design, develop, and implement automated testing solutions to validate data ingestion,...

Must Have Strong hands-on Experience in AWS Native Services Python, Pyspark Data Engineering(S3, EMR, Glue, Sqoop) Serverless Experience(Lambda, Step Functions) Strong SQL AWS Athena, Cloud Formation Templates, Crawler Strong Data analysis and troubleshooting skill Datamart / Data Warehousing Multi-Dimensional OLAP Star/Snowflake Schema Design **About...

About the Role:We are seeking an experienced Senior ETL Developer with expertise in designing, implementing, and maintaining ETL processes using AWS services, specifically - AWS Glue and EventBridge.Key Responsibilities:• Design and Develop ETL Pipelines: Build scalable, efficient ETL workflows using AWS Glue to extract, transform, and load data from...

**Skill - Azure Data Lead / Arch** **Location - Hyderabad** **Work mode - 5 days office** **Work timings - 12 PM to 9 PM** **JD**: - Must have work experience in Azure Synapse, Python,Pyspark and ADF. - Strong in writing SQL query, stored procedure and functions with hands-on in Power BI. Relevant Experience in Power BI, SSIS and SSRS and SQL Server -...

Must have 7plus years of experience total IT experience in Data engineering DW area Must have 3plus yrs of exposure on AWS ecosystem specifically DataBricks, Redshift Lambda Glue Starbust Minimum 5 yrs of technical expertise with data models data mining and segmentation techniques Expert on programming languages SQL Python Pyspark Must be good at...

Must have 7+ years of total IT experience in Data engineering and 3 years as MLOps engineer. Designing, developing, and implementing robust MLOps pipelines using industry-leading tools like MLflow, Apache Airflow etc. Working Experience with AWS and Databricks. Must have strong Proficiency in Python, Pyspark, SQL, Machine Learning, NLP, Deep Learning,...

P1-C2-TSTS Client is looking for a Lead ETL Developer Lead in our Enterprise Data Warehouse. In this role you will be part of a team working to develop solutions enabling the business to leverage data as an asset at the bank. As a Lead ETL Developer, you will be leading teams to develop, maintain and enhance code ensuring all IT SDLC processes are...

Job Summary : We are seeking an experienced Senior ETL Developer with expertise in designing, implementing, and maintaining ETL processes using AWS services, specifically - AWS Glue- and - EventBridge- . The ideal candidate will play a key role in transforming and integrating complex data systems, ensuring data quality, and optimizing performance across...

Location: Indore, Pune, Noida, Gurugram Experience: 4- 8 years Description: We are looking for Big Data Developer having minimum experience of 4 year in big data ecosystem, passionate about technology, motivated for continuous learning and an individual who views every client interaction as an opportunity to create an exceptional customer...

At least 3 years of experience in architect role are required along with at least 2 3 years experience designing and building analytics solutions in Azure. Demonstrated experience with Data Migration both onpremises and in the cloud using Azure Native Data Migration Service and other ETL technologies. Demonstrated experience delivering multiple data...

**Join our Team**: **About this opportunity**: **What you will do**: - Analyze, coordinate, prioritize, and optimize business requirements, and map them to achievable implementations. - Develop predictive models, recommendation engines, anomaly detection systems, and other forms of statistical modelling and machine learning systems. - Proactively utilize...

Job Title: Cloud Data Engineer Skills: AWS, Snowflake, Python / Pyspark, SQL, ETL, Data Warehousing, Data Modelling & Dimensional Modelling Experience: 4 - 14 years Location: Greater Noida & Bengaluru We at Coforge are hiring Cloud Data Engineers with the following skillset: Qualifications: Proficiency in Data Warehouse Design/ETL Architecture :...

Sr. Software Engineer - AWSExperience: 4 - 12 years of ExperienceWhat should you have?Job Description-Explore and learn the latest Data & Analytics and Databricks Platform features /technologies to provide new capabilities and increase efficiency.Build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and...

Job Title: Cloud Data EngineerSkills: AWS, Snowflake, Python / Pyspark, SQL, ETL, Data Warehousing, Data Modelling & Dimensional ModellingExperience: 4 - 14 yearsLocation: Greater Noida & BengaluruWe at Coforge are hiring Cloud Data Engineers with the following skillset:Qualifications:Proficiency in Data Warehouse Design/ETL Architecture : Extensive...

**Job Title: GCP Architect** **Location: Noida/Bangalore** **Type of Employment: Full Time** **Experience: 12 to 20 Years** **Notice Period: Immediate or Less than 20 Days** **Skill Set**: GCP DATA LAKE **Skill to Evaluate**: GCP-Architecture, GA4-Model, Data-form, Python or Pyspark, BigQuery, Terraform **JOB DESCRIPTION**: - Good understanding of...