Sr Etl Qa Pyspark

Responsible for designing, developing, and maintaining ETL processes to support data integration and business intelligence initiatives. Need to closely work with stakeholders to understand data requirements and ensure efficient data flow and transformation using ETL tools and PySpark Develop and implement ETL processes using with one of ETL tool and PySpark...

**Skills - Pyspark** **Experience: 6 to 9 years** **Location: AIA-Pune** **Responsibilities** - Develop and maintain scalable data pipelines using Python and PySpark. - Collaborate with data engineers and data scientists to understand and fulfil data processing needs. - Write clean, efficient, and well-documented code following best practices. -...

Looking for a offshore Techlead with databricks engineer experience and lead the team from offshore. Develop and maintain a metadata driven generic ETL framework for automating ETL code Design, build, and optimize ETL/ELT pipelines using Databricks (PySpark/SQL) on AWS. Ingest data from a variety of structured and unstructured sources (APIs, RDBMS, flat...

Description :Location Pune & NagpurExperience 5-7 YearsEmployment Type Full-Time Job Summary :We are seeking an experienced Data Engineer with strong hands-on expertise in Databricks on any cloud platform (AWS, Azure, or GCP), along with proven skills in SQL, Python, and PySpark. The ideal candidate will have a solid background in database design, data...

You bring systems design experience with the ability to architect and explain complex systems interactions, data flows, common interfaces and APIs.You bring a deep understanding of and experience with software development and programming languages such as Java/Kotlin, and Shell scripting.You have hands-on experience with the following technologies as a...

About the Role :We are seeking a highly skilled Software Development Engineer in Test (SDET) with strong expertise in Python and PySpark. The ideal candidate should have hands-on experience in designing, developing, and testing robust systems, with a focus on Automation Framework Development (Backend) and ETL workflows. You will work closely with...

Company Description :MarsDevs is a remote-first, offshore digital product development company, committed to delivering high-quality code and long-lasting technical architectures.We specialize in building MVPs, mobile and web applications, and SaaS products for startups and SMBs.Our services include systematic project analysis, UI/UX design, technical...

Position OverviewWe are seeking a skilled and experienced Senior PySpark Developer with expertise in Apache spark, Spark Batch, and Spark Streaming to join our dynamic team. The ideal candidate will design, develop, and maintain high-performance, scalable applications for processing large-scale data in batch and real-time environments.Required Skills and...

Title/Position: Datahub QA (Python) Job Location: Pune Employment Type: Full Time Shift Time: UK Shift Job Overview: **Responsibilities**: - Develop and execute test plans, test cases, and automation scripts for ETL pipelines and data validation. - Perform SQL-based data validation to ensure data integrity, consistency, and correctness. - Work closely with...

Pyspark DeveloperRequirements:Mandatory: Primary skill: Pyspark, Data Engineering, Azure Data BricksGood Experience of Hadoop, Hive, and Cloudera/ Azure/GCP 3+ years of experience in the design and implementation of Big Data systems using PySpark, database migration, transformation and integration solutions for any Data warehousing project.Must have...