Pyspark Data Engineer

Develop and implement data pipelines for ingesting and collecting data from various sources into a centralized data platform.Develop and maintain ETL jobs using AWS Glue services to process and transform data at scale.Optimize and troubleshoot AWS Glue jobs for performance and reliability.Utilize Python and PySpark to efficiently handle large volumes of data...

Develop and implement data pipelines for ingesting and collecting data from various sources into a centralized data platformDevelop and maintain ETL jobs using AWS Glue services to process and transform data at scaleOptimize and troubleshoot AWS Glue jobs for performance and reliabilityUtilize Python and PySpark to efficiently handle large volumes of data...

Job DescriptionJob Description:We are looking for Data Engineers to join our team. You will use various methods to transform raw data into useful data systems. For example, you'll create algorithms and conduct statistical analysis. Overall, you'll strive for efficiency by aligning data systems with business goals. Tosucceed in this position, you should have...

Job Description: We are looking for Data Engineers to join our team. You will use various methods to transform raw data into useful data systems. For example, youll create algorithms and conduct statistical analysis. Overall, youll strive for efficiency by aligning data systems with business goals. To succeed in this position, you should have strong...

Job Description: We are looking for Data Engineers to join our team. You will use various methods to transform raw data into useful data systems. For example, youll create algorithms and conduct statistical analysis. Overall, youll strive for efficiency by aligning data systems with business goals. To succeed in this position, you should have strong...

Job Title: Operations AnalystLocation : RemoteCompany Overview:Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary to...

Job Title: Operations AnalystLocation : RemoteCompany Overview:Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary to...

Job Description: We are looking for Data Engineers to join our team. You will use various methods to transform raw data into useful data systems. For example, you'll create algorithms and conduct statistical analysis. Overall, you'll strive for efficiency by aligning data systems with business goals. Tosucceed in this position, you should have strong...

Job DescriptionThe role requires data ingestion, processing and extraction of data to & from Hadoop Cluster onlyusing Informatica BDM. It requires extensive experience in ETL, SQL, Scoop, Spark, Hive, Hadoop &KAFKA. Knowledge of PySpark will be preferableJob Title Data EngineerExperienceMinimum 4-5 years of Experience in Development inInformatica Big Data...

LTIMindtree is proud to be an equal opportunity employer. We are committed to equal employment opportunity regardless of race, ethnicity, nationality, gender, gender-identity, gender expression, language, age, sexual orientation, religion, marital status, veteran status, socio-economic status, disability or any other characteristic protected by applicable...

About Quantzig:Quantzig is a global analytics and advisory firm with offices in the US, UK, Canada, China, and India. we have assisted our clients across the globe with end-to-end advanced analytics, visual storyboarding , Machine Learning and data engineering solutions implementation for prudent decision making. We are a rapidly growing organization that is...

Responsibilities:Work with stakeholders to understand the data requirements to design, develop, and maintain complex ETL processes.Create the data integration and data diagram documentation.Lead the data validation, UAT and regression test for new data asset creation.Create and maintain data models, including schema design and optimization.Create and manage...

Work Location – All EXL Locations (Hybrid)Experience - 5+ YearsMust have Skills:Minimum 4Y+ on Azure cloud services.Proficiency in using Azure Synapse, Azure Storage, and Azure Data Factory for building data solutions.Strong understanding of metadata-driven approaches and data governance principles.Excellent problem-solving skills and ability to work in a...

As a Data engineer , you will be a part of a highly qualified team, leading the delivery of modern data platforms using Azure Services and Databricks.Designing and delivering software using an agile and iterative approach based on Scrum or KanbanFollowing and contributing to improvement of client's software engineering practices e.g., source code management,...

Lead Data EngineerLocation: Remote - Gurgaon (Office visit - once in a while - as and when required)Experience: 6+ yearsAre you passionate about leveraging data to drive business decisions? Do you thrive in a collaborative environment where your expertise in data engineering can make a significant impact? If so, we're looking for you to join our team as a...

About Quantzig:Quantzig is a global analytics & advisory firm with offices in the US, UK, Canada, and India. we have assisted our clients across the globe with end-to-end advanced analytics, visual storyboarding, machine Learning and data engineering solutions implementation for prudent decision making. We are a rapidly growing organization that is built and...

Job Title : Big Data EngineerLocation : RemoteAbout Us :We are a leading specializing in software development . Our team is dedicated to leveraging cutting-edge technologies to deliver scalable and efficient solutions to our clients globally.Role Overview :We are seeking a highly skilled Big Data Engineer with a strong background in designing and developing...

As a Senior Data Engineer, you will collect, aggregate, store, and reconcile data in support of apparel (GBS) business decisions. You will design and build data pipelines, data streams, data service APIs, data generators, and other end-user information portals and insight tools.Job Responsibility:Plan, build, and implement data solutions based on Data...

Data Engineer Company Name: Office Location: Delhi (Work from Office) Job Type: Full-time Experience: 4+ Years Job Description: We are looking for Data Engineers to join our team. You will use various methods to transform raw data into useful data systems. For example, you'll create algorithms and conduct statistical analysis. Overall, you'll strive for...

Good Knowledge on Hive and Pyspark Need to create tables using HIVE and optimize the tables using different methodologies. Need to build data pipeline and ETL process using PySpark code.Primary Skills Should have good knowledge of PySpark, Spark,Hive and SQLSecondary Skills Ready for work form office Flexible to work in any shift