PySpark Developer

Key Responsibilities : - Design and develop scalable PySpark pipelines to ingest, parse, and process XML datasets with extreme hierarchical complexity. - Implement efficient XPath expressions, recursive parsing techniques, and custom schema definitions to extract data from nested XML structures. - Optimize Spark jobs through partitioning, caching, and...

About AJ Consulting:AJ Consulting is a leading consulting firm that specializes in big data solutions. We are committed to delivering high-quality services to our clients and providing a collaborative and dynamic work environment for our employees.Job Description:The Lead PySpark Engineer will be responsible for leading our team in designing and implementing...

Key Responsibilities : - Model Development : Lead the development of advanced models using AWS services such as EMR, Glue, and Glue Notebooks. - Cloud Infrastructure : Design, build, and optimize scalable cloud infrastructure solutions with a minimum of 5 years of experience. - ETL Pipeline Development : Create, manage, and optimize ETL pipelines using...

Qualification : - 5-7 years of good hands on exposure with Big Data technologies - pySpark (Data frame and SparkSQL), Hadoop, and Hive - Good hands on experience of python and Bash Scripts - Good understanding of SQL and data warehouse concepts - Strong analytical, problem-solving, data analysis and research skills - Demonstrable ability to think outside of...

About the Role : We are seeking a highly skilled and motivated Python/PySpark Data Engineer to join our growing data engineering team. In this role, you will play a crucial part in building and maintaining robust and efficient data pipelines that power our data-driven decision making. You will work closely with data engineers, analysts, and other...

Job Description : - 7-10 years of good hands on exposure with Big Data technologies - PySpark (Data frame and SparkSQL), Hadoop, and Hive. - Good hands on experience of python, Bash Scripts. - Good understanding of SQL and data warehouse concepts - Strong analytical, problem-solving, data analysis and research skills - Demonstrable ability to think outside...

Job Description :- 7-10 years of good hands on exposure with Big Data technologies - PySpark (Data frame and SparkSQL), Hadoop, and Hive. - Good hands on experience of python, Bash Scripts. - Good understanding of SQL and data warehouse concepts - Strong analytical, problem-solving, data analysis and research skills - Demonstrable ability to think outside of...

We are seeking a highly skilled Senior Big Data Engineer with extensive experience in Big Data technologies, including Hadoop, Hive, PySpark, and expertise in Google Cloud Platform (GCP) and BigQuery. The successful candidate will be responsible for designing, building, and maintaining robust data pipelines that support large-scale data processing and...

We are seeking a highly skilled Senior Big Data Engineer with extensive experience in Big Data technologies, including Hadoop, Hive, PySpark, and expertise in Google Cloud Platform (GCP) and BigQuery. The successful candidate will be responsible for designing, building, and maintaining robust data pipelines that support large-scale data processing and...

Job Title: Python AWS DeveloperYears of Experience: 5+ YrsPrimary Skills: Python, AWS Development, PySpark, Lambdas, Cloud Watch (Alerts), SNS, SQS, Cloud formation.Roles & Requirements:• More than 5 years of working knowledge in Python.More than 3 years of hands-on experience with AWS Development, PySpark, Lambdas, Cloud Watch (Alerts), SNS, SQS, and...

Job Title: Python AWS Developer Years of Experience: 5+ Years Primary Skills: Python, AWS Development, PySpark, Lambdas, Cloud Watch (Alerts), SNS, SQS, Cloud formation. Roles & Requirements: Mastery in Python with over 5 years of working knowledge and expertise. Proven experience in AWS Development with a minimum of 3 years, focusing on PySpark,...

Job Description Developer 8 Yrs in Design and dveloping ETL Pipelines using on AWS EMR / SAS SQL Logic into Python coding using frame work such as Pyspark. We are seeking an experienced Python Developer with a strong background in designing and developing ETL (Extract, Transform, Load) pipelines on AWS EMR. The ideal candidate will be proficient in...

Must have : Python/PySpark, SQL/PL/SQL & Summary : Looking for a senior developer who has hands-on experience with Databricks/Pyspark, Java, and Webservices. Position is long-term and will likely be renewed Job Functions : - Understands the full picture and helps operations with monitoring, dashboards, etc. - Work with architect on design - Constantly keeps...

Data Engineer Position OverviewWe are looking for an experienced Data Engineer to join our team. The ideal candidate will have expertise in OpenShift, Python, Scala, PySpark, and REST APIs, with hands-on experience in Oracle database management, API development, and cloud-based deployments.Main Responsibilities:Design and develop data pipelines using...

Job RequirementsWe are seeking an experienced Big Data Pipeline Developer to join our team. The ideal candidate will have 5+ years of hands-on experience with Azure Databricks and big data processing frameworks. Strong expertise in PySpark, Spark SQL, and distributed data processing is required. Good understanding of Azure Data Lake Storage (ADLS Gen2),...

About the jobWe are seeking a skilled Python Developer to join our product development team. The successful candidate will focus on automating data ingestion, processing, and validation workflows using PySpark, ensuring robust, scalable, and efficient data pipelines. You will work closely with data engineers, analysts, and stakeholders to deliver impactful...

Cortrex Consultants LLC is seeking a skilled SQL to Databricks Migration Specialist to join our team.Key Responsibilities and QualificationsThe ideal candidate should have a strong background in SQL, Databricks, and Crystal Reports, along with excellent problem-solving skills and attention to detail.Analyzing existing Crystal Reports, including reviewing SQL...

**Job Title**:Python/PySpark Developer We are seeking a highly skilled and motivated Python/PySpark Developer to join our growing team. In this role, you will be responsible for designing, developing, and maintaining high-performance data processing pipelines using Python and the PySpark framework. You will work closely with data engineers, data scientists,...

About the RoleMWIDM Staffing Services is seeking a talented Data Engineer to join our team. As a Data Engineer, you will play a critical role in designing, developing, and maintaining our data infrastructure.The ideal candidate will have a strong background in data engineering, with experience in designing and implementing data pipelines using PySpark. You...

Company OverviewTredence is a leader in the analytics services and solutions space, known for its innovative approach to building scalable big data solutions. We pride ourselves on attracting the greatest talent in the data analytics and data science space.Job DescriptionWe are seeking an experienced data scientist who can develop modern data warehouse...