PySpark Developer

Develop and implement data pipelines for ingesting and collecting data from various sources into a centralized data platform.Develop and maintain ETL jobs using AWS Glue services to process and transform data at scale.Optimize and troubleshoot AWS Glue jobs for performance and reliability.Utilize Python and PySpark to efficiently handle large volumes of data...

Experience Required: 4-5 yrsLocation:GurgaonImmediate Joiners onlyJOB DESCRIPTION:Skillset:Should have strong experience in big data technologies.Basic skills in data pipeline – experience in building data pipelines for data migrationBig Data – Pyspark, SparkStrong command on SQL & HiveProgramming Language: Any - Java/Python/Scala

Develop and implement data pipelines for ingesting and collecting data from various sources into a centralized data platformDevelop and maintain ETL jobs using AWS Glue services to process and transform data at scaleOptimize and troubleshoot AWS Glue jobs for performance and reliabilityUtilize Python and PySpark to efficiently handle large volumes of data...

Role and Responsibilities:Develop and implement a comprehensive quality assurance strategy for data engineering projects, ensuring data quality standards are consistently met.Collaborate with cross-functional teams to define test plans and strategies for validating data pipelines, ETL processes, and transformations using PySpark, Databricks, and SQL.Design...

Position: SAP Business Warehouse DeveloperResponsibilities Develop and maintain SAP BW solutions in BW4/HANA and/or BW On HANA. Extract data from S/4 systems, SLT, or via CDS views and ODP. Collaborate with cross-functional teams to design, develop, and optimize data models. Implement Native HANA development and modeling best practices. Troubleshoot and...

Job DescriptionAs a Big Data Engineer, you will be responsible for designing, developing, and maintaining our big data infrastructure. You will work with large datasets, perform data processing, and support various business functions by creating data pipelines, data processing jobs, and data integration solutions. You will be working in a dynamic and...

Position: SAP Business Warehouse DeveloperResponsibilitiesDevelop and maintain SAP BW solutions in BW4/HANA and/or BW On HANA.Extract data from S/4 systems, SLT, or via CDS views and ODP.Collaborate with cross-functional teams to design, develop, and optimize data models.Implement Native HANA development and modeling best practices.Troubleshoot and resolve...

Job DescriptionWe are seeking a highly skilled and motivated Sr. Data Quality Analyst to join our dynamic team. The ideal candidate will be an independent contributor with a passion for understanding business acumen and the ability to manage multiple projects simultaneously. This role requires a deep understanding of data quality principles and expertise in...

Responsibilities:Work with stakeholders to understand the data requirements to design, develop, and maintain complex ETL processes.Create the data integration and data diagram documentation.Lead the data validation, UAT and regression test for new data asset creation.Create and maintain data models, including schema design and optimization.Create and manage...

Job SummaryThe primary purpose of this role is to translate business requirements and functional specifications into logical program designs and to deliver modules, stable application systems, and Data or Platform solutions. This includes developing, configuring, or modifying integrated business and/or enterprise infrastructure or application solutions...

About Quantzig:Quantzig is a global analytics and advisory firm with offices in the US, UK, Canada, China, and India. we have assisted our clients across the globe with end-to-end advanced analytics, visual storyboarding , Machine Learning and data engineering solutions implementation for prudent decision making. We are a rapidly growing organization that is...

About Quantzig:Quantzig is a global analytics & advisory firm with offices in the US, UK, Canada, and India. we have assisted our clients across the globe with end-to-end advanced analytics, visual storyboarding, machine Learning and data engineering solutions implementation for prudent decision making. We are a rapidly growing organization that is built and...

We are seeking a skilled Mid level Google Cloud Platform Engineer to join our team. The ideal candidate will have a strong background in GCP services, data processing, and UI development.Key Responsibilities:Utilize Google Cloud Composer to orchestrate and monitor data pipelines.Leverage BigQuery for data warehousing and SQL-like querying.Use Dataproc to...

We are seeking a skilled Mid levelGoogle Cloud Platform Engineerto join our team. The ideal candidate will have a strong background in GCP services, data processing, and UI development.Key Responsibilities:UtilizeGoogle Cloud Composerto orchestrate and monitor data pipelines.LeverageBigQueryfor data warehousing and SQL-like querying.UseDataprocto process...

Birlasoft Urgent Hiring for AWS Solution ArchitectBangaloreJob locations : BangaloreExperience Required 12 Years – 15 yearsNotice Period * Immediate/15 days.Roles/ responsibilities on the below lineLook for ETL/DW architects/leads with ~12 15 years' experience, who have programming knowledge with AWS-Glue, Lambda, Python/Pyspark.Solution and design data...

Mandatory Skills Description: Working proficiency in using Python/Scala, Spark (tuning jobs), SQL, Hadoop platforms to build Big Data products & platforms. Good programming skills in Java, spring Boot, and Junit. Knowledge in software development test approaches & and frameworks Familiarity with RESTful APIs and microservices architectures Experience in...

Birlasoft - Urgent Hiring for AWS Solution Architect - BangaloreJob locations : BangaloreExperience Required- 12 Years – 15 yearsNotice Period- * Immediate/15 days.Roles/ responsibilities on the below line-Look for ETL/DW architects/leads with ~12-15 years' experience, who have programming knowledge withAWS-Glue, Lambda, Python/Pyspark.Solution and design...

ABOUT US :Bristlecone is the leading provider of AI-powered application transformation services for the connected supply chain. We empower our customers with speed, visibility, automation, and resiliency – to thrive on change.Our transformative solutions in Digital Logistics, Cognitive Manufacturing, Autonomous Planning, Smart Procurement and...

We are seeking a talented and experienced Py Spark Data Engineer to join our dynamic team.The ideal candidate will have a strong background in data engineering, a passion for big data technologies, and the ability to work in a fast-paced, collaborative environment.Key Responsibilities:Data Pipeline Development: Design, develop, and maintain scalable data...

SrSoftware Engineer - AzureExperience:7 years of ExperienceWhat you should have?Azure Data Factory, Azure DevOps CI/CD, Azure Data Lake, Azure Synapse, Azure Databricks, PySpark, GitHub.Need 4+ Years of experience Good analytical skills with excellent knowledge of SQL.Well versed with Azure ServicesMust have experience and knowledge on ADF, ADLS, Blob...