Big Data + Pyspark

Responsibilities : Design and develop PySpark applications using Spark DataFrames and SQL to extract, transform, and load (ETL) data. Read data from various sources such as relational databases, data lakes, and cloud storage using PySpark connectors. Clean, transform, and enrich data using PySpark functions for data wrangling and manipulation. Build and...

# Hiring Alert #We are looking for Immediate Joiners Skills:Big Data with GCP GCP; Hive; PySpark; Python GCP Data Engineer with hands-on experience of 3+ years in Big Query, Data Proc, Airflow, Cloud Composer, GCP Hydra Services, Cloud Data Optimization "Join us and become an integral part of our success story. Apply today and let's achieve great things...

Job Description :We are seeking a skilled Big Data GCP Engineer to join our team. The ideal candidate will have substantial experience with Google Cloud Platform (GCP) and a strong background in Big Data technologies. This role involves working with various GCP services and tools to design, develop, and optimize data processing pipelines and workflows.Key...

About ImpetusImpetus Technologies is a digital engineering company focused on delivering expert services and products to help enterprises achieve their transformation goals. We solve the analytics, AI, and cloud puzzle, enabling businesses to drive unmatched innovation and growth.Founded in 1991, we are cloud and data engineering leaders providing solutions...

Job Title:Big Data Engineer Duration: Full-time on OmegaHires Payroll Location: Gurugram (Should be located near NCR to attend office for 3 days a week) Should understand the Credit Card domain and good to have knowledge on Compliance & Operational Risk . Good analytics experience to do data discovery, analyze the gaps in data, partner with Data Owners,...

Location: Gurgaon, Experience: 4- 6 years Description: We are looking for Big Data developers having minimum experience of 4 year in Hadoop Ecosystem, passionate about technology, motivated for continuous learning and an individual who views every client interaction as an opportunity to create an exceptional customer experience. Qualifications: Must have:...

Big Data Engineer - CREQ190572 Description Qualifications Bachelors degree in Engineering or Computer Science or equivalent OR Masters in Computer Applications or equivalent. 6+ years of software development experience and leading teams of engineers and scrum teams 3+ years of hands-on experience of working with Map-Reduce, Hive, Spark (core, SQL and...

Years of experience : 4 to 6 Years Location: gurugram Notice period : Immediate to 30 Days Experience with design and coding across one or more platforms and languages (e.g. , Python/Pyspark/SQL, Scala) as appropriateHands-on expertise with application design, software development Proficient in Big Data technologies Designs, codes, tests, corrects and...

Years of experience : 4 to 6 Years Location: gurugram Notice period : Immediate to 30 Days Experience with design and coding across one or more platforms and languages (e.g. , Python/Pyspark/SQL, Scala) as appropriate Hands-on expertise with application design, software development Proficient in Big Data technologies Designs, codes, tests, corrects and...

Location: Gurgaon,Experience: 4- 6 yearsDescription:We are looking for Big Data developers having minimum experience of 4 year in Hadoop Ecosystem, passionate about technology, motivated for continuous learning and an individual who views every client interaction as an opportunity to create an exceptional customer experience.Qualifications:Must have:...

Position Summary: The Data engineer is responsible for development & maintenance of the Data Lake within Cognizant. You should be able to collaborate with technology cross-commits and business teams to code, test and deploy scalable solution and adhering to required quality standards. You must be a self-starter, think outside the box and enjoy coming up with...

Big Data - Informatica Developer - CREQ188336 Description Must have 6-9 year of experience of create, design, and implement data processing jobs to transform the data.Demonstrate proficiency in writing shell script and SQL queries.Hands on Exp with Oracle and DB2 databases.Must have Big Data tech stack experience Hadoop, Hive, Mapr etc.Good Communication...

Mandatory Skills – Python , Pyspark, DataBricks, SQL Primary Skills:Hands-on Python, PySpark, Databricks, SQL, AWS (S3, Lambda, EC2, RDS), and CI-CD toolsJob description:6 or more years of experience developing, testing, and implementing major Information Technology programs or projects that are broad in scope or multi-unit/cross-divisional 3 or more years...

Experience- 5 to 12 yrs Notice period- 30 days Work Location- Gurgaon Job description 5+ Years of working experience in Bigdata ( Hive and PySpark)3+ Years of experience in Unix shell scripting.Strong SQL Programming skills.Knowledge/ experience on Python is good to have.Excellent communication skills for effective stakeholder management.Strong...

Experience- 5 to 12 yrs Notice period- 30 days Work Location- Gurgaon Job description 5+ Years of working experience in Bigdata ( Hive and PySpark)3+ Years of experience in Unix shell scripting.Strong SQL Programming skills.Knowledge/ experience on Python is good to have.Excellent communication skills for effective stakeholder management.Strong...

Experience- 5 to 12 yrs Notice period- 30 days Work Location- Gurgaon Job description 5+ Years of working experience in Bigdata ( Hive and PySpark)3+ Years of experience in Unix shell scripting.Strong SQL Programming skills.Knowledge/ experience on Python is good to have.Excellent communication skills for effective stakeholder management.Strong...

Our hiring partner is looking for :This is a full-time on-site role for a Big Data Developer at Big Four Consulting Firm Gurugram. The Big Data Developer will be responsible for tasks related to Data Engineering, Extract Transform Load (ETL), Big Data, Data Warehousing, and Software Data Engineering, Big Data, Extract Transform Load (ETL), and Data...

Big Data EngineerPosition Overview :We are seeking a skilled Big Data Engineer to join our dynamic team. The ideal candidate will have expertise in designing, implementing, and maintaining large-scale data processing systems using cutting-edge technologies. As a Big Data Engineer, you will play a key role in building and optimizing data pipelines, data...

Data Engineer Consultant – Job DescriptionJob Summary:Data Engineer (DE) Consultant is responsible for designing, developing, and maintaining data assets and data related products by liaising with multiple stakeholders.Responsibilities:Work with stakeholders to understand the data requirements to design, develop, and maintain complex ETL processes.Create...

Overview:As a Data Engineer, you will work with multiple teams to deliver solutions on the Azure Cloud using corecloud data warehouse tools (Azure Data Factory, Azure Databricks, Azure SQL DW and other Big Datarelated technologies). In addition to building the next generation of application data platforms (notinfrastructure) and/or improving recent...