Spark Engineer

Design, develop, and maintain data processing pipelines using Apache Spark and Scala.Optimize Spark jobs for performance, scalability, and reliability.Work closely with data engineers and data scientists to implement data-driven solutions.Develop and maintain ETL processes to ingest, transform, and load large volumes of data.Perform data analysis and...

Wissen Technology is now hiringJava + Spark We are seeking a skilled Java Developer with a strong background in Spark to develop and optimize data processing applications. The ideal candidate will be responsible for building robust and scalable data processing solutions, leveraging both Java and Spark. Experience–5-12years Location:Bangalore ...

About Us "Quess IT Staffing is India's largest IT staffing company with over 20 years of experience in staffing IT professionals in 300+ companies across levels and skillsets. Our 10,000+ associates deployed in 80+ cities and towns are proficient in over 500 technological skills. Our associates help enable cutting edge solutions some of the biggest names...

About Us "Quess IT Staffing is India's largest IT staffing company with over 20 years of experience in staffing IT professionals in 300+ companies across levels and skillsets. Our 10,000+ associates deployed in 80+ cities and towns are proficient in over 500 technological skills. Our associates help enable cutting edge solutions some of the biggest names...

Wissen Technology is now hiringPython+Spark+cloudWe are seeking a skilled Python Developer with a strong background in Spark and Cloud technologies. The ideal candidate will be responsible for developing, maintaining, and optimizing scalable data processing pipelines and integrating them with cloud-based...

Job Details - Spark+ Scala+ SQL:Job ID: RARR Job 2943Job Title: Spark+ Scala+ SQLJob Type: PermanentJob Location: BENGALURU / BANGALORE, CHENNAI, HYDERABAD, MUMBAI, PUNETotal Experience:YearsSkills: SCALA, SPARKPosted 01/02/2023Job Description:JD Details: Should have at least 6 to 12 years of experience in developing end to end ETL and Data Engineering...

Job Description :Experience working with distributed technology tools for- developing Batch and Streaming- pipelines using SQL, Spark, Python, PySpark (4+ years), Airflow (3+ years), Scala (2+ years). Experience in Cloud platform, e.g., AWS, GCP, Azure, etc. Experience with creating/ configuring Jenkins pipeline for smooth CI/CD process for Managed Spark...

We are hiring senior data engineers for the leaders in analytics and cloud applications, headquartered in San Francisco and with offices in India (Bangalore and Chennai).Our client provides strategic guidance and technology systems for clients wishing to solve their most complex and interesting business challenges involving cloud applications, big data,...

Spark Pyspark Python Data Engineer - Bangalore/ Chennai/ Puneat Capco IndiaJob Title: Data Engineer with Spark and ScalaAbout Us"Capco, a Wipro company, is a global technology and management consulting firm. Awarded withConsultancy of the year in the British Bank Awardand has been rankedTop Best Companies for Women in India by. With our presence across 32...

Tech Lead- Python, Spark/Scala, Kafka and Cloud storage on Azure Cloud platformRoleSr.Data EngineerYears of Experience5-7 YrsPreferred LocationHYD 2Shift Timing (IST)11:00 AM - 08:30 PMShort DescriptionDevelop batch and real-time streaming data pipelines using Python, Spark/Scala, Kafka and Cloud storage on the Azure Cloud platform, as well as implement and...

Spark Pyspark Python Data Engineer - Bangalore/ Chennai/ Puneat Capco IndiaJob Title: Data Engineer with Spark and ScalaAbout Us"Capco, a Wipro company, is a global technology and management consulting firm. Awarded withConsultancy of the year in the British Bank Awardand has been rankedTop Best Companies for Women in India by. With our presence across 32...

Job Description : Must have : 5- 10 years of meaningful experience in data engineering working on building ETL pipelines, big data tech like spark Very good expertise in algorithms and data structures Excellent in at least one programming language - Python, Go, R Hands-on expertise big data technologies such as Apache Spark, Hadoop, message...

About Us: Quess IT Staffing is the biggest IT staffing company in India, with more than 20 years of experience placing IT professionals in 300+ companies across various levels and skill sets. Our 10,000+ associates work in 80+ cities, proficient in over 500 technological skills, helping deliver innovative solutions to top industries. Quess IT Staffing is...

Candidate should be able to:Understanding of different types of testing – Unit, Acceptance, Regression, Performance, etc.open to receiving feedback and constructive criticism.Proficiency working with large data storesunderstanding of Test Driven Development (TDD) or Pair ProgrammingCandidate should have:Deep understanding of all aspects of database...

You will work on:We help many of our clients make sense of their large investments in data – be it building analytics solutions or machine learning applications. You will work on cutting edge cloud-native technologies to crunch terabytes of data into meaningful insights.What you will do (Responsibilities):Collaborate with product management & engineering...

You will work on: We help many of our clients make sense of their large investments in data – be it building analytics solutions or machine learning applications. You will work on cutting edge cloud-native technologies to crunch terabytes of data into meaningful insights. What you will do (Responsibilities): Collaborate with product management &...

Job Description: Scala, Spark, Apache Sqoop, Cloudera, Unix Shell scripting, CAAS. Experience: 4-6 years At least four years of data engineering experience working with sophisticated data pipelines using Spark , Scala , Apache Sqoop, Cloudera , Unix Shell scripting and CAAS. Scala, Spark, Apache Sqoop, Cloudera, Unix Shell scripting, CAAS. ...

Job Description:Scala, Spark, Apache Sqoop, Cloudera, Unix Shell scripting, CAASExperience: 4-6 yearsAt least four years of data engineering experience working with sophisticated data pipelines using Spark , Scala , ApacheSqoop, Cloudera , Unix Shell scripting and CAAS.Scala, Spark, Apache Sqoop, Cloudera, Unix Shell scripting, CAASExperience: 4-6 yearsAt...

Lead Data Engineer Experience: 6-10 years Location: Bengaluru Availability: Immediate to 30 days Mandatory Skills: Spark Databricks Py Spark or Scala SQL & Python Github DWH (Snowflake or Presto or Hive or Hadoop) Data Pipeline & Data Model We are seeking an experienced Senior Data Engineer to join our dynamic team in Bengaluru.If you are passionate about...

Over all exp : 3-5yrsNotice : ImmediateMust Have Skills:3-5 yrs, of Strong expertise inPythonfor data engineering tasks (ETL/ELT).3-5yrs, of Experience with big data tools is desirable:Spark, Spark-Streaming, Kafka, Debeziumetc.experience withtwo or moreof this big data streaming technology is mandatory:Apache Spark Streaming, Apache Flink, Apache Kafka,...