Apache Spark

7 days ago

Bengaluru, India Coppergate Consultancy Pvt.Ltd Full time

Process Apache Spark is an open-source, distributed processing system used for big data workloads. It utilizes in-memory caching, and optimized query execution for fast analytic queries against data of any size.

No of Openings 3

Gender male/female

About Process Apache Spark is a data processing framework that can quickly perform processing tasks on very large data sets,
and can also distribute data processing tasks across multiple computers, either on its own or in tandem with other distributed computing tools. These two qualities are key to the worlds of big data and machine learning, which require the marshalling of massive computing power to crunch through large data stores. Spark also takes some of the programming burdens of these tasks off the shoulders of developers with an easy-to-use API that abstracts away much of the grunt work of distributed computing and big data processing.

Title Apache Spark

Location CHENNAI /BANGALORE/HYDERABAD/PUNE

Requirment Minimum of 4+ years of software development experience (with a concentration in data centric initiatives), with demonstrated expertise in

standard development best practice methodologies

Minimum 4+ years of experience in Hadoop using

Spark, Scala, Hive, Kafka

Strong knowledge of Database concepts
Expert on SQL skills for data manipulation (DML)
Expertise in Object Oriented Programming Langu
- Java
Ability to impliment POC with latest tech stalk
Experience using CI/CD Process, version control ,bug tracking tools.
Need exposure to Real Time data processing.
Experience in handling very large data volume in low latency and batch mode.
Result oriented with strong analytical and problem-solving skills.
Experience with automation of job execution,validation and compares of the data files on Hadoop Env at the field level.
Experience in leading a small team and be a team player.
Strong communication skills with proven ability to present complex ideas and document in a clear and concise way.
Quick learner: self-starter, detailed and in-depth

Education BSCIT/ BS/MS degree in Computer Science

Shift timings 10.30 am-7.30pm, night shifts if required

Transport Boundaries NA

Transport Facility NA

Salary Range 14LPA

Weekly Off Alternate Saturdays and Fix Sundays

Age upto 35yrs

USP Brand salary

Rounds of Interview HR+Operationa Rounds

Documents Educational + Identity Proof + Residential Proof +Offer Letter + Salary Proof (Bank Statement Payslip) + Relieving documents

Payout 8.33%

Claw back 90 days

**Salary**: ₹50,000.00 - ₹100,000.00 per month

Schedule:

- Morning shift

Ability to commute/relocate:

- Bengaluru, Bengaluru Urban - 560087, Karnataka: Reliably commute or planning to relocate before starting work (required)

**Experience**:

- total work: 4 years (preferred)

  • Apache Spark E0

    4 days ago

    Bengaluru, India Teamware Solutions Full time

    Job Description We are looking for a motivated Apache Spark Developer (Entry Level) to join our data engineering team. The ideal candidate will learn to design, develop, and maintain large-scale data processing applications using Apache Spark and related big data technologies. Key Responsibilities: - Assist in developing batch and real-time data processing...

  • Apache Spark

    4 days ago

    Bengaluru, India Teamware Solutions Full time

    Job Description Responsibilities: - Develop and maintain data processing workflows using Apache Spark and Scala - Implement batch and streaming data pipelines - Optimize Spark jobs for better performance and scalability - Collaborate with data engineers and analysts to deliver data solutions - Debug and resolve issues in production big data environments -...

  • Apache Spark Professional

    2 weeks ago

    Bengaluru, Chennai, Coimbatore, India Krazy Mantra HR Solutions Pvt. Ltd Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We are looking for a skilled professional with expertise in Apache Spark to join our team. The ideal candidate will have 7-10 years of experience and be based in Pune, Bangalore, GNDc, Chennai, Coimbatore, or Hyderabad.Roles and ResponsibilityDesign, develop, and implement scalable data processing pipelines using Apache Spark.Collaborate with...

  • Spark/Scala Developer

    2 weeks ago

    Bengaluru, India HARP Technologies and Services Full time

    Notice Period : Immediate to 30 DaysJob Summary :We are looking for experienced Spark Scala Developers to join our growing team. The ideal candidate will have hands-on expertise in big data processing using Apache Spark with Scala, along with proficiency in workflow management tools like Oozie and data flow platforms such as Apache NiFi.Key Responsibilities...

  • Principal Scala Engineer

    17 hours ago

    Bengaluru, India BairesDev Full time

    Job Description At BairesDev, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley. Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works on roles that drive significant impact worldwide. When you apply for this...

  • Senior Apache Spark Expert

    2 weeks ago

    Bengaluru, Karnataka, India Relanto Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Position - Senior Apache Spark ExpertExperience:6 + yearsLocation:Bangalore (WFO only)Qualification:Bachelor's degree in computer science, Engineering, or a related field (preferred)Immediate joiners onlyJob DescriptionStrong knowledge of Spark architecture, able to set up, manage and admin Spark cluster with Kubernetes, Strong on Scala, build efficient ETL...

  • Sr Backline Engineer

    3 weeks ago

    Bengaluru, India Databricks Full time

    Mission Databricks helps data teams solve the world’s toughest problems. As the leader in Unified Data Analytics, Databricks helps organizations make all their data ready for analytics, empower data-driven decisions across the organization, and rapidly adopt machine learning to outpace the competition Databricks is venture-backed and founded by the...

  • Sr Backline Engineer

    4 weeks ago

    Bengaluru, India Databricks Full time

    Mission Databricks helps data teams solve the world’s toughest problems. As the leader in Unified Data Analytics, Databricks helps organizations make all their data ready for analytics, empower data-driven decisions across the organization, and rapidly adopt machine learning to outpace the competition Databricks is venture-backed and founded by the...

  • Apache spark with cloud Professional

    1 week ago

    Bengaluru, Chennai, Coimbatore, India Krazy Mantra HR Solutions Pvt. Ltd Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We are looking for a skilled professional with expertise in Apache Spark and cloud technologies to join our team. The ideal candidate will have 5-7 years of experience.Roles and ResponsibilityDesign, develop, and implement scalable data processing pipelines using Apache Spark.Collaborate with cross-functional teams to integrate Spark applications with cloud...

  • Data Engineer

    2 days ago

    Bengaluru, India Ixceed Solutions Full time

    Responsibilities :- Design, develop, and maintain robust and scalable data pipelines using Apache Spark and Scala on the Databricks platform.- Implement ETL (Extract, Transform, Load) processes for various data sources, ensuring data quality, integrity, and efficiency.- Optimize Spark applications for performance and cost-efficiency within the Databricks...