Spark Developer
1 day ago
We are seeking an experienced Apache Spark Developer to design, develop, and optimize big data processing pipelines using Spark.
The ideal candidate will have strong expertise in distributed computing, data engineering, and performance tuning, with experience in building scalable data solutions on cloud or on-prem platforms.
Key Responsibilities:
- Design and implement data processing pipelines using Apache Spark (Core, SQL, Streaming).
- Develop and optimize ETL workflows for large-scale data ingestion and transformation.
- Work with Spark on Hadoop, Databricks, or cloud-based Spark environments.
- Collaborate with data engineers, data scientists, and business teams to deliver analytics solutions.
- Ensure data quality, security, and compliance standards.
- Perform performance tuning and job optimization for Spark applications.
- Integrate Spark with data lakes, data warehouses, and streaming platforms (Kafka).
Required Skills:
- Strong proficiency in Apache Spark (Core, SQL, Streaming).
- Hands-on experience with PySpark or Scala for Spark development.
- Knowledge of HDFS, Hive, and data lake architectures.
- Familiarity with cloud platforms (AWS EMR, Azure HDInsight, GCP Dataproc).
- Proficiency in SQL and data modeling.
Preferred Skills:
- Experience with Databricks and Delta Lake.
- Knowledge of Kafka, Airflow, or other orchestration tools.
- Exposure to machine learning pipelines in Spark MLlib.
-
spark developer
1 week ago
Bengaluru, Karnataka, India Coders Brain Technology Full time ₹ 1,00,00,000 - ₹ 2,00,00,000 per yearJD for Spark developer Experience:3 to 5 Years Work Location: Bangalore Responsibilities . As a Spark developer you will manage the development of scalable distributed Architecture defined by the Architect or tech Lead in our team. . Analyse, assemble large data sets to designed for the functional and...
-
Spark developer
2 weeks ago
Hyderabad, India Tata Consultancy Services Full timeGreetings from TCS !!!TCS presents an excellent opportunity for Java developer (Java,spark,AWS)Relevant Experience (Yrs) Need : 7 to 11 yearsRole: Java developer (Java,spark,AWS)Preferred Location Only for - Hyderabad/BangaloreMust-Have**(Ideally should not bemore than 3-5) - Spark programming, Java / J2EE, AWSResponsibility of / Expectations from the Role1....
-
Spark developer
1 week ago
Hyderabad, India Tata Consultancy Services Full timeGreetings from TCS !!!TCS presents an excellent opportunity for Java developer (Java,spark,AWS)Relevant Experience (Yrs) Need : 7 to 11 yearsRole: Java developer (Java,spark,AWS)Preferred Location Only for -Hyderabad/BangaloreMust-Have**(Ideally should not bemore than 3-5) - Spark programming, Java / J2EE, AWSResponsibility of / Expectations from the Role1....
-
Spark developer
1 week ago
Hyderabad, India Tata Consultancy Services Full timeGreetings from TCS !!!TCS presents an excellent opportunity for Java developer (Java,spark,AWS)Relevant Experience (Yrs) Need : 7 to 11 yearsRole: Java developer (Java,spark,AWS)Preferred Location Only for -Hyderabad/BangaloreMust-Have**(Ideally should not bemore than 3-5) - Spark programming, Java / J2EE, AWSResponsibility of / Expectations from the Role1....
-
Spark developer
24 hours ago
Hyderabad, India Tata Consultancy Services Full timeGreetings from TCS !!!TCS presents an excellent opportunity for Java developer (Java,spark,AWS)Relevant Experience (Yrs) Need : 7 to 11 yearsRole: Java developer (Java,spark,AWS)Preferred Location Only for - Hyderabad/BangaloreMust-Have**(Ideally should not bemore than 3-5) - Spark programming, Java / J2EE, AWSResponsibility of / Expectations from the...
-
Spark developer
2 weeks ago
hyderabad, India Tata Consultancy Services Full timeGreetings from TCS !!! TCS presents an excellent opportunity for Java developer (Java,spark,AWS) Relevant Experience (Yrs) Need : 7 to 11 years Role: Java developer (Java,spark,AWS) Preferred Location Only for -Hyderabad/Bangalore Must-Have** (Ideally should not be more than 3-5) - Spark programming, Java / J2EE, AWS Responsibility of / Expectations from the...
-
Spark developer
2 weeks ago
Hyderabad, India Tata Consultancy Services Full timeGreetings from TCS !!! TCS presents an excellent opportunity for Java developer (Java,spark,AWS) Relevant Experience (Yrs) Need : 7 to 11 years Role: Java developer (Java,spark,AWS) Preferred Location Only for -Hyderabad/Bangalore Must-Have** (Ideally should not be more than 3-5) - Spark programming, Java / J2EE, AWS Responsibility of / Expectations from the...
-
Spark developer
2 weeks ago
Hyderabad, India Tata Consultancy Services Full timeGreetings from TCS !!!TCS presents an excellent opportunity for Java developer (Java,spark,AWS)Relevant Experience (Yrs) Need : 7 to 11 yearsRole: Java developer (Java,spark,AWS)Preferred Location Only for -Hyderabad/BangaloreMust-Have**(Ideally should not bemore than 3-5) - Spark programming, Java / J2EE, AWSResponsibility of / Expectations from the Role1....
-
Spark developer
2 weeks ago
hyderabad, India Tata Consultancy Services Full timeGreetings from TCS !!!TCS presents an excellent opportunity for Java developer (Java,spark,AWS)Relevant Experience (Yrs) Need : 7 to 11 yearsRole: Java developer (Java,spark,AWS)Preferred Location Only for -Hyderabad/BangaloreMust-Have**(Ideally should not bemore than 3-5) - Spark programming, Java / J2EE, AWSResponsibility of / Expectations from the Role1....
-
Spark developer
1 week ago
Hyderabad, India Tata Consultancy Services Full timeGreetings from TCS !!! TCS presents an excellent opportunity for Java developer (Java,spark,AWS) Relevant Experience (Yrs) Need : 7 to 11 years Role: Java developer (Java,spark,AWS) Preferred Location Only for -Hyderabad/Bangalore Must-Have** (Ideally should not be more than 3-5) - Spark programming, Java / J2EE, AWS Responsibility of / Expectations from the...
