Spark Developer
2 weeks ago
We are seeking an experienced Spark Developer with 5+ years of expertise in big data processing and distributed computing. The ideal candidate will design, develop, and optimize data pipelines using Apache Spark and related technologies, ensuring high performance and scalability for large datasets.
Key Responsibilities
- Design and implement Spark-based ETL pipelines for batch and streaming data.
- Optimize Spark jobs for performance and resource utilization.
- Work with distributed systems and big data frameworks (Hadoop, Hive, Kafka).
- Collaborate with data engineers, data scientists, and business teams to deliver clean, structured data.
- Ensure data quality, reliability, and security across all processes.
- Troubleshoot and resolve issues in Spark clusters and jobs.
- Integrate Spark applications with cloud platforms (AWS, Azure, GCP).
Required Skills & Qualifications
- Bachelors/Masters in Computer Science, Data Engineering, or related field.
- 5+ years of experience in big data development.
- Strong proficiency in Apache Spark (Core, SQL, Streaming).
- Expertise in Scala or Python for Spark development.
- Experience with Hadoop ecosystem (HDFS, Hive, YARN).
- Familiarity with data modeling, partitioning, and performance tuning.
- Knowledge of cloud services and containerization (Docker, Kubernetes).
-
Spark developer
1 week ago
hyderabad, India Tata Consultancy Services Full timeGreetings from TCSTCS presents an excellent opportunity for Java developer (Java,spark,AWS)Relevant Experience (Yrs) Need : 7 to 11 yearsRole: Java developer (Java,spark,AWS)Preferred Location Only for -Hyderabad/BangaloreMust-Have**(Ideally should not bemore than 3-5) - Spark programming, Java / J2EE, AWSResponsibility of / Expectations from the Role1....
-
Spark Developer
1 week ago
Bengaluru, Chennai, Hyderabad, India ti Steps Full time ₹ 8,00,000 - ₹ 24,00,000 per yearAbout the Role:We are looking for a skilled and passionate Spark Developer to design, build, and optimize large-scale data processing systems. The ideal candidate will have strong expertise in Apache Spark, Big Data ecosystems, and distributed computing frameworks.Key Responsibilities:Design, develop, and maintain data processing pipelines using Apache Spark...
-
Spark developer
3 weeks ago
Hyderabad, India Tata Consultancy Services Full timeGreetings from TCS !!!TCS presents an excellent opportunity for Java developer (Java,spark,AWS)Relevant Experience (Yrs) Need : 7 to 11 yearsRole: Java developer (Java,spark,AWS)Preferred Location Only for -Hyderabad/BangaloreMust-Have**(Ideally should not bemore than 3-5) - Spark programming, Java / J2EE, AWSResponsibility of / Expectations from the Role1....
-
Spark developer
4 weeks ago
Hyderabad, India Tata Consultancy Services Full timeGreetings from TCS !!!TCS presents an excellent opportunity for Java developer (Java,spark,AWS)Relevant Experience (Yrs) Need : 7 to 11 yearsRole: Java developer (Java,spark,AWS)Preferred Location Only for - Hyderabad/BangaloreMust-Have**(Ideally should not bemore than 3-5) - Spark programming, Java / J2EE, AWSResponsibility of / Expectations from the Role1....
-
Spark developer
3 weeks ago
Hyderabad, India Tata Consultancy Services Full timeGreetings from TCS !!! TCS presents an excellent opportunity for Java developer (Java,spark,AWS) Relevant Experience (Yrs) Need : 7 to 11 years Role: Java developer (Java,spark,AWS) Preferred Location Only for -Hyderabad/Bangalore Must-Have** (Ideally should not be more than 3-5) - Spark programming, Java / J2EE, AWS Responsibility of / Expectations from the...
-
Spark developer
3 weeks ago
Hyderabad, India Tata Consultancy Services Full timeGreetings from TCS !!! TCS presents an excellent opportunity for Java developer (Java,spark,AWS) Relevant Experience (Yrs) Need : 7 to 11 years Role: Java developer (Java,spark,AWS) Preferred Location Only for -Hyderabad/Bangalore Must-Have** (Ideally should not be more than 3-5) - Spark programming, Java / J2EE, AWS Responsibility of / Expectations from the...
-
Spark developer
4 weeks ago
Hyderabad, India Tata Consultancy Services Full timeGreetings from TCS !!!TCS presents an excellent opportunity for Java developer (Java,spark,AWS)Relevant Experience (Yrs) Need : 7 to 11 yearsRole: Java developer (Java,spark,AWS)Preferred Location Only for -Hyderabad/BangaloreMust-Have**(Ideally should not bemore than 3-5) - Spark programming, Java / J2EE, AWSResponsibility of / Expectations from the Role1....
-
Spark developer
4 weeks ago
Hyderabad, India Tata Consultancy Services Full timeGreetings from TCS !!! TCS presents an excellent opportunity for Java developer (Java,spark,AWS) Relevant Experience (Yrs) Need : 7 to 11 years Role: Java developer (Java,spark,AWS) Preferred Location Only for -Hyderabad/Bangalore Must-Have** (Ideally should not be more than 3-5) - Spark programming, Java / J2EE, AWS Responsibility of / Expectations from the...
-
Spark developer
4 weeks ago
hyderabad, India Tata Consultancy Services Full timeGreetings from TCS !!! TCS presents an excellent opportunity for Java developer (Java,spark,AWS) Relevant Experience (Yrs) Need : 7 to 11 years Role: Java developer (Java,spark,AWS) Preferred Location Only for -Hyderabad/Bangalore Must-Have** (Ideally should not be more than 3-5) - Spark programming, Java / J2EE, AWS Responsibility of / Expectations from the...
-
Spark developer
2 weeks ago
Hyderabad, India Tata Consultancy Services Full timeGreetings from TCS !!!TCS presents an excellent opportunity for Java developer (Java,spark,AWS)Relevant Experience (Yrs) Need : 7 to 11 yearsRole: Java developer (Java,spark,AWS)Preferred Location Only for -Hyderabad/BangaloreMust-Have**(Ideally should not bemore than 3-5) - Spark programming, Java / J2EE, AWSResponsibility of / Expectations from the Role1....
