Spark Developer
1 week ago
About the Role:
We are looking for a skilled and passionate Spark Developer to design, build, and optimize large-scale data processing systems. The ideal candidate will have strong expertise in Apache Spark, Big Data ecosystems, and distributed computing frameworks.
Key Responsibilities:
- Design, develop, and maintain data processing pipelines using Apache Spark (Core, SQL, Streaming, Structured Streaming).
- Implement ETL workflows for data ingestion, transformation, and integration across multiple data sources.
- Optimize Spark applications for performance, scalability, and reliability in distributed environments.
- Work with large structured and unstructured datasets to support analytical and reporting needs.
- Collaborate with data scientists and business analysts to understand data requirements and provide engineering solutions.
- Integrate Spark applications with cloud platforms (AWS, Azure, GCP) and data storage systems (HDFS, S3, Hive, Cassandra, etc.).
Preferred Skills:
- Experience with cloud-based data platforms (AWS EMR, Databricks, Azure Synapse, GCP Dataproc).
- Familiarity with containerization (Docker, Kubernetes) and orchestration tools (Airflow, Luigi).
- Knowledge of data lake architectures, Delta Lake, or Parquet/Avro file formats.
- Exposure to machine learning pipelines and data science integrations.
- Understanding of data security, compliance, and governance principles.
-
Spark developer
1 week ago
hyderabad, India Tata Consultancy Services Full timeGreetings from TCSTCS presents an excellent opportunity for Java developer (Java,spark,AWS)Relevant Experience (Yrs) Need : 7 to 11 yearsRole: Java developer (Java,spark,AWS)Preferred Location Only for -Hyderabad/BangaloreMust-Have**(Ideally should not bemore than 3-5) - Spark programming, Java / J2EE, AWSResponsibility of / Expectations from the Role1....
-
spark developer
3 weeks ago
Chennai, India Tata Consultancy Services Full timeTCS HIRING!!! ROLE: Spark Developer JOB LOCATION : Chennai, Kolkata, Hyderabad , Ahmedabad,, Gurgaon EXPERIENCE : 6-8 years Required Technical Skill : Spark , Scala, Pyspark, python Job Description: Strong Knowledge on Spark, Scala, Python, PySpark · Strong in SQL concepts · Good to have Knowledge on Bigdata Technologies like Hive ,Sqoop,Pig,Kafka,Flume....
-
spark developer
3 weeks ago
Chennai, India Tata Consultancy Services Full timeTCS HIRING!!! ROLE: Spark Developer JOB LOCATION : Chennai, Kolkata, Hyderabad , Ahmedabad,, Gurgaon EXPERIENCE : 6-8 years Required Technical Skill : Spark , Scala, Pyspark, python Job Description: Strong Knowledge on Spark, Scala, Python, PySpark · Strong in SQL concepts · Good to have Knowledge on Bigdata Technologies like Hive ,Sqoop,Pig,Kafka,Flume....
-
spark developer
4 weeks ago
Chennai, India Tata Consultancy Services Full timeTCS HIRING!!! ROLE: Spark Developer JOB LOCATION : Chennai, Kolkata, Hyderabad , Ahmedabad,, Gurgaon EXPERIENCE : 6-8 years Required Technical Skill : Spark , Scala, Pyspark, python Job Description: Strong Knowledge on Spark, Scala, Python, PySpark · Strong in SQL concepts · Good to have Knowledge on Bigdata Technologies like Hive ,Sqoop,Pig,Kafka,Flume....
-
spark developer
4 weeks ago
chennai, India Tata Consultancy Services Full timeTCS HIRING!!! ROLE: Spark Developer JOB LOCATION : Chennai, Kolkata, Hyderabad , Ahmedabad,, Gurgaon EXPERIENCE : 6-8 years Required Technical Skill : Spark , Scala, Pyspark, python Job Description: Strong Knowledge on Spark, Scala, Python, PySpark · Strong in SQL concepts · Good to have Knowledge on Bigdata Technologies like Hive ,Sqoop,Pig,Kafka,Flume....
-
Spark developer
3 weeks ago
Hyderabad, India Tata Consultancy Services Full timeGreetings from TCS !!!TCS presents an excellent opportunity for Java developer (Java,spark,AWS)Relevant Experience (Yrs) Need : 7 to 11 yearsRole: Java developer (Java,spark,AWS)Preferred Location Only for -Hyderabad/BangaloreMust-Have**(Ideally should not bemore than 3-5) - Spark programming, Java / J2EE, AWSResponsibility of / Expectations from the Role1....
-
Spark developer
4 weeks ago
Hyderabad, India Tata Consultancy Services Full timeGreetings from TCS !!!TCS presents an excellent opportunity for Java developer (Java,spark,AWS)Relevant Experience (Yrs) Need : 7 to 11 yearsRole: Java developer (Java,spark,AWS)Preferred Location Only for - Hyderabad/BangaloreMust-Have**(Ideally should not bemore than 3-5) - Spark programming, Java / J2EE, AWSResponsibility of / Expectations from the Role1....
-
Spark developer
3 weeks ago
Hyderabad, India Tata Consultancy Services Full timeGreetings from TCS !!! TCS presents an excellent opportunity for Java developer (Java,spark,AWS) Relevant Experience (Yrs) Need : 7 to 11 years Role: Java developer (Java,spark,AWS) Preferred Location Only for -Hyderabad/Bangalore Must-Have** (Ideally should not be more than 3-5) - Spark programming, Java / J2EE, AWS Responsibility of / Expectations from the...
-
Spark developer
3 weeks ago
Hyderabad, India Tata Consultancy Services Full timeGreetings from TCS !!! TCS presents an excellent opportunity for Java developer (Java,spark,AWS) Relevant Experience (Yrs) Need : 7 to 11 years Role: Java developer (Java,spark,AWS) Preferred Location Only for -Hyderabad/Bangalore Must-Have** (Ideally should not be more than 3-5) - Spark programming, Java / J2EE, AWS Responsibility of / Expectations from the...
-
Spark developer
4 weeks ago
Hyderabad, India Tata Consultancy Services Full timeGreetings from TCS !!!TCS presents an excellent opportunity for Java developer (Java,spark,AWS)Relevant Experience (Yrs) Need : 7 to 11 yearsRole: Java developer (Java,spark,AWS)Preferred Location Only for -Hyderabad/BangaloreMust-Have**(Ideally should not bemore than 3-5) - Spark programming, Java / J2EE, AWSResponsibility of / Expectations from the Role1....
