Apache Spark Expert

6 months ago

Pune, India Info Origin Full time

Position Title:

- Apache Spark Expert**Location**:

- Pune, MH, OnsitePosition Type:

- Full-TimeInterview Process:

- Webcam/SkypeReq Id:

- 3314Salary/Rate:

- MarketPosition Duration:

- Permanent**Key Responsibilities**:

- Provide architectural consultancy to clients and develop implementation roadmaps for Apache Spark and Kafka solutions.
- Translate architectural strategies into code and facilitate knowledge transfer to junior developers.
- Demonstrate in-depth knowledge of AWS services, particularly MSK (Managed Streaming for Kafka), Spark EMR, and working with various data sources, sinks, and transformations.
- Proficiency in utilizing S3, Athena, Glue, and Step Functions for efficient data processing and analysis.
- Experience with Kinesis, Firehose, and the Kafka Connect Framework, including the development of custom connectors.

**Qualifications and Skills**:

- Strong expertise in Apache Spark and Kafka with a focus on architectural understanding.
- Proven hands-on experience in developing and implementing solutions using Apache Spark and Kafka Streaming.
- Sound knowledge of AWS services, including MSK, Spark EMR, S3, Athena, Glue, Step Functions, Kinesis, and Firehose.
- Proficiency in the Kafka Connect Framework, especially in the development of custom connectors.

**Preferred**:

- Familiarity with Apache Airflow is considered a plus.
- Experience in (Real-time) Data analytics is also welcome.

  • Apache Spark Developer

    4 weeks ago

    Pune, Maharashtra, India Wipro Full time

    Role SummaryWe are looking for a highly skilled Data Engineer with expertise in Apache Spark to join our team at Wipro.Key ResponsibilitiesDesign, develop, and maintain large-scale data processing pipelines using Apache Spark.Ensure high-performance data processing and optimize Spark framework for optimal performance.Develop and maintain complex data models...

  • Data Scientist with Expertise in Apache Spark

    1 week ago

    Pune, Maharashtra, India Talent Sketchers Full time

    Talent Sketchers is seeking a highly skilled Data Scientist to join our team.Estimated Salary: ₹1500000 - ₹2000000 per annum (depending on experience)The ideal candidate will have 5+ years of experience in designing, developing, and maintaining large-scale data processing systems using Apache Spark.The successful candidate will be responsible...

  • Ab Initio and Apache Spark Developer

    1 month ago

    Pune, Maharashtra, India Synechron Full time

    About the RoleWe are seeking a highly skilled Ab Initio and Apache Spark Developer to join our team. The ideal candidate will have a strong background in big data processing and a proven track record of delivering scalable and performance-driven solutions.Key Responsibilities:Lead architectural design sessions and technical reviews to create a robust,...

  • Senior Apache Spark and Big Data Developer with Excellent Skills in Hadoop Ecosystem

    2 weeks ago

    Pune, Maharashtra, India Xoriant Full time

    Xoriant is seeking a highly skilled Senior Apache Spark and Big Data Developer to join our team. The ideal candidate will have excellent skills in the Hadoop ecosystem, including Apache Spark, Hive, and My SQL.

  • Spark scala developer

    1 week ago

    Pune, India Radioactive Technologies Full time

    We are hiring at Radioactive Technologies.Full time Contract OpportunityFully Remoteplease share resume at Spark & Scala DeveloperExp- 10-13 yrsShift- EuropeanFull time Contract OpportunityFully Remoteplease share resume at Responsibilities-Create Scala/Spark jobs for data transformation and aggregationProduce unit tests for Spark transformations and...

  • Apache spark developer

    4 weeks ago

    Pune, India Wipro Full time

    Responsibilities Excellent Knowledge on Spark; The professional must have a thorough understanding Spark framework, Performance Tuning etc. Excellent Knowledge and hands-on experience of at least 4+ years in Scala or Py Spark Excellent Knowledge of the Hadoop eco System- Knowledge of Hive mandatory Strong Unix and Shell Scripting Skills Excellent...

  • Apache spark developer

    1 month ago

    Pune, India Wipro Full time

    ResponsibilitiesExcellent Knowledge on Spark; The professional must have a thorough understanding Spark framework, Performance Tuning etc.Excellent Knowledge and hands-on experience of at least 4+ years in Scala or Py SparkExcellent Knowledge of the Hadoop eco System- Knowledge of Hive mandatoryStrong Unix and Shell Scripting SkillsExcellent Inter-personal...

  • Senior Data Engineer

    4 weeks ago

    Pune, Maharashtra, India Coders Brain Technology Pvt. Ltd. Full time

    Job Title: Senior Data Engineer - Apache Spark and JavaAbout the Role: We are seeking a highly skilled Senior Data Engineer to join our team at Coders Brain Technology Pvt. Ltd.Key Responsibilities:Design, develop, and deploy large-scale data engineering solutions using Apache Spark and Java.Collaborate with cross-functional teams to understand business...

  • Spark Scala Developer

    2 weeks ago

    Pune, India Radioactive Technologies Full time

    We are hiring at Radioactive Technologies. Full time Contract Opportunity Fully Remote please share resume at Spark & Scala Developer Exp- 10-13 yrs Shift- European   Full time Contract Opportunity Fully Remote   please share resume at   Responsibilities- Create Scala/Spark jobs for data transformation and aggregation Produce unit tests for Spark...

  • Spark Scala Developer

    2 weeks ago

    Pune, India Radioactive Technologies Full time

    We are hiring at Radioactive Technologies.Full time Contract OpportunityFully Remoteplease share resume at Khalil@weradioactive.comSpark & Scala DeveloperExp- 10-13 yrsShift- European Full time Contract OpportunityFully Remote please share resume at Khalil@weradioactive.com Responsibilities-Create Scala/Spark jobs for data transformation and...

  • Spark Scala Developer

    2 weeks ago

    Pune, India Radioactive Technologies Full time

    We are hiring at Radioactive Technologies.Full time Contract OpportunityFully Remoteplease share resume at Khalil@weradioactive.comSpark & Scala DeveloperExp- 10-13 yrsShift- European Full time Contract OpportunityFully Remote please share resume at Khalil@weradioactive.com Responsibilities-Create Scala/Spark jobs for data transformation and...

  • Apache spark Developer

    1 month ago

    Pune, India Wipro Full time

    ResponsibilitiesExcellent Knowledge on Spark; The professional must have a thorough understanding Spark framework, Performance Tuning etc.Excellent Knowledge and hands-on experience of at least 4+ years in Scala or PySparkExcellent Knowledge of the Hadoop eco System- Knowledge of Hive mandatoryStrong Unix and Shell Scripting SkillsExcellent Inter-personal...

  • Apache spark Developer

    4 weeks ago

    pune, India Wipro Full time

    Responsibilities - Excellent Knowledge on Spark; The professional must have a thorough understanding Spark framework, Performance Tuning etc. - Excellent Knowledge and hands-on experience of at least 4+ years in Scala or PySpark - Excellent Knowledge of the Hadoop eco System- Knowledge of Hive mandatory - Strong Unix and Shell Scripting Skills - Excellent...

  • Apache spark Developer

    4 weeks ago

    pune, India Wipro Full time

    Responsibilities- Excellent Knowledge on Spark; The professional must have a thorough understanding Spark framework, Performance Tuning etc.- Excellent Knowledge and hands-on experience of at least 4+ years in Scala or PySpark- Excellent Knowledge of the Hadoop eco System- Knowledge of Hive mandatory- Strong Unix and Shell Scripting Skills- Excellent...

  • Apache spark Developer

    4 weeks ago

    pune, India Wipro Full time

    Responsibilities Excellent Knowledge on Spark; The professional must have a thorough understanding Spark framework, Performance Tuning etc. Excellent Knowledge and hands-on experience of at least 4+ years in Scala or PySpark Excellent Knowledge of the Hadoop eco System- Knowledge of Hive mandatory Strong Unix and Shell Scripting Skills Excellent...

  • Apache spark Developer

    1 month ago

    Pune, India Wipro Full time

    Responsibilities- Excellent Knowledge on Spark; The professional must have a thorough understanding Spark framework, Performance Tuning etc.- Excellent Knowledge and hands-on experience of at least 4+ years in Scala or PySpark- Excellent Knowledge of the Hadoop eco System- Knowledge of Hive mandatory- Strong Unix and Shell Scripting Skills- Excellent...

  • Apache spark Developer

    4 weeks ago

    pune, India Wipro Full time

    Responsibilities- Excellent Knowledge on Spark; The professional must have a thorough understanding Spark framework, Performance Tuning etc.- Excellent Knowledge and hands-on experience of at least 4+ years in Scala or PySpark- Excellent Knowledge of the Hadoop eco System- Knowledge of Hive mandatory- Strong Unix and Shell Scripting Skills- Excellent...

  • Apache spark Developer

    1 month ago

    pune, India Wipro Full time

    ResponsibilitiesExcellent Knowledge on Spark; The professional must have a thorough understanding Spark framework, Performance Tuning etc.Excellent Knowledge and hands-on experience of at least 4+ years in Scala or PySparkExcellent Knowledge of the Hadoop eco System- Knowledge of Hive mandatoryStrong Unix and Shell Scripting SkillsExcellent Inter-personal...

  • Apache spark Developer

    1 month ago

    Pune, India Wipro Full time

    ResponsibilitiesExcellent Knowledge on Spark; The professional must have a thorough understanding Spark framework, Performance Tuning etc.Excellent Knowledge and hands-on experience of at least 4+ years in Scala or PySparkExcellent Knowledge of the Hadoop eco System- Knowledge of Hive mandatoryStrong Unix and Shell Scripting SkillsExcellent Inter-personal...

  • Apache spark Developer

    1 month ago

    pune, India Wipro Full time

    ResponsibilitiesExcellent Knowledge on Spark; The professional must have a thorough understanding Spark framework, Performance Tuning etc.Excellent Knowledge and hands-on experience of at least 4+ years in Scala or PySparkExcellent Knowledge of the Hadoop eco System- Knowledge of Hive mandatoryStrong Unix and Shell Scripting SkillsExcellent Inter-personal...