Big Data Developer

1 week ago

Bengaluru, India Xcelyst Full time

Big Data + Scala developer

Experience : 4-8 Yrs. experience overall

Mandatory Skills :


Programming Languages : Scala (SCALA IS MAND)

Big Data Frameworks : Spark, Hadoop/HDFS/Hive/Sqoop/Oozie, Kafka, HBase or any other NoSQL Store

Good to Have : Streaming with Spark/Kafka, Cloud knowledge (AWS/Azure)Scheduling and creatin

Location : Bangalore / Pune

Notice Period : Immediate Joiner - 30 days

Job Description :

We are seeking a highly skilled and motivated Big Data Developer with expertise in Scala to join our dynamic data engineering team. The ideal candidate will have a strong background in developing scalable data processing solutions and a passion for working with large datasets.

Responsibilities :

- Data Processing Pipelines : Design, develop, and maintain data processing pipelines using Scala and Apache Spark.

- Collaboration : Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver effective solutions.

- Documentation : Create and maintain comprehensive documentation for data pipelines, processes, and systems.

- Monitoring and Troubleshooting : Monitor data pipeline performance, troubleshoot issues, and implement solutions to ensure data integrity and system reliability.

- Data Processing : Design and develop data processing pipelines using Scala and big data frameworks like Apache Spark.

- ETL Processes : Implement Extract, Transform, Load (ETL) processes to move and transform data from various sources into a central repository.

- Optimization: Optimize data processing workflows for performance and scalability.

- Data Integration: Integrate diverse data sources, ensuring data quality and consistency.

- Collaboration: Work closely with data scientists, analysts, and other stakeholders to understand data needs and deliver solutions workflows with Apache AirFlow

- Excellent communication skills

- Proficiency in Scala programming language.

- Extensive experience with big data technologies such as Apache Spark, Hadoop, Kafka, and HBase.

- Strong understanding of data warehousing concepts and ETL processes.

- Experience with cloud platforms such as AWS, Google Cloud Platform (GCP), or Azure.

- Familiarity with data modeling, data integration, and data quality best practices.

- Analytical Skills : Strong problem-solving and analytical skills, with the ability to troubleshoot and resolve data-related issues.

- Communication Skills : Excellent communication and teamwork skills, with the ability to collaborate effectively with cross-functional teams.

- Attention to Detail : High attention to detail and a commitment to delivering high-quality, reliable data solutions.

- Agile Methodologies : Experience working in an Agile development environment is a plus.

(ref:hirist.tech)

  • Big Data Developer

    2 months ago

    Bengaluru, India Unison Consulting Pte Ltd Full time

    Job Description:Unison Consulting Pte Ltd is seeking an experienced Big Data Developer to join our team. As a Big Data Developer, you will be responsible for designing, developing, and maintaining big data solutions to enable data-driven decision making and analytics capabilities for our clients. You will work with large volumes of structured and...

  • Big Data Developer

    1 hour ago

    Bengaluru, Karnataka, India Unison Consulting Full time

    Job Description:Unison Consulting Pte Ltd is seeking an experienced Big Data Developer to join our team. As a Big Data Developer, you will be responsible for designing, developing, and maintaining big data solutions to enable data-driven decision making and analytics capabilities for our clients. You will work with large volumes of structured and...

  • Big Data Developer

    4 weeks ago

    Bengaluru, India Unison Consulting Full time

    Job Description:Unison Consulting Pte Ltd is seeking an experienced Big Data Developer to join our team. As a Big Data Developer, you will be responsible for designing, developing, and maintaining big data solutions to enable data-driven decision making and analytics capabilities for our clients. You will work with large volumes of structured and...

  • Big Data Developer

    2 months ago

    Bengaluru, India Unison Consulting Pte Ltd Full time

    Job Description:Unison Consulting Pte Ltd is seeking an experienced Big Data Developer to join our team. As a Big Data Developer, you will be responsible for designing, developing, and maintaining big data solutions to enable data-driven decision making and analytics capabilities for our clients. You will work with large volumes of structured and...

  • Big Data Developer

    4 weeks ago

    Bengaluru, India Unison Consulting Full time

    Job Description:Unison Consulting Pte Ltd is seeking an experienced Big Data Developer to join our team. As a Big Data Developer, you will be responsible for designing, developing, and maintaining big data solutions to enable data-driven decision making and analytics capabilities for our clients. You will work with large volumes of structured and...

  • Big Data Developer

    1 hour ago

    Bengaluru, Karnataka, India Unison Consulting Pte Ltd Full time

    Job Description: Unison Consulting Pte Ltd is seeking an experienced Big Data Developer to join our team. As a Big Data Developer, you will be responsible for designing, developing, and maintaining big data solutions to enable data-driven decision making and analytics capabilities for our clients. You will work with large volumes of structured and...

  • Big Data Developer

    4 weeks ago

    Bengaluru, India Fractal Full time

    Fractal analytics is looking for a Bigdata developer, please find the job description below:Experience - 5+ yearsSkills : Bigdata, Hadoop, Hive, Impala, Cloudera (Cloudera current experience is mandatory)Location - Bangalore (work from office)Notice period - 30-45 daysRESPONSIBILITIES:Our Big Data capability team needs hands-on developers who can produce...

  • Big Data Developer

    2 weeks ago

    Bengaluru, India Fractal Full time

    Fractal analytics is looking for a Bigdata developer, please find the job description below: Experience - 5+ years Skills : Bigdata, Hadoop, Hive, Impala, Cloudera (Cloudera current experience is mandatory) Location - Bangalore (work from office) Notice period - 30-45 days RESPONSIBILITIES: Our Big Data capability team needs hands-on developers who can...

  • Big Data Developer

    4 weeks ago

    Bengaluru, India Fractal Full time

    Fractal analytics is looking for a Bigdata developer, please find the job description below:Experience - 5+ yearsSkills : Bigdata, Hadoop, Hive, Impala, Cloudera (Cloudera current experience is mandatory)Location - Bangalore (work from office)Notice period - 30-45 daysRESPONSIBILITIES: Our Big Data capability team needs hands-on developers who can produce...

  • Big Data Developer

    2 weeks ago

    Bengaluru, India Fractal Full time

    Fractal analytics is looking for a Bigdata developer, please find the job description below:Experience - 5+ yearsSkills : Bigdata, Hadoop, Hive, Impala, Cloudera (Cloudera current experience is mandatory)Location - Bangalore (work from office)Notice period - 30-45 daysRESPONSIBILITIES: Our Big Data capability team needs hands-on developers who can produce...

  • Big Data Developer

    4 weeks ago

    Bengaluru, India Fractal Full time

    Fractal analytics is looking for a Bigdata developer, please find the job description below:Experience - 5+ yearsSkills : Bigdata, Hadoop, Hive, Impala, Cloudera (Cloudera current experience is mandatory)Location - Bangalore (work from office)Notice period - 30-45 daysRESPONSIBILITIES: Our Big Data capability team needs hands-on developers who can produce...

  • Big Data Developer

    2 weeks ago

    Bengaluru, India Fractal Full time

    Fractal analytics is looking for a Bigdata developer, please find the job description below:Experience - 5+ yearsSkills : Bigdata, Hadoop, Hive, Impala, Cloudera (Cloudera current experience is mandatory)Location - Bangalore (work from office)Notice period - 30-45 daysRESPONSIBILITIES: Our Big Data capability team needs hands-on developers who can produce...

  • Big data developer

    2 months ago

    Bengaluru, India Virtusa Full time

    Big data developer - CREQ185815 Description Position: Big data developer Primary skills: Hadoop, hive, spark, aws Location: BLR Experience in building SparkStreaming process. Proficient in understanding distributed computing principles. Experience in managing Hadoop cluster with all services. Experience with Nosql Databases and Messaging systems like...

  • Big data developer

    2 weeks ago

    Bengaluru, India Virtusa Full time

    Big data developer - CREQ185815 Description Position: Big data developer Primary skills: Hadoop, hive, spark, aws Location: BLR Experience in building SparkStreaming process. Proficient in understanding distributed computing principles. Experience in managing Hadoop cluster with all services. Experience with Nosql Databases and Messaging systems like...

  • Big data developer

    9 hours ago

    Bengaluru, Karnataka, India Virtusa Full time

    Big data developer - CREQ185815 Description Position: Big data developer Primary skills: Hadoop, hive, spark, aws Location: BLR Experience in building SparkStreaming process. Proficient in understanding distributed computing principles. Experience in managing Hadoop cluster with all services. Experience with Nosql Databases and Messaging systems like...

  • Big data developer

    8 hours ago

    Bengaluru, Karnataka, India Virtusa Full time

    Big data developer - CREQ185815 DescriptionPosition: Big data developerPrimary skills: Hadoop, hive, spark, awsLocation: BLRExperience in building SparkStreaming process. Proficient in understanding distributed computing principles. Experience in managing Hadoop cluster with all services. Experience with Nosql Databases and Messaging systems like Kafka....

  • Big Data Developer

    2 days ago

    Bengaluru, India upGrad Rekrut Full time

    Role: Big Data DeveloperYears of experience: 7 to 9 yrsSkill requirement: Big data stack tools like Hadoop, spark etc, Data structures and Algorithm (DSA), Java/Python/ScalaWork location: BangaloreWork mode: 4 days in office, (1 day WFH)Notice period: immediate to 15 daysQualifications: - - Years of track record of relevant work experience and a computer...

  • Big Data Developer

    1 month ago

    Bengaluru, India HTC Global Services Full time

    About HTC Global ServicesHTC Global Services is a US based IT solutions and IT enabled services company with its global headquarters in Troy, MI. We are an Inc 500 Hall of Fame company with our existence in the industry for three decades. HTC is a SEI-CMM Level 5 and ISO 9001 & ISO 27001 certified organization. HTC has its global presence in North America,...

  • Big Data Developer

    4 weeks ago

    Bengaluru, India HTC Global Services Full time

    About HTC Global Services HTC Global Services is a US based IT solutions and IT enabled services company with its global headquarters in Troy, MI. We are an Inc 500 Hall of Fame company with our existence in the industry for three decades. HTC is a SEI-CMM Level 5 and ISO 9001 & ISO 27001 certified organization. HTC has its global presence in North America,...

  • Big data developer

    2 weeks ago

    Bengaluru, India Virtusa Full time

    Big data developer - CREQ185815 DescriptionPosition: Big data developerPrimary skills: Hadoop, hive, spark, awsLocation: BLRExperience in building SparkStreaming process. Proficient in understanding distributed computing principles. Experience in managing Hadoop cluster with all services. Experience with Nosql Databases and Messaging systems like Kafka....