Big Data Consultant

3 weeks ago


Bangalore, Karnataka, India Nilasu consulting Full time

Summary :

We are seeking a highly skilled consultant with expertise in Spark/Scala and Python to join our team.

You will play a key role in developing and maintaining big data applications using Spark and Scala with a focus on functional programming principles.

Additionally, your experience in Python and microservices architecture will be valuable in building scalable and robust big data solutions.

Responsibilities :

- Design, develop, and maintain Spark Scala applications for big data processing tasks, emphasizing functional programming paradigms.

- Develop and implement Scala microservices and APIs for efficient data access and integration.

- Leverage your expertise in big data technologies like Hadoop, Spark, and Hive to build and manage data pipelines.

- Collaborate with data engineers, scientists, and analysts to understand data requirements and translate them into effective big data solutions.

- Participate in code reviews and ensure adherence to coding best practices and maintainability standards.

- Stay up-to-date with the latest advancements in big data technologies and frameworks.

Qualifications :

- Bachelor's degree in Computer Science or a related field.

- Minimum of 4 years of experience in Spark Scala programming.

- Proficiency in Python programming with experience in data analysis libraries (e.g., NumPy, Pandas).

- Strong understanding of big data concepts, data processing paradigms, and distributed computing frameworks.

- Familiarity with Apache Hadoop ecosystem tools like YARN, HDFS, and MapReduce (preferred).

- Experience with Apache Hive for data warehousing and querying (preferred).

- Experience with microservices architecture and API development (preferred).

- Solid understanding of functional programming principles.

- Excellent problem-solving and analytical skills.

- Effective communication and collaboration skills.

(ref:hirist.tech)
  • Data Architect

    3 weeks ago


    Bangalore, Karnataka, India Indium Software Full time

    Job Description :We are looking for a highly experienced Data Architect to join our team. The ideal candidate will have over a decade of experience with Big Data technologies, including Apache Spark, Kafka, Cloud Native solutions, and Data Lakes. This role involves working in a customer-facing, post-sales capacity, focusing on technical architecture and...

  • Data Architect

    3 weeks ago


    Bangalore, Karnataka, India Indium Software Full time

    Job Description :We are looking for a highly experienced Data Architect to join our team. The ideal candidate will have over a decade of experience with Big Data technologies, including Apache Spark, Kafka, Cloud Native solutions, and Data Lakes. This role involves working in a customer-facing, post-sales capacity, focusing on technical architecture and...

  • Technical Lead

    4 days ago


    Bangalore, Karnataka, India Strategic HR Solutions Full time

    Job DescriptionAs a Technical Lead, you will be responsible for building a highly-scalable and extensible big data platform that provides the foundation for collecting, storing, modeling, and analyzing massive data sets from multiple channels. This position reports to the Engineering manager. Responsibilities: - Align our client with key Client initiatives -...

  • Unison Consulting

    2 months ago


    Bangalore, Karnataka, India Unison consulting pte ltd Full time

    About the Role:We are seeking a talented Solution Architect to join our team and play a key role in designing and implementing innovative big data solutions. You will be responsible for translating business needs into scalable, reliable, and high-performance technology architectures, leveraging your expertise in Databricks and other big data technologies....

  • Unison Consulting

    3 weeks ago


    Bangalore, Karnataka, India Unison consulting pte ltd Full time

    About the Role:We are seeking a talented Solution Architect to join our team and play a key role in designing and implementing innovative big data solutions. You will be responsible for translating business needs into scalable, reliable, and high-performance technology architectures, leveraging your expertise in Databricks and other big data technologies....

  • Technical Lead

    4 days ago


    Bangalore, Karnataka, India Suitable.AI Full time

    Job Description :As a Technical Lead, you will be responsible for building a highly-scalable and extensible big data platform that provides the foundation for collecting, storing, modeling, and analyzing massive data sets from multiple channels.This position reports to the Engineering manager. Responsibilities : Align Sigmoid with key Client initiatives ...

  • Technical Lead

    4 days ago


    Bangalore, Karnataka, India Suitable.AI Full time

    Job DescriptionAs a Technical Lead, you will be responsible for building a highly-scalable and extensible big data platform that provides the foundation for collecting, storing, modeling, and analyzing massive data sets from multiple channels. This position reports to the Engineering manager. Responsibilities : Align with key Client initiatives :- Interface...

  • Data Engineer

    4 days ago


    Bangalore/Hyderabad, Karnataka, India Pan Asia Man power Consultants Recruiting agency Full time

    Data EngineerExperience Range : 6 to 14 YearsLocation : Bangalore (Hybrid: Work From Office - 3 Days in a Week)Full Time Skill Sets :- Experience designing and implementing data pipelines- Experience with SQL, RDBMS, or other data management, reporting and query tools.- Big Data Technologies - Hadoop, Hive, Spark, KafkaSecondary Skill Sets :- Added advantage...

  • Unison Consulting

    2 months ago


    Bangalore, Karnataka, India Unison consulting pte ltd Full time

    We are seeking a talented Big Data Engineer to join our team and play a key role in designing, developing, and maintaining our big data infrastructure. You will leverage your expertise in Java, Hadoop, and Kafka to build efficient data pipelines, handle real-time data streams, and ensure high-quality data processing for our data analytics...

  • Unison Consulting

    3 weeks ago


    Bangalore, Karnataka, India Unison consulting pte ltd Full time

    We are seeking a talented Big Data Engineer to join our team and play a key role in designing, developing, and maintaining our big data infrastructure. You will leverage your expertise in Java, Hadoop, and Kafka to build efficient data pipelines, handle real-time data streams, and ensure high-quality data processing for our data analytics...

  • Big Data Engineer

    4 days ago


    Bangalore, Karnataka, India WEN Full time

    Role : Big Data Engineer (Scala)Responsibilities :- Develop and maintain scalable data pipelines using Spark and Hive within the Hadoop ecosystem- Utilize Scala programming language to implement efficient data processing solutions- Collaborate with cross-functional teams to understand data requirements and deliver optimal solutions- Implement best practices...

  • Senior Data Engineer

    2 months ago


    Bangalore, Karnataka, India Squareroot Consulting Pvt Ltd Full time

    We are seeking a highly skilled and experienced Senior Data Engineer to join our team.Location : Bangalore (Work from Office all 5 days)Experience : 6+ YearsRole : Senior Data EngineerThe ideal candidate will have a strong background in big data technologies and extensive hands-on experience with Cloudera, Spark, Hive, HDFS, Flink, Data Lake, and...

  • Senior Data Engineer

    3 weeks ago


    Bangalore, Karnataka, India Squareroot Consulting Pvt Ltd Full time

    We are seeking a highly skilled and experienced Senior Data Engineer to join our team.Location : Bangalore (Work from Office all 5 days)Experience : 6+ YearsRole : Senior Data EngineerThe ideal candidate will have a strong background in big data technologies and extensive hands-on experience with Cloudera, Spark, Hive, HDFS, Flink, Data Lake, and...

  • Big Data Engineer

    2 months ago


    Bangalore, Karnataka, India randstad Full time

    Primary Responsibilities :- Design, develop, and implement big data solutions using Java, Python, or Scala.- Utilize SQL and Spark Scala for data processing and analysis.- Implement and manage data storage solutions using AWS services like S3, EC2, and Lambda.- Work with various databases such as Postgres, MySQL, Oracle, etc., for data storage and...

  • Big Data Engineer

    3 weeks ago


    Bangalore, Karnataka, India Randstad Full time

    Primary Responsibilities :- Design, develop, and implement big data solutions using Java, Python, or Scala.- Utilize SQL and Spark Scala for data processing and analysis.- Implement and manage data storage solutions using AWS services like S3, EC2, and Lambda.- Work with various databases such as Postgres, MySQL, Oracle, etc., for data storage and...


  • Bangalore, Karnataka, India Marktine Technology Solutions Full time

    Must Have Skills :- Solid Knowledge on DWH, ETL and Big Data Concepts- Excellent SQL Skills (With knowledge of SQL Analytics Functions)- Working Experience on any ETL tool i.e. SSIS / Informatica- Working Experience on any Azure or AWS Big Data Tools.- Experience on Implementing Data Jobs (Batch / Real time Streaming)- Excellent written and verbal...

  • Databricks Architect

    2 months ago


    Bangalore, Karnataka, India TecHHire Global Full time

    Job Description :Function : Technical Management - Engineering Management, Software Engineering - Backend Development, Big Data / DWH / ETLResponsibilities :- Design and implement large-scale data processing systems using the Databricks platform.- Work closely with clients to understand their requirements and design solutions that meet their needs.-...

  • Databricks Architect

    3 weeks ago


    Bangalore, Karnataka, India TecHHire Global Full time

    Job Description :Function : Technical Management - Engineering Management, Software Engineering - Backend Development, Big Data / DWH / ETLResponsibilities :- Design and implement large-scale data processing systems using the Databricks platform.- Work closely with clients to understand their requirements and design solutions that meet their needs.-...

  • Big Data Developer

    2 months ago


    Bangalore, Karnataka, India Codersbrain technology pvt ltd Full time

    Salary : 12 - 20 LPARequirements :- Bachelor's/Master's degree in Computer Science, Engineering, or a related field.- Master's degree preferred.- Proven experience as a Big Data Developer or similar role, with strong knowledge of Big Data and Hadoop ecosystems.- Hands-on experience with HDFS, Spark, MapReduce, Sqoop, and Hive.- Experience in...

  • Lead Data Engineer

    4 days ago


    Bangalore, Karnataka, India NINETY1 GLOBAL CONSULTING PRIVATE LIMITED Full time

    Job Description:Experience: 8-12 yearsLocation: Bangalore (WFO)- 8 years' experience in developing scalable Big Data applications or solutions on distributed platforms. - Able to partner with others in solving complex problems by taking a broad perspective to identify innovative solutions.- Strong skills building positive relationships across Product and...