Big Data Engineer

3 weeks ago


Bangalore, Karnataka, India Randstad Full time

Primary Responsibilities :

- Design, develop, and implement big data solutions using Java, Python, or Scala.

- Utilize SQL and Spark Scala for data processing and analysis.

- Implement and manage data storage solutions using AWS services like S3, EC2, and Lambda.

- Work with various databases such as Postgres, MySQL, Oracle, etc., for data storage and retrieval.

- Develop and maintain applications using frameworks like Java/J2EE, Spring Boot, and cloud frameworks.

- Implement infrastructure as code using Terraform and Cloud Formation for cloud resources provisioning and management.

- Collaborate with cross-functional teams to define, design, and deliver big data solutions.

- Participate in Agile/Scrum methodologies, contributing to sprint planning, daily stand-ups, and retrospectives.

- Troubleshoot and optimize existing big data pipelines and applications for performance and scalability.

Key Skills and Qualifications :

- Bachelor's/Master's degree in Computer Science, Information Technology, or a related field.

- Experience in Java, Python, or Scala for big data processing and analytics.

- Proficiency in SQL and Spark Scala for data manipulation and querying.

- Hands-on experience with AWS services such as S3, EC2, and Lambda.

- Experience with databases like Postgres, MySQL, Oracle, etc.

- Knowledge of Java/J2EE, Spring Boot, and cloud frameworks.

- Familiarity with Terraform and Cloud Formation for infrastructure management.

- Strong understanding of Agile/Scrum methodologies.

- Excellent problem-solving, analytical, and communication skills.

Salary : 15-25LPA

(ref:hirist.tech)
  • Senior Data Engineer

    2 months ago


    Bangalore, Karnataka, India Squareroot Consulting Pvt Ltd Full time

    We are seeking a highly skilled and experienced Senior Data Engineer to join our team.Location : Bangalore (Work from Office all 5 days)Experience : 6+ YearsRole : Senior Data EngineerThe ideal candidate will have a strong background in big data technologies and extensive hands-on experience with Cloudera, Spark, Hive, HDFS, Flink, Data Lake, and...

  • Senior Data Engineer

    3 weeks ago


    Bangalore, Karnataka, India Squareroot Consulting Pvt Ltd Full time

    We are seeking a highly skilled and experienced Senior Data Engineer to join our team.Location : Bangalore (Work from Office all 5 days)Experience : 6+ YearsRole : Senior Data EngineerThe ideal candidate will have a strong background in big data technologies and extensive hands-on experience with Cloudera, Spark, Hive, HDFS, Flink, Data Lake, and...

  • Big Data Engineer

    4 days ago


    Bangalore, Karnataka, India WEN Full time

    Role : Big Data Engineer (Scala)Responsibilities :- Develop and maintain scalable data pipelines using Spark and Hive within the Hadoop ecosystem- Utilize Scala programming language to implement efficient data processing solutions- Collaborate with cross-functional teams to understand data requirements and deliver optimal solutions- Implement best practices...

  • Data Engineer

    4 days ago


    Bangalore/Hyderabad, Karnataka, India Pan Asia Man power Consultants Recruiting agency Full time

    Data EngineerExperience Range : 6 to 14 YearsLocation : Bangalore (Hybrid: Work From Office - 3 Days in a Week)Full Time Skill Sets :- Experience designing and implementing data pipelines- Experience with SQL, RDBMS, or other data management, reporting and query tools.- Big Data Technologies - Hadoop, Hive, Spark, KafkaSecondary Skill Sets :- Added advantage...


  • Bangalore, Karnataka, India Marktine Technology Solutions Full time

    Must Have Skills :- Solid Knowledge on DWH, ETL and Big Data Concepts- Excellent SQL Skills (With knowledge of SQL Analytics Functions)- Working Experience on any ETL tool i.e. SSIS / Informatica- Working Experience on any Azure or AWS Big Data Tools.- Experience on Implementing Data Jobs (Batch / Real time Streaming)- Excellent written and verbal...

  • Lead Data Engineer

    4 days ago


    Bangalore, Karnataka, India NINETY1 GLOBAL CONSULTING PRIVATE LIMITED Full time

    Job Description:Experience: 8-12 yearsLocation: Bangalore (WFO)- 8 years' experience in developing scalable Big Data applications or solutions on distributed platforms. - Able to partner with others in solving complex problems by taking a broad perspective to identify innovative solutions.- Strong skills building positive relationships across Product and...

  • Data Architect

    3 weeks ago


    Bangalore, Karnataka, India Indium Software Full time

    Job Description :We are looking for a highly experienced Data Architect to join our team. The ideal candidate will have over a decade of experience with Big Data technologies, including Apache Spark, Kafka, Cloud Native solutions, and Data Lakes. This role involves working in a customer-facing, post-sales capacity, focusing on technical architecture and...

  • Data Architect

    3 weeks ago


    Bangalore, Karnataka, India Indium Software Full time

    Job Description :We are looking for a highly experienced Data Architect to join our team. The ideal candidate will have over a decade of experience with Big Data technologies, including Apache Spark, Kafka, Cloud Native solutions, and Data Lakes. This role involves working in a customer-facing, post-sales capacity, focusing on technical architecture and...

  • Product Architect

    3 weeks ago


    Bangalore, Karnataka, India Experis IT Private Limited Full time

    REQUIREMENTS :Qualification : Bachelors / MastersExperience : 6.5-9 Years Job Location : BangaloreJob Type : Full timeROLES and RESPONSIBILITIES :- Working closely with the client to understand the business use case, build the data architecture, build the data pipeline, by using scalable, highly available and fault tolerant services in big data. - Provide...

  • Product Architect

    3 weeks ago


    Bangalore, Karnataka, India Experis IT Private Limited Full time

    REQUIREMENTS :Qualification : Bachelors / MastersExperience : 6.5-9 Years Job Location : BangaloreJob Type : Full timeROLES and RESPONSIBILITIES :- Working closely with the client to understand the business use case, build the data architecture, build the data pipeline, by using scalable, highly available and fault tolerant services in big data. - Provide...

  • Software Engineer

    2 months ago


    Bangalore, Karnataka, India symphoni HR Full time

    Skill: Java (Data structures/Algorithims) & Spark - Design, develop and implement, scalable, maintainable, and efficient software solutions using best practices and modern technologies. - Write clean, well designed, and testable code, following coding standards and guidelines. - Conduct code reviews and provide constructive feedback to team members to ensure...

  • Software Engineer

    3 weeks ago


    Bangalore, Karnataka, India symphoni HR Full time

    Skill: Java (Data structures/Algorithims) & Spark - Design, develop and implement, scalable, maintainable, and efficient software solutions using best practices and modern technologies. - Write clean, well designed, and testable code, following coding standards and guidelines. - Conduct code reviews and provide constructive feedback to team members to ensure...

  • Data Engineer

    2 months ago


    Bangalore, Karnataka, India LOGIC PLANET IT SERVICES Full time

    About the job :We are hiring for a global technology company, home to more than 224,000 people across 60 countries.Role : Data EngineerExp : 5+ years Mode of Work : HybridMode of Hire : FTEAvailability : Immediate joinee or serving maximum of 30 days notice period.Job Description :- 5+ years of experience operating and deploying solutions using AWS Service...


  • Bangalore, Karnataka, India Thoucentric Full time

    Job Description :As a Big Data Engineer, you will be responsible for designing, developing, and maintaining our big data infrastructure. You will work with large datasets, perform data processing, and support various business functions by creating data pipelines, data processing jobs, and data integration solutions. You will be working in a dynamic and...


  • Bangalore, Karnataka, India Thoucentric Full time

    Job Description :As a Big Data Engineer, you will be responsible for designing, developing, and maintaining our big data infrastructure. You will work with large datasets, perform data processing, and support various business functions by creating data pipelines, data processing jobs, and data integration solutions. You will be working in a dynamic and...

  • Databricks Architect

    2 months ago


    Bangalore, Karnataka, India TecHHire Global Full time

    Job Description :Function : Technical Management - Engineering Management, Software Engineering - Backend Development, Big Data / DWH / ETLResponsibilities :- Design and implement large-scale data processing systems using the Databricks platform.- Work closely with clients to understand their requirements and design solutions that meet their needs.-...

  • Databricks Architect

    3 weeks ago


    Bangalore, Karnataka, India TecHHire Global Full time

    Job Description :Function : Technical Management - Engineering Management, Software Engineering - Backend Development, Big Data / DWH / ETLResponsibilities :- Design and implement large-scale data processing systems using the Databricks platform.- Work closely with clients to understand their requirements and design solutions that meet their needs.-...

  • Technical Lead

    4 days ago


    Bangalore, Karnataka, India Strategic HR Solutions Full time

    Job DescriptionAs a Technical Lead, you will be responsible for building a highly-scalable and extensible big data platform that provides the foundation for collecting, storing, modeling, and analyzing massive data sets from multiple channels. This position reports to the Engineering manager. Responsibilities: - Align our client with key Client initiatives -...

  • Big Data Consultant

    2 months ago


    Bangalore, Karnataka, India Nilasu consulting Full time

    Summary :We are seeking a highly skilled consultant with expertise in Spark/Scala and Python to join our team. You will play a key role in developing and maintaining big data applications using Spark and Scala with a focus on functional programming principles. Additionally, your experience in Python and microservices architecture will be valuable in building...

  • Big Data Consultant

    3 weeks ago


    Bangalore, Karnataka, India Nilasu consulting Full time

    Summary :We are seeking a highly skilled consultant with expertise in Spark/Scala and Python to join our team. You will play a key role in developing and maintaining big data applications using Spark and Scala with a focus on functional programming principles. Additionally, your experience in Python and microservices architecture will be valuable in building...