Big Data Engineer

3 weeks ago

Bengaluru, Karnataka, India Coders Brain Full time
Job Description

Roles and Responsibilities:

- Develop scalable infrastructure and platform to collect, analyze and process large amounts of structured and unstructured data with real-time data interpretation.
- Work closely across an array of various teams and organizations in the company (including partners, customers)

Basic Qualifications:

- Bachelor's degree in Engineering in Computer Science/Electronics & Telecommunication.Minimum of 2 year of Big Data experience

Preferred Qualifications:

- 5+ years of software development experience using multiple computer languages.
- Experience building large scale distributed data processing systems/applications or large-scale internet systems (cloud computing)
- Strong foundational knowledge and experience with distributed systems and computing systems in general.
- Hands-on engineering skills.
- Should be able to develop big data solution and how that big data solution can be delivered using big data technology such as Hadoop/HDFS, MapReduce, Hive, AWS EMR, MongoDB, Airflow, Oozie,, Yarn, Ambari, ZooKeeper; Sqoop, BIRT or any other big data frameworks(with full life cycle of Hadoop Solution)
- Hands-on experience with Hadoop applications (e.g. administration, configuration management, monitoring, debugging, and performance tuning).
- Firm understanding of major programming/scripting languages like Java, Linux, Ruby, Kafka, Camunda,Phyton and/or R, Shell script.
- Should be able to build a big data environment on premises or in thecloudBroad understanding and experience of real-time analytics, NoSQL data stores, data modeling and data management, analytical tools, languages, or libraries (e.g. SAS, SPSS, R, Mahout).
- Experience with deploying container based applications using tools such as DockerExperience developing API centric solutions (REST API)

  • Big Data Engineer

    2 days ago

    Bengaluru, Karnataka, India Etaclam Techno Services Full time ₹ 12,00,000 - ₹ 14,40,000 per year

    Job Title: Big Data EngineerLocation: BengaluruExperience Required: 5 to 8 yearsJob Description:We are looking for a skilled Big Data Engineer with strong hands-on experience in PySpark and SQL. This is a hybrid role, requiring the candidate to work both remotely and from the office as needed. The ideal candidate should be comfortable working on large-scale...

  • Big Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India IT Firm Full time

    Role Overview :As a Big Data Engineer, you will be responsible for building and maintaining scalable data pipelines and architectures that support data analytics, reporting, and real-time processing. You will collaborate with data scientists, business analysts, and software engineers to design robust solutions that drive data-driven decisions.Mandatory Skill...

  • Big Data Engineer

    2 days ago

    Bengaluru, Karnataka, India RiskInsight Consulting Pvt Ltd Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    ResponsibilitiesDesign, develop, and implement robust Big Data solutions using technologies such as Hadoop, Spark, and NoSQL databases. Build and maintain scalable data pipelines for effective data ingestion, transformation, and analysis. Collaborate with data scientists, analysts, and cross-functional teams to understand business requirements and translate...

  • Cloud Big Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India beBeeBigdataengineer Full time US$ 90,000 - US$ 1,20,000

    Cloud Big Data Engineering SpecialistWe are seeking a Cloud Big Data Engineering Specialist to join our team.

  • Big Data Engineer

    6 days ago

    Bengaluru, Karnataka, India Suzva Software Technologies Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Hiring: Big Data Engineer (PySpark)Client: [Details will be shared upon shortlisting]Location: Bangalore (Onsite)Experience: 6-8 years (Relevant)Joining: Immediate to 15 days Key Skills: Strong hands-on experience in PySpark Expertise in Big Data technologies Solid understanding of SQL, Data Pipelines, and ETLInterested candidates can share their resume...

  • Big Basket

    3 weeks ago

    Bengaluru, Karnataka, India big basket Full time

    As a Software Engineer we are looking for developers who share our passion for building world class software. If you are excited about the prospect of changing the way India shops for groceries and being a pioneer then this a great home for you. Not to mention the thrill of building products that millions use daily and using cutting edge technology to make...

  • Big Data Engineers/Senior Engineers

    6 days ago

    Bengaluru, Karnataka, India Peoplelogic Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Role: Big Data Engineers/Senior Engineers About the Role:We are seeking highly skilled Big Data Engineers/Senior Engineers with a strong background inbuilding and supporting big data solutions. The ideal candidate will have expertise in big datatechnologies, data pipeline development, and performance optimization within a collaborativeand agile...

  • Big Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India 4Bell Technology Full time

    Job Description :Core Responsibilities :- Design, build, and maintain robust data pipelines (batch or streaming) that process and transform data from diverse sources.- Ensure data quality, reliability, and availability across the pipeline lifecycle.- Collaborate with product managers, architects, and engineering leads to define technical strategy.-...

  • Big Basket

    3 weeks ago

    Bengaluru, Karnataka, India big basket Full time

    What would you be doing/ Expected from this role ?- Collaborate with cross-functional teams including data scientists, engineers, and product managers to deliver AI-driven solutions.- Drive the architecture of machine learning pipelines from data collection and preprocessing to model training, evaluation, and deployment.- Implement scalable machine learning...

  • Big Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India Xebia Full time

    We're Hiring – Big Data Engineer (Scala + Spark) Location: Bangalore – Whitefield (Hybrid: 3 Days Office / Week) Budget: Up to 30 LPA Availability: Immediate to Max 2 Weeks Notice Must Have Skills: Scala & Spark (Mandatory) Big Data & Hadoop Ecosystem Hive, Kafka, Oozie Python Data Structures & Algorithms Design & Coding Skills CI/CD Pipelines...