Big Data Engineer

1 day ago

Bengaluru, India Coders Brain Full time

Job Description

Roles and Responsibilities:

- Develop scalable infrastructure and platform to collect, analyze and process large amounts of structured and unstructured data with real-time data interpretation.
- Work closely across an array of various teams and organizations in the company (including partners, customers)

Basic Qualifications:

- Bachelor's degree in Engineering in Computer Science/Electronics & Telecommunication.Minimum of 2 year of Big Data experience

Preferred Qualifications:

- 5+ years of software development experience using multiple computer languages.
- Experience building large scale distributed data processing systems/applications or large-scale internet systems (cloud computing)
- Strong foundational knowledge and experience with distributed systems and computing systems in general.
- Hands-on engineering skills.
- Should be able to develop big data solution and how that big data solution can be delivered using big data technology such as Hadoop/HDFS, MapReduce, Hive, AWS EMR, MongoDB, Airflow, Oozie,, Yarn, Ambari, ZooKeeper; Sqoop, BIRT or any other big data frameworks(with full life cycle of Hadoop Solution)
- Hands-on experience with Hadoop applications (e.g. administration, configuration management, monitoring, debugging, and performance tuning).
- Firm understanding of major programming/scripting languages like Java, Linux, Ruby, Kafka, Camunda,Phyton and/or R, Shell script.
- Should be able to build a big data environment on premises or in thecloudBroad understanding and experience of real-time analytics, NoSQL data stores, data modeling and data management, analytical tools, languages, or libraries (e.g. SAS, SPSS, R, Mahout).
- Experience with deploying container based applications using tools such as DockerExperience developing API centric solutions (REST API)

  • Big Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India Coders Brain Full time

    Job DescriptionRoles and Responsibilities:- Develop scalable infrastructure and platform to collect, analyze and process large amounts of structured and unstructured data with real-time data interpretation.- Work closely across an array of various teams and organizations in the company (including partners, customers)Basic Qualifications:- Bachelor's degree...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Reveille Technologies,Inc Full time ₹ 1,04,000 - ₹ 13,39,200 per year

    We're Hiring: Big Data Engineer – Full-TimeLooking for a skilledBig Data Engineerto join our team inBangaloreRole: Big Data EngineerGrade: G4 |TSRLocation: Bangalore (Onsite/Hybrid – specify if needed)Budget: ₹13,39,200Experience: 4–6 yearsSkills:Azure Databricks (ADB)PySparkSQLSpark (Scala/Python)TerraformAirflow & KubernetesData Warehousing &...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Xebia Full time

    We're Hiring – Big Data Engineer (Scala + Spark)&## ; Location: Bangalore – Whitefield (Hybrid: 3 Days Office / Week)&##Availability: Immediate to Max 2 Weeks Notice Big Data & Hadoop Ecosystem Python Data Structures & Algorithms Design & Coding Skills Experience in distributed data processing & performance optimization At Xebia, you'll be part of a...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India IT Firm Full time

    Role Overview :As a Big Data Engineer, you will be responsible for building and maintaining scalable data pipelines and architectures that support data analytics, reporting, and real-time processing. You will collaborate with data scientists, business analysts, and software engineers to design robust solutions that drive data-driven decisions.Mandatory Skill...

  • Big Data Engineer

    1 week ago

    Bengaluru, Karnataka, India The IT Firm Full time ₹ 1,50,000 - ₹ 28,00,000 per year

    Role OverviewAs a Big Data Engineer, you will be responsible for building and maintaining scalable data pipelines and architectures that support data analytics, reporting, and real-time processing. You will collaborate with data scientists, business analysts, and software engineers to design robust solutions that drive data-driven decisions.Mandatory Skill...

  • Big Data Solutions Engineer

    2 weeks ago

    Bengaluru, Karnataka, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Big Data Solutions EngineerWe are seeking a highly skilled and experienced Big Data Solutions Engineer to lead and manage our team of data engineers. As a key member of our organization, you will be responsible for designing, building, and maintaining scalable big data platforms and pipelines that meet the needs of our business.Your primary focus will be on...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 1,04,000 - ₹ 1,30,878

    Job Title: Big Data EngineerWe are seeking a highly skilled Big Data Engineer to join our team. As a key member of our data engineering team, you will play a critical role in designing, building, and maintaining large-scale data processing systems.This is an exceptional opportunity for a talented engineer who is passionate about working with big data...

  • Big Basket

    1 day ago

    Bengaluru, India Big Basket Full time

    What would you be doing/ Expected from this role? - Be responsible for Platforms Team roadmap and engineering execution from conceptualization to delivery of current and next-generation tools & technologies.- Manage release planning, execution, deployment of all tools maintained by Platforms Team, for running production and non-production environments...

  • Cloud Big Data Engineer

    6 days ago

    Bengaluru, Karnataka, India beBeeBigdataengineer Full time US$ 90,000 - US$ 1,20,000

    Cloud Big Data Engineering SpecialistWe are seeking a Cloud Big Data Engineering Specialist to join our team.

  • Big Data Engineer

    5 hours ago

    Bengaluru, Karnataka, India Suzva Software Technologies Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Hiring: Big Data Engineer (PySpark)Client: [Details will be shared upon shortlisting]Location: Bangalore (Onsite)Experience: 6-8 years (Relevant)Joining: Immediate to 15 days Key Skills: Strong hands-on experience in PySpark Expertise in Big Data technologies Solid understanding of SQL, Data Pipelines, and ETLInterested candidates can share their resume...