BigData Engineer

1 month ago

Bengaluru, India Fractal Full time
It's fun to work in a company where people truly BELIEVE in what they are doing
The BigData Engineers have expertise in building horizontally scalable applications using distributed technologies like NoSQL Dbs/Hadoop/Spark and others and we execute projects on-premise and cloud based systems. The AI-Engineers and MLOps Engineers work on scaling AI-systems and in building end-to-end productionized MLOps pipelines.
RESPONSIBILITIES:
Our Big Data capability team needs hands-on developers who can produce beautiful & functional code to solve complex analytics problems. If you are an exceptional developer with an aptitude to learn and implement using new technologies, and who loves to push the boundaries to solve complex business problems innovatively, then we would like to talk with you.
You would be responsible for evaluating, developing, maintaining, and testing big data solutions for advanced analytics projects.
The role would involve big data pre-processing & reporting workflows including collecting, parsing, managing, analyzing and visualizing large sets of data to turn information into business insights.
The role would also involve testing various machine learning models on Big Data and deploying learned models for ongoing scoring and prediction. An appreciation of the mechanics of complex machine learning algorithms would be a strong advantage.
QUALIFICATIONS:
Demonstrable experience designing technological solutions to complex data problems, developing & testing modular, reusable, efficient and scalable code to implement those solutions.
Ideally, this would include work on the following technologies:
Expert-level proficiency in at-least one of Java, C++, or Python (preferred). Scala knowledge a strong advantage
Strong understanding and experience in distributed computing frameworks, particularly Apache Hadoop 2.0 (YARN; MR & HDFS) and associated technologies -- one or more of Hive, Sqoop, Avro, Flume, Oozie, Zookeeper, etc.
Hands-on experience with Apache Spark and its components (Streaming, SQL, MLLib) is a strong advantage.
Operating knowledge of cloud computing platforms (AWS, especially EMR, EC2, S3, SWF services and the AWS CLI)
Experience working within a Linux computing environment, and use of command line tools including knowledge of shell/Python scripting for automating common tasks.
Ability to work in a team in an agile setting, familiarity with JIRA and clear understanding of how Git works.
Linux environment and shell scripting
If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us
Not the right fit? Let us know you're interested in a future opportunity by clickingin the top-right corner of the page or create an account to set up email alerts as new job postings become available that meet your interest

  • Gcp + Bigdata

    2 weeks ago

    Bengaluru, India LTIMindtree Full time

    Primary Skills: Hands on experience is mandatory for the GCP, Python/Java, Spark, SQL and Bigdata. Expereince- 5 to 12 years Location- Gurgaon & Bangalore • Must Have Qualifications: o Masters in computer applications or equivalent OR Bachelor degree in engineering or computer science or equivalent. o Deep understanding of Hadoop and Spark Architecture...

  • GCP + Bigdata

    2 months ago

    Bengaluru, India LTIMindtree Full time

    Primary Skills: Hands on experience is mandatory for the GCP, Python/Java, Spark, SQL and Bigdata. Expereince- 5 to 12 years Location- Gurgaon & Bangalore • Must Have Qualifications: o Masters in computer applications or equivalent OR Bachelor degree in engineering or computer science or equivalent. o Deep understanding of Hadoop and Spark Architecture and...

  • GCP + Bigdata

    2 months ago

    Bengaluru, India LTIMindtree Full time

    Primary Skills: Hands on experience is mandatory for the GCP, Python/Java, Spark, SQL and Bigdata.Expereince- 5 to 12 yearsLocation- Gurgaon & Bangalore• Must Have Qualifications:o Masters in computer applications or equivalent OR Bachelor degree in engineering or computer science or equivalent.o Deep understanding of Hadoop and Spark Architecture and its...

  • Lead Data Developer

    3 weeks ago

    Bengaluru, India Airbus Full time

    Qualification & Experience :● Graduate in an area such as Information Technology, Engineering . ● At least 8 years experience in BigData Development. ○ Strong Hands On Experience on Python, PySpark, Java Script ● Primary Skills ○ Knowledge of SQL and relational databases ○ Proficiency in developing, deploying, and debugging data-objects, and data...

  • Lead Data Developer

    3 weeks ago

    Bengaluru, India Airbus Full time

    Qualification & Experience : ● Graduate in an area such as Information Technology, Engineering . ● At least 8 years experience in BigData Development. ○ Strong Hands On Experience on Python, PySpark, Java Script ● Primary Skills ○ Knowledge of SQL and relational databases ○ Proficiency in developing, deploying, and debugging...

  • Azure Bigdata Specialist

    3 weeks ago

    Bengaluru, India Bosch Group Full time

    Job DescriptionData Engineer/Azure Bigdata Specialist :We are looking for a Data Engineer to join our growing team of analytics experts. The hire will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. The ideal candidate is an experienced data...

  • Azure Bigdata Specialist

    4 weeks ago

    Bengaluru, India Bosch Full time

    Job Description Data Engineer/Azure Bigdata Specialist :We are looking for a Data Engineer to join our growing team of analytics experts. The hire will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. The ideal candidate is an experienced data...

  • Azure Bigdata Specialist

    4 weeks ago

    Bengaluru, India Bosch Group Full time

    Job DescriptionData Engineer/Azure Bigdata Specialist :We are looking for a Data Engineer to join our growing team of analytics experts. The hire will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. The ideal candidate is an experienced data...

  • BigData Engineer

    2 weeks ago

    Bengaluru, India Grid Dynamics Full time

    Experience- 4-8 YearsLocation- BangaloreNotice- Less than 15 daysJob Description:Must Have: (All or expertise in few).basic data structure, algorithms, and problem-solving knowledgeJava programming, Spring Framework, and Spring BootFunctional programming: Scala/PythonBig data: Hadoop (Spark and Hive)Any RDBMS (preferably MySQL)Hands-on multithreading and...

  • BigData Engineer

    4 weeks ago

    Bengaluru, India Grid Dynamics Full time

    Experience- 4-8 YearsLocation- BangaloreNotice- Less than 15 daysJob Description:Must Have: (All or expertise in few).basic data structure, algorithms, and problem-solving knowledgeJava programming, Spring Framework, and Spring BootFunctional programming: Scala/PythonBig data: Hadoop (Spark and Hive)Any RDBMS (preferably MySQL)Hands-on multithreading and...

  • Engineering Manager

    1 week ago

    Bengaluru, India Sony Pictures Networks India Private Limited Full time

    Position:Engineering Manager – BigData, Digital BusinessPurpose:This position is required to provide technology leadership on medium to large scale products/platform with internal and direct customer impact.Education:./, MCA or Equivalent Computer DegreePurpose:The incumbent will direct the development and implementation of Big data and analytics solutions...

  • BigData Engineer

    3 weeks ago

    Bengaluru, India Grid Dynamics Full time

    Experience- 4-8 Years Location- Bangalore Notice- Less than 15 days Job Description: Must Have: (All or expertise in few). basic data structure, algorithms, and problem-solving knowledge Java programming, Spring Framework, and Spring Boot Functional programming: Scala/Python Big data: Hadoop (Spark and Hive) Any RDBMS (preferably MySQL) Hands-on...

  • BigData Engineer

    4 weeks ago

    Bengaluru, India Grid Dynamics Full time

    Experience- 4-8 YearsLocation- BangaloreNotice- Less than 15 daysJob Description:- Must Have: (All or expertise in few).- basic data structure, algorithms, and problem-solving knowledge- Java programming, Spring Framework, and Spring Boot- Functional programming: Scala/Python- Big data: Hadoop (Spark and Hive)- Any RDBMS (preferably MySQL)- Hands-on...

  • BigData Engineer

    4 weeks ago

    Bengaluru, India Grid Dynamics Full time

    Experience- 4-8 YearsLocation- BangaloreNotice- Less than 15 daysJob Description:Must Have: (All or expertise in few).basic data structure, algorithms, and problem-solving knowledgeJava programming, Spring Framework, and Spring BootFunctional programming: Scala/PythonBig data: Hadoop (Spark and Hive)Any RDBMS (preferably MySQL)Hands-on multithreading and...

  • BigData Engineer

    4 weeks ago

    Bengaluru, India Grid Dynamics Full time

    Experience- 4-8 YearsLocation- BangaloreNotice- Less than 15 daysJob Description:Must Have: (All or expertise in few).basic data structure, algorithms, and problem-solving knowledgeJava programming, Spring Framework, and Spring BootFunctional programming: Scala/PythonBig data: Hadoop (Spark and Hive)Any RDBMS (preferably MySQL)Hands-on multithreading and...

  • Nielsen - Software Engineer - Bigdata Java/Scala and SQL

    4 weeks ago

    Bengaluru, Karnataka, India timesjobs Full time

    Software Engineer - Bigdata (Java/Scala and SQL)Location: Bangalore, IndiaTechnology: OtherEmployment Type: Full TimeWork Environment: HybridAt Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help you to...

  • Engineering Manager

    2 months ago

    Bengaluru, India Sony Pictures Networks India Private Limited Full time

    Position: Engineering Manager – BigData, Digital Business Purpose: This position is required to provide technology leadership on medium to large scale products/platform with internal and direct customer impact. Education: ./, MCA or Equivalent Computer Degree Purpose:   The incumbent will direct the development and implementation of Big...

  • Java Software Engineer

    6 days ago

    Bengaluru, India UST Full time

    Software Engineer (Core Java, Elastic Search/Solr) Bangalore Job Description: Good Experience on core java. Experience on any web framework like Spring Boot. Experience on indexing and querying data from Elasticsearch with variety of data sources. Experience writing data discovery, analytics and Visualization application using Elasticsearch. Experience...

  • Senior Data Engineer

    2 weeks ago

    Bengaluru, India Prescience Decision Solutions Full time

    Job DescriptionContribute to the development and maintenance of ETL jobs and components utilizing Apache Spark, Python, Pyspark, Talend, Kafka, Hadoop, Airflow, and GCP technologies.Engage in requirement gathering, analysis, and translation of functional requirements into technical tasks using Spark/Airflow.Produce comprehensive Technical ETL design...

  • Specialist Software Engineer

    2 months ago

    Bengaluru, India Société Générale Assurances Full time

    Specialist Software Engineer - BigData Permanent contract|Bangalore|IT (Information Technology) Specialist Software Engineer - BigData Bangalore, India Permanent contract IT (Information Technology) Responsibilities Responsible for understanding the software requirements and developing it into a working source code accordingly. ...