Big Data Engineer

5 days ago

Bengaluru, Karnataka, India Talent Worx Full time ₹ 15,00,000 - ₹ 20,00,000 per year

Location – Pune/Chennai
Exp - 6 to 9

Requirements

Technology: - Big Data (Hadoop, Hive, Spark, Scala, PLSQL/ No SQL Database)

Knowledge/Experience (Must):

· 6-9 years of experience in Hadoop/big data technologies.

· Experience with Spark/Storm/Kafka or equivalent streaming/batch processing and event

based messaging.

· Relational and NoSQL database integration and data distribution principles experience

· Hands-on experience with the Hadoop eco-system (HDFS, MapReduce, Hive, Pig, Impala,

Spark, Kafka, Kudu, Solr)

· Experience with API development and use of JSON/XML/Hypermedia data formats.

· Strong development/automation skills

· Experience with all aspects of DevOps (source control, continuous integration,

deployments, etc.)

· 5+ years of hands-on experience as a Scala developer (with previous Java background)

Knowledge/Experience (Preferred):

· Experience in Core Banking functionality for generating various hand-offs

· Experience with containerization and related technologies (e.g. Docker, Kubernetes)

· Comprehensive knowledge of the principles of software engineering and data analytics

· Knowledge of agile(scrum) development methodology is a plus

· Cloudera/Hortonworks/AWS EMR, S3 experience a plus

Qualifications:

Strong academic record, ideally with a bachelor's degree in engineering/mathematical or scientific

background.

· Strong Communication skills

· Self-Motivated

· Willingness to learn.

· Excellent planning and organizational skills

  • Big Data Engineer

    5 days ago

    Bengaluru, Karnataka, India Coders Brain Full time

    Job DescriptionRoles and Responsibilities:- Develop scalable infrastructure and platform to collect, analyze and process large amounts of structured and unstructured data with real-time data interpretation.- Work closely across an array of various teams and organizations in the company (including partners, customers)Basic Qualifications:- Bachelor's degree...

  • Big Data Engineer

    23 hours ago

    Bengaluru, Karnataka, India Xebia Full time

    We're Hiring – Big Data Engineer (Scala + Spark)&## ; Location: Bangalore – Whitefield (Hybrid: 3 Days Office / Week)&##Availability: Immediate to Max 2 Weeks Notice Big Data & Hadoop Ecosystem Python Data Structures & Algorithms Design & Coding Skills Experience in distributed data processing & performance optimization At Xebia, you'll be part of a...

  • Big Data Engineer

    3 days ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Big Data EngineerOverviewWe are seeking a highly skilled professional to design, develop and implement large-scale data engineering solutions.The ideal candidate will be part of a fast-paced team focused on delivering cutting-edge technology and product roadmaps.The team is responsible for developing marketing campaign tracking capabilities using...

  • Big Data Engineer

    5 days ago

    Bengaluru, Karnataka, India Xebia Full time

    We're Hiring – Big Data Engineer (Scala + Spark)Location: Bangalore – Whitefield (Hybrid: 3 Days Office / Week)Budget: Up to 30 LPAAvailability: Immediate to Max 2 Weeks NoticeMust Have Skills:Scala & Spark (Mandatory)Big Data & Hadoop EcosystemHive, Kafka, OoziePythonData Structures & AlgorithmsDesign & Coding SkillsCI/CD PipelinesProblem Solving...

  • Big Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India Xebia Full time

    ???? We're Hiring – Big Data Engineer (Scala + Spark)???? Location: Bangalore – Whitefield (Hybrid: 3 Days Office / Week)???? Budget: Up to 30 LPA???? Availability: Immediate to Max 2 Weeks NoticeMust Have Skills:Scala & Spark (Mandatory)Big Data & Hadoop EcosystemHive, Kafka, OoziePythonData Structures & AlgorithmsDesign & Coding SkillsCI/CD...

  • Big Data Engineer

    4 days ago

    Bengaluru, Karnataka, India RiskInsight Consulting Pvt Ltd Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    ResponsibilitiesDesign, develop, and implement robust Big Data solutions using technologies such as Hadoop, Spark, and NoSQL databases. Build and maintain scalable data pipelines for effective data ingestion, transformation, and analysis. Collaborate with data scientists, analysts, and cross-functional teams to understand business requirements and translate...

  • Big Data Engineering Specialist

    5 days ago

    Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 10,00,000 - ₹ 15,00,000

    Job OverviewThe role of a Data Solutions Engineer is to develop and implement large-scale data processing systems that can handle structured and unstructured data with real-time interpretation.Key ResponsibilitiesDesign and build scalable infrastructure for big data collection, analysis, and processing.Collaborate closely with cross-functional teams and...

  • Senior Big Data Engineer

    9 hours ago

    Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 1,04,000 - ₹ 1,30,878

    ">Big Data Engineer">Job Description: As a senior big data engineer, you will play a key role in designing and implementing large-scale data processing systems. You will work with cross-functional teams to develop and deploy data pipelines that integrate with various data sources and enable business insights.">Develop scalable and efficient data pipelines...

  • Senior Big Data Engineer

    1 day ago

    Bengaluru, Karnataka, India beBeeBigData Full time ₹ 20,00,000 - ₹ 35,00,000

    We are looking for a seasoned big data professional with expertise in Scala and cloud technologies to lead our data engineering efforts.Job DescriptionThe ideal candidate will have hands-on experience designing, developing, and optimizing data pipelines and ETL workflows using Hadoop, Apache Airflow, Kubernetes, and Containers. They will work closely with...

  • Big Data Engineer

    4 weeks ago

    Bengaluru, Karnataka, India Xebia Full time

    We're Hiring – Big Data Engineer (Scala + Spark) Location: Bangalore – Whitefield (Hybrid: 3 Days Office / Week) Budget: Up to 30 LPA Availability: Immediate to Max 2 Weeks NoticeMust Have Skills:- Scala & Spark (Mandatory)- Big Data & Hadoop Ecosystem- Hive, Kafka, Oozie- Python- Data Structures & Algorithms- Design & Coding Skills- CI/CD Pipelines-...