Big Data Engineer

6 days ago

Bengaluru, Karnataka, India Talent Worx Full time ₹ 20,00,000 - ₹ 25,00,000 per year

Location – Pune/Chennai
Exp - 6 to 9

Requirements

Technology: - Big Data (Hadoop, Hive, Spark, Scala, PLSQL/ No SQL Database)

Knowledge/Experience (Must):

· 6-9 years of experience in Hadoop/big data technologies.

· Experience with Spark/Storm/Kafka or equivalent streaming/batch processing and event

based messaging.

· Relational and NoSQL database integration and data distribution principles experience

· Hands-on experience with the Hadoop eco-system (HDFS, MapReduce, Hive, Pig, Impala,

Spark, Kafka, Kudu, Solr)

· Experience with API development and use of JSON/XML/Hypermedia data formats.

· Strong development/automation skills

· Experience with all aspects of DevOps (source control, continuous integration,

deployments, etc.)

· 5+ years of hands-on experience as a Scala developer (with previous Java background)

Knowledge/Experience (Preferred):

· Experience in Core Banking functionality for generating various hand-offs

· Experience with containerization and related technologies (e.g. Docker, Kubernetes)

· Comprehensive knowledge of the principles of software engineering and data analytics

· Knowledge of agile(scrum) development methodology is a plus

· Cloudera/Hortonworks/AWS EMR, S3 experience a plus

Qualifications:

Strong academic record, ideally with a bachelor's degree in engineering/mathematical or scientific

background.

· Strong Communication skills

· Self-Motivated

· Willingness to learn.

· Excellent planning and organizational skills

  • Big Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Acme Services Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    We are looking for Big Data Engineer who has experience with:- 1) Big Query 2) Pyspark 3) GCP or AWS or Azure Required Candidate profileCandidate should have more than 5 Years of overall experience in Data Engineer. We are not looking for Data Analyst or Snowflake Developer.

  • Big Data Engineer

    7 days ago

    Bengaluru, Karnataka, India Deqode Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Profile: Big Data Engineer (System Design)Experience:5+ yearsLocation:BangaloreWork Mode:HybridAbout The RoleWe're looking for an experiencedBig Data Engineerwith system design expertise to architect and build scalable data pipelines and optimize big data solutions.Key ResponsibilitiesDesign, develop, and maintain data pipelines and ETL processes using...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Brillio Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Key skills - Hive, SQL, Python, Spark, Hadoop and kafka , apache airflowJob Title Big Data EngineerRole OverviewWe are seeking a highly skilled Big Data Engineer to join our team. The ideal candidate will have strong experience in building, maintaining, and optimizing large-scale data pipelines and distributed data processing systems. This role involves...

  • Big Data Engineer

    6 days ago

    Bengaluru, Karnataka, India RiskInsight Consulting Pvt Ltd Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    ResponsibilitiesDesign, develop, and implement robust Big Data solutions using technologies such as Hadoop, Spark, and NoSQL databases. Build and maintain scalable data pipelines for effective data ingestion, transformation, and analysis. Collaborate with data scientists, analysts, and cross-functional teams to understand business requirements and translate...

  • Big Data Engineer

    1 week ago

    Bengaluru, Karnataka, India Innova ESI Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Role: Big Data EngineerExperience: 7+ YearsLocation: BangaloreNotice: Immediate Joiners OnlyJob Description:Azure Databricks, Azure Data Factory, Azure Function apps, Apache Spark, Scala, Java, Apache Kafka, event stream and Big DataOptional Skills: Airflow, PythonRoles & ResponsibilitiesOverall, 12 years of experience in IT industry, including 5 years in...

  • Big Data Engineer

    4 days ago

    Bengaluru, Karnataka, India Saransh Software Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Title: Data EngineerExperience: 8+ yearsLocation: BengaluruNotice Period: Immediate to 20 DaysEmployment Type: Full-timeAbout the RoleWe are looking for an experienced Data Engineer with strong expertise in Python, Spark, and PySpark to design, develop, and optimize large-scale data pipelines and distributed systems. The ideal candidate will possess a...

  • Big Data

    22 hours ago

    Bengaluru, Karnataka, India PradeepIT Consulting Services Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About the jobAccelerate your career with PradeepITPradeepIT is one of the largest, globally recognized IT Consulting firm to connect Indias deeply vetted talent team to global customer.Were headquartered in Bengaluru, Silicon Valley of India. PradeepITs customers include SAP Lab, Bosch, Rolls-Royce, Daikin, Daimler and J&J and hundreds of other Fortune 500...

  • Big Data Engineer

    4 days ago

    Bengaluru, Karnataka, India Mercedes-Benz Group Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Tätigkeitsbereich:IT / TelekommunikationFachabteilung:Mainframe Transformation VansGesellschaft:Mercedes-Benz Research and Development India Private LimitedStandort:Mercedes-Benz Research and Development India Private Limited, BangaloreStartdatum: Veröffentlichungsdatum: Stellennummer:MER0003UUTArbeitszeit:VollzeitAufgabenAbout MBRDIMercedes-Benz Research...

  • Big Data Engineer

    5 days ago

    Bengaluru, Karnataka, India Coforge Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    Hiring Now: Big Data Engineer Bangalore || Coforge LtdNote: This position requires 5 days mandatory - Work From Office.Send your updated CV to: For queries, reach out on WhatsApp: Job Location: BangaloreExperience Required: 6 YearsAvailability: Immediate Joiners PreferredKey Technologies & Skills Required:Big Data Tools: Hadoop, HiveProgramming Languages:...

  • Big Data Engineer – Azure

    20 hours ago

    Bengaluru, Karnataka, India Innova ESI Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Role: Big Data Engineer – AzureExperience: 10+ YearsLocation: BangaloreImmediate Joiners OnlyBig Data :Mandatory Skills:Azure Databricks, Azure Data Factory, Azure Function apps, Apache Spark, Scala, Java, Apache Kafka, event stream and Big DataOptional Skills: Airflow, PythonRoles & ResponsibilitiesOverall, experience in IT industry, including 5 years in...