BigData Engineer

1 week ago


Chennai Pune, India Talodyn Networks Private Limited Full time

Bigdata Developer with PYSpark exp

  • Strong experience in PySpark.
  • Strong experience with Python in writing test-cases and Experience in error logging and debugging.
  • Strong experience in Spark, Unix scripting, SparkSQL, Hive.
  • Experience in writing SQLs using Oracle.
  • Excellent oral and written communication skills is a must.
  • Experience in banking is an added advantage.
  • Good understanding on Hadoop Ecosystem and Architecture. (HDFS, Map Reduce, Pig, Oozie, Yarn).
  • Knowledge in Kafka, Pig, MapReduce, HBase, Sqoop, Solr is a plus

Certification in Spark or Python is mandatory

Bigdata Developer with Java Spark exp

● Minimum 3+ years of experience in Java spark

● Minimum 2+ years of experience in multi-tier web application development using Java, Springs

MVC Framework, Hibernate, JDB, and REST.

● Minimum 3+ years of development experience in Hadoop based applications using Apache

Hadoop HDFS, Sqoop, Hive, Java and Spark, Spark SQL, Kafka, and Spark Streaming.

● Should have strong understanding in framework development for data ingestion, data

processing and data extraction.

● Should have strong understanding and knowledge in various file formats like orc, Avro, parquet

etc.

● Should have experience in Spark job performance tuning.

● Good communication skill and client facing.

Bigdata with Scala Spark experience:

● Candidate to have 4 to 12 Years of IT Experience and in Big Data minimum 3+ Years of

experience.

● Strong Hadoop , Distributed Computing and Cluster Knowledge, Cloudera Distribution

experience is a plus.

● Good knowledge in Scala (with a focus on the functional programming paradigm)

Hands

on experience in spark using Scala, Good hands on DataFrame, RDD logic, looping concepts and

Hadoop architecture.

● data transformation pipeline design/development knowledge is required.

● Sound knowledge on SQL and hive.

● Need to have Strong problem solving and performance improvement skills."

● Any of below Apache Spark Certification

Cloudera - CCA Spark and Hadoop Developer

(CCA175) Cloudera

Databricks Certified Developer: Apache Spark

● 2.X DatabricksHortonworks - HDP Certified Apache Spark Developer Hortonworks.



  • Chennai, Tamil Nadu, India Virtusa Full time

    Job Title: BigData - Senior EngineerJob Summary:We are seeking an experienced Big Data Engineer - Leader to join our team at Virtusa. The ideal candidate will have a strong background in Big Data and Data Engineering, with a focus on designing and developing scalable data pipelines and REST APIs.Responsibilities:Design and develop scalable data pipelines...


  • Chennai, Tamil Nadu, India Virtusa Full time

    About the Role:Job Summary:We are seeking a highly skilled BigData - Tech Lead to join our team at Virtusa. The ideal candidate will have a strong background in Big Data and Data Engineering using Scala or Java and will be responsible for designing, building, and deploying Big Data solutions.Design and develop Big Data pipelines and REST APIs using...

  • BigData - Tech Lead

    5 months ago


    Chennai, India Virtusa Full time

    BigData - Tech Lead - CREQ186711 Description Job Description: Responsibilities: Responsible for Design, Build & deployment the Solution in Bigdata. Ability to effectively use complex analytical, interpretive and problem solving techniques. Analytical, flexible, team-oriented and has good interpersonal/communication skills. Apply...


  • pune, India PubMatic Full time

    Title : Senior/Software Development Engineer in Test – Bigdata: Requirements: - Should have 1-3 years of experience working as SDET and doing meaningful automation. - Good programming skills. Python preferred. - Hands on experience in automating backend applications (e.g., database, REST API's) - Hands on experience with automating any backend...


  • pune, India PubMatic Full time

    Title : Senior/Software Development Engineer in Test – Bigdata: Requirements: Should have 1-3 years of experience working as SDET and doing meaningful automation. Good programming skills. Python preferred. Hands on experience in automating backend applications (e.g., database, REST API's) Hands on experience with automating any backend applications (e.g.,...


  • Pune, India PubMatic Full time

    Title : Senior/Software Development Engineer in Test – Bigdata: Requirements: Should have 1-3 years of experience working as SDET and doing meaningful automation. Good programming skills. Python preferred. Hands on experience in automating backend applications (e.g., database, REST API's) Hands on experience with automating any backend applications...


  • Pune, India PubMatic Full time

    Title : Senior/Software Development Engineer in Test – Bigdata: Requirements: Should have 1-3 years of experience working as SDET and doing meaningful automation. Good programming skills. Python preferred. Hands on experience in automating backend applications (e.g., database, REST API's) Hands on experience with automating any backend applications...


  • pune, India PubMatic Full time

    Title : Senior/Software Development Engineer in Test – Bigdata:Requirements:- Should have 1-3 years of experience working as SDET and doing meaningful automation.- Good programming skills. Python preferred.- Hands on experience in automating backend applications (e.g., database, REST API's)- Hands on experience with automating any backend applications...


  • pune, India PubMatic Full time

    Title : Senior/Software Development Engineer in Test – Bigdata:Requirements:Should have 1-3 years of experience working as SDET and doing meaningful automation.Good programming skills. Python preferred.Hands on experience in automating backend applications (e.g., database, REST API's)Hands on experience with automating any backend applications (e.g.,...


  • Pune H.o, India PubMatic Full time

    Title : Senior/Software Development Engineer in Test – Bigdata: Requirements: Should have 1-3 years of experience working as SDET and doing meaningful automation. Good programming skills. Python preferred. Hands on experience in automating backend applications (e. G., database, REST API's)Hands on experience with automating any backend applications (e. G.,...


  • pune, India PubMatic Full time

    Title : Senior/Software Development Engineer in Test – Bigdata: Requirements: Should have 1-3 years of experience working as SDET and doing meaningful automation. Good programming skills. Python preferred. Hands on experience in automating backend applications (e.g., database, REST API's) Hands on experience with automating any backend applications...


  • pune, India PubMatic Full time

    Title : Senior/Software Development Engineer in Test – Bigdata:Requirements: Should have 1-3 years of experience working as SDET and doing meaningful automation.Good programming skills. Python preferred.Hands on experience in automating backend applications (e.g., database, REST API's)Hands on experience with automating any backend applications (e.g.,...


  • Pune, India PubMatic Full time

    Title : Senior/Software Development Engineer in Test – Bigdata:Requirements: Should have 1-3 years of experience working as SDET and doing meaningful automation.Good programming skills. Python preferred.Hands on experience in automating backend applications (e.g., database, REST API's)Hands on experience with automating any backend applications (e.g.,...


  • Pune, India PubMatic Full time

    Title : Senior/Software Development Engineer in Test – Bigdata:Requirements: Should have 1-3 years of experience working as SDET and doing meaningful automation.Good programming skills. Python preferred.Hands on experience in automating backend applications (e.g., database, REST API's)Hands on experience with automating any backend applications (e.g.,...


  • Chennai, India Virtusa Full time

    Architect - Bigdata,Kafka - CREQ192590 Description Job Description: Responsibilities: Architect and Design scalable Data and AI solutions. Evaluate technologies, tools, and platforms. Identify and evaluate emerging technologies, such as Data and AI, and assess their potential impacts and benefits and present it to Internal and External stakeholders....


  • Chennai, India MASTER MIND CONSULTANCY Full time

    SpecialistSoftware Engineer Java / Bigdata Currentcriterion: Java springbootmandatory BigDataSpark with Javamandatory Also can be lookedfor: Java springbootmandatory BigdataSpark with Python orScala or Java mandatory (provided the candidate is ready tolearn/work on Spark withJava) Act as aTech lead for AirAgora application which is an critical applicationin...


  • Pune, India PubMatic Full time

    Title : Senior/Software Development Engineer in Test – Bigdata:Requirements:- Should have 1-3 years of experience working as SDET and doing meaningful automation.- Good programming skills. Python preferred.- Hands on experience in automating backend applications (e.g., database, REST API's)- Hands on experience with automating any backend applications...


  • Pune, India Radical Technologies Full time

    Interested candidates kindly apply before 14th September. CV must be in pdf format, saved with your first name. Role: Trainee Software Engineer / Software Engineer (BI Developer) Experience Range: Fresher (Trained in MSBI, PowerBI, SQL) to 3 years Work Location: Ahmedabad / Pune Role & Requirement: Clear on fundamental Data warehouse and...

  • Bigdata

    7 days ago


    Chennai, Tamil Nadu, India Tata Consultancy Services Full time

    TCS has been a great pioneer in feeding the fire of young Techies like you. We are a global leader in the technology arena and there's nothing that can stop us from growing together. As an Analyst, you will specialize in requirement gathering and to analyze the same in respective areas. Your role is of key importance, as it lays down the foundation for the...

  • Big Data Architect

    5 months ago


    Pune, India Reed & Willow Full time

    **Qualifications**: - Bachelor’s Degree in engineering - 12+ years of experience in Information Technology - Experience and proven track record of delivery of enterprise-scale solution architectures supporting enterprise-level business functions in Bigdata technologies - Well versed in Bigdata technologies Hadoop, Spark, Spark SQL, Hive, Cloudera -...