BigData Engineer
1 week ago
Bigdata Developer with PYSpark exp
- Strong experience in PySpark.
- Strong experience with Python in writing test-cases and Experience in error logging and debugging.
- Strong experience in Spark, Unix scripting, SparkSQL, Hive.
- Experience in writing SQLs using Oracle.
- Excellent oral and written communication skills is a must.
- Experience in banking is an added advantage.
- Good understanding on Hadoop Ecosystem and Architecture. (HDFS, Map Reduce, Pig, Oozie, Yarn).
- Knowledge in Kafka, Pig, MapReduce, HBase, Sqoop, Solr is a plus
Certification in Spark or Python is mandatory
Bigdata Developer with Java Spark exp
● Minimum 3+ years of experience in Java spark
● Minimum 2+ years of experience in multi-tier web application development using Java, Springs
MVC Framework, Hibernate, JDB, and REST.
● Minimum 3+ years of development experience in Hadoop based applications using Apache
Hadoop HDFS, Sqoop, Hive, Java and Spark, Spark SQL, Kafka, and Spark Streaming.
● Should have strong understanding in framework development for data ingestion, data
processing and data extraction.
● Should have strong understanding and knowledge in various file formats like orc, Avro, parquet
etc.
● Should have experience in Spark job performance tuning.
● Good communication skill and client facing.
Bigdata with Scala Spark experience:
● Candidate to have 4 to 12 Years of IT Experience and in Big Data minimum 3+ Years of
experience.
● Strong Hadoop , Distributed Computing and Cluster Knowledge, Cloudera Distribution
experience is a plus.
● Good knowledge in Scala (with a focus on the functional programming paradigm)
Hands
on experience in spark using Scala, Good hands on DataFrame, RDD logic, looping concepts and
Hadoop architecture.
● data transformation pipeline design/development knowledge is required.
● Sound knowledge on SQL and hive.
● Need to have Strong problem solving and performance improvement skills."
● Any of below Apache Spark Certification
Cloudera - CCA Spark and Hadoop Developer
(CCA175) Cloudera
Databricks Certified Developer: Apache Spark
● 2.X DatabricksHortonworks - HDP Certified Apache Spark Developer Hortonworks.
-
BigData - Senior Engineer
4 weeks ago
Chennai, Tamil Nadu, India Virtusa Full timeJob Title: BigData - Senior EngineerJob Summary:We are seeking an experienced Big Data Engineer - Leader to join our team at Virtusa. The ideal candidate will have a strong background in Big Data and Data Engineering, with a focus on designing and developing scalable data pipelines and REST APIs.Responsibilities:Design and develop scalable data pipelines...
-
BigData - Senior Architect
4 weeks ago
Chennai, Tamil Nadu, India Virtusa Full timeAbout the Role:Job Summary:We are seeking a highly skilled BigData - Tech Lead to join our team at Virtusa. The ideal candidate will have a strong background in Big Data and Data Engineering using Scala or Java and will be responsible for designing, building, and deploying Big Data solutions.Design and develop Big Data pipelines and REST APIs using...
-
BigData - Tech Lead
5 months ago
Chennai, India Virtusa Full timeBigData - Tech Lead - CREQ186711 Description Job Description: Responsibilities: Responsible for Design, Build & deployment the Solution in Bigdata. Ability to effectively use complex analytical, interpretive and problem solving techniques. Analytical, flexible, team-oriented and has good interpersonal/communication skills. Apply...
-
pune, India PubMatic Full timeTitle : Senior/Software Development Engineer in Test – Bigdata: Requirements: - Should have 1-3 years of experience working as SDET and doing meaningful automation. - Good programming skills. Python preferred. - Hands on experience in automating backend applications (e.g., database, REST API's) - Hands on experience with automating any backend...
-
pune, India PubMatic Full timeTitle : Senior/Software Development Engineer in Test – Bigdata: Requirements: Should have 1-3 years of experience working as SDET and doing meaningful automation. Good programming skills. Python preferred. Hands on experience in automating backend applications (e.g., database, REST API's) Hands on experience with automating any backend applications (e.g.,...
-
Senior/Software Development Engineer in Test
1 month ago
Pune, India PubMatic Full timeTitle : Senior/Software Development Engineer in Test – Bigdata: Requirements: Should have 1-3 years of experience working as SDET and doing meaningful automation. Good programming skills. Python preferred. Hands on experience in automating backend applications (e.g., database, REST API's) Hands on experience with automating any backend applications...
-
Senior/Software Development Engineer in Test
2 months ago
Pune, India PubMatic Full timeTitle : Senior/Software Development Engineer in Test – Bigdata: Requirements: Should have 1-3 years of experience working as SDET and doing meaningful automation. Good programming skills. Python preferred. Hands on experience in automating backend applications (e.g., database, REST API's) Hands on experience with automating any backend applications...
-
pune, India PubMatic Full timeTitle : Senior/Software Development Engineer in Test – Bigdata:Requirements:- Should have 1-3 years of experience working as SDET and doing meaningful automation.- Good programming skills. Python preferred.- Hands on experience in automating backend applications (e.g., database, REST API's)- Hands on experience with automating any backend applications...
-
pune, India PubMatic Full timeTitle : Senior/Software Development Engineer in Test – Bigdata:Requirements:Should have 1-3 years of experience working as SDET and doing meaningful automation.Good programming skills. Python preferred.Hands on experience in automating backend applications (e.g., database, REST API's)Hands on experience with automating any backend applications (e.g.,...
-
Pune H.o, India PubMatic Full timeTitle : Senior/Software Development Engineer in Test – Bigdata: Requirements: Should have 1-3 years of experience working as SDET and doing meaningful automation. Good programming skills. Python preferred. Hands on experience in automating backend applications (e. G., database, REST API's)Hands on experience with automating any backend applications (e. G.,...
-
pune, India PubMatic Full timeTitle : Senior/Software Development Engineer in Test – Bigdata: Requirements: Should have 1-3 years of experience working as SDET and doing meaningful automation. Good programming skills. Python preferred. Hands on experience in automating backend applications (e.g., database, REST API's) Hands on experience with automating any backend applications...
-
pune, India PubMatic Full timeTitle : Senior/Software Development Engineer in Test – Bigdata:Requirements: Should have 1-3 years of experience working as SDET and doing meaningful automation.Good programming skills. Python preferred.Hands on experience in automating backend applications (e.g., database, REST API's)Hands on experience with automating any backend applications (e.g.,...
-
Pune, India PubMatic Full timeTitle : Senior/Software Development Engineer in Test – Bigdata:Requirements: Should have 1-3 years of experience working as SDET and doing meaningful automation.Good programming skills. Python preferred.Hands on experience in automating backend applications (e.g., database, REST API's)Hands on experience with automating any backend applications (e.g.,...
-
Pune, India PubMatic Full timeTitle : Senior/Software Development Engineer in Test – Bigdata:Requirements: Should have 1-3 years of experience working as SDET and doing meaningful automation.Good programming skills. Python preferred.Hands on experience in automating backend applications (e.g., database, REST API's)Hands on experience with automating any backend applications (e.g.,...
-
Architect - Bigdata,Kafka
5 months ago
Chennai, India Virtusa Full timeArchitect - Bigdata,Kafka - CREQ192590 Description Job Description: Responsibilities: Architect and Design scalable Data and AI solutions. Evaluate technologies, tools, and platforms. Identify and evaluate emerging technologies, such as Data and AI, and assess their potential impacts and benefits and present it to Internal and External stakeholders....
-
Specialist Software Engineer
3 months ago
Chennai, India MASTER MIND CONSULTANCY Full timeSpecialistSoftware Engineer Java / Bigdata Currentcriterion: Java springbootmandatory BigDataSpark with Javamandatory Also can be lookedfor: Java springbootmandatory BigdataSpark with Python orScala or Java mandatory (provided the candidate is ready tolearn/work on Spark withJava) Act as aTech lead for AirAgora application which is an critical applicationin...
-
Pune, India PubMatic Full timeTitle : Senior/Software Development Engineer in Test – Bigdata:Requirements:- Should have 1-3 years of experience working as SDET and doing meaningful automation.- Good programming skills. Python preferred.- Hands on experience in automating backend applications (e.g., database, REST API's)- Hands on experience with automating any backend applications...
-
Trainee Software Engineer
6 months ago
Pune, India Radical Technologies Full timeInterested candidates kindly apply before 14th September. CV must be in pdf format, saved with your first name. Role: Trainee Software Engineer / Software Engineer (BI Developer) Experience Range: Fresher (Trained in MSBI, PowerBI, SQL) to 3 years Work Location: Ahmedabad / Pune Role & Requirement: Clear on fundamental Data warehouse and...
-
Bigdata
7 days ago
Chennai, Tamil Nadu, India Tata Consultancy Services Full timeTCS has been a great pioneer in feeding the fire of young Techies like you. We are a global leader in the technology arena and there's nothing that can stop us from growing together. As an Analyst, you will specialize in requirement gathering and to analyze the same in respective areas. Your role is of key importance, as it lays down the foundation for the...
-
Big Data Architect
5 months ago
Pune, India Reed & Willow Full time**Qualifications**: - Bachelor’s Degree in engineering - 12+ years of experience in Information Technology - Experience and proven track record of delivery of enterprise-scale solution architectures supporting enterprise-level business functions in Bigdata technologies - Well versed in Bigdata technologies Hadoop, Spark, Spark SQL, Hive, Cloudera -...