Big Data Developer
3 days ago
Candidate Requirement
Looking for an experienced Spark and Scala developer able to create an end-to-end data pipeline.
Associate should be self-driven, can work with minimal guidance and guide the team technically.
Job Details:
- Expertise in Spark framework with scala language and Pyspark
- Expertise in ETL and Data Warehousing and cloud concepts
- Good work experience in SQL in hive and impala
- Basic understanding in Spark, Hive and Impala architecture along with cloud integration concepts
- Knowledge in shell scripting and git commands
- Able to design and create data flows diagrams and do data modelling.
- Expertise in data profiling and decision making.
- Able to understand the Architecture and design end-to-end data flow.
- Excellent logical and analytical, troubleshooting, and problem-solving skills.
- Excellent working knowledge of version control system like GitHub and branching strategies.
- Able to understand and implement the spark optimization techniques and implement the same in the code.’
- Communicate effectively and concisely with multiple stakeholders.
- To monitor and support the year end activities, if needed
- Ability to co-ordinate and collaborate with cross functional teams.
- Well versed with security and compliance aspects in Cloud.
- Good to have Big data related certifications and health care domain knowledge
Work Location
Chennai, Noida, Gurugram, Mumbai
-
Big Data Developer
2 days ago
Chennai, India Mavinsys Full timeMinimum Required Skills & Experience :1. Big Data Technologies (6+ years) :- Extensive experience with Big Data frameworks like Hadoop and Spark.- Deep understanding of Hadoop ecosystem (HDFS, YARN, MapReduce).- Familiarity with big data schedulers (e.g., Oozie, Airflow).2. Scala & Spark Expertise (4+ years each) :- Strong proficiency in Scala programming...
-
Big Data Developer
2 months ago
Chennai, India Virtusa Full timeBig Data Developer - CREQ188135 Description Job Description: 5+ years of hands-on experience in designing, building and supporting Data Applications using Spark, Sqoop and Hive Bachelors or masters degree in Computer Science or related field Strong knowledge of working with large data sets and high-capacity big data processing platform Strong experience...
-
Big Data Developer
11 hours ago
Chennai, India Saransh Inc Full timeSkills: Spark, Big Data, Hive, Java Job Description: 4+yrs with hands-on on Java 1.8 and Above is Must Database knowledge and should be able to write the queries is Must. Handson on Unix Shell scripting is Must. Knowledge in Spark SQL (Good to have). Understand on Regulatory reporting (Good to have). Design implementation of scalable fault tolerant ETL...
-
Big Data Developer
6 hours ago
chennai, India Saransh Inc Full timeSkills: Spark, Big Data, Hive, JavaJob Description: 4+yrs with hands-on on Java 1.8 and Above is Must Database knowledge and should be able to write the queries is Must. Handson on Unix Shell scripting is Must. Knowledge in Spark SQL (Good to have). Understand on Regulatory reporting (Good to have). Design implementation of scalable fault tolerant ETL...
-
Big Data Developer
5 hours ago
Chennai, India Saransh Inc Full timeSkills: Spark, Big Data, Hive, JavaJob Description: 4+yrs with hands-on on Java 1.8 and Above is Must Database knowledge and should be able to write the queries is Must. Handson on Unix Shell scripting is Must. Knowledge in Spark SQL (Good to have). Understand on Regulatory reporting (Good to have). Design implementation of scalable fault tolerant ETL...
-
Big Data Developer
20 hours ago
Chennai, India Saransh Inc Full timeSkills: Spark, Big Data, Hive, JavaJob Description: 4+yrs with hands-on on Java 1.8 and Above is Must Database knowledge and should be able to write the queries is Must. Handson on Unix Shell scripting is Must. Knowledge in Spark SQL (Good to have). Understand on Regulatory reporting (Good to have). Design implementation of scalable fault tolerant ETL...
-
Big Data Developer
4 months ago
Chennai, India RiskInsight Consulting Pvt Ltd Full timeResponsibilities Design, develop, and deploy scalable Big Data applications using Apache Spark. Collaborate with data scientists and business analysts to understand requirements and translate them into technical solutions. Write efficient and optimized code to process and analyze large volumes of data. Implement data ingestion processes from various data...
-
GCP Big Data Engineer
3 weeks ago
Chennai, India IntraEdge Full timeAbout the Role:We are seeking a highly motivated and experienced Big Data Engineer to join our growing team in Chennai, Bangalore, or Gurgaon. In this role, you will play a key part in designing, developing, and managing our big data infrastructure on Google Cloud Platform (GCP). You will leverage your expertise in big data technologies and GCP services to...
-
GCP Big Data Engineer
3 days ago
chennai, India IntraEdge Full timeAbout the Role:We are seeking a highly motivated and experienced Big Data Engineer to join our growing team in Chennai, Bangalore, or Gurgaon. In this role, you will play a key part in designing, developing, and managing our big data infrastructure on Google Cloud Platform (GCP). You will leverage your expertise in big data technologies and GCP services to...
-
GCP Big Data Engineer
3 weeks ago
Chennai, India IntraEdge Full timeAbout the Role: We are seeking a highly motivated and experienced Big Data Engineer to join our growing team in Chennai, Bangalore, or Gurgaon. In this role, you will play a key part in designing, developing, and managing our big data infrastructure on Google Cloud Platform (GCP). You will leverage your expertise in big data technologies and GCP services to...
-
Big Data Developer
3 weeks ago
Chennai, India Wipro Full timeCandidate Requirement Looking for an experienced Spark and Scala developer able to create an end-to-end data pipeline. Associate should be self-driven, can work with minimal guidance and guide the team technically. Job Details: Expertise in Spark framework with scala language and Pyspark Expertise in ETL and Data Warehousing and cloud concepts Good work...
-
Big Data Developer
3 weeks ago
Chennai, India Wipro Full timeCandidate Requirement Looking for an experienced Spark and Scala developer able to create an end-to-end data pipeline. Associate should be self-driven, can work with minimal guidance and guide the team technically. Job Details: Expertise in Spark framework with scala language and Pyspark Expertise in ETL and Data Warehousing and cloud concepts Good work...
-
Big Data Developer
3 weeks ago
Chennai, India Wipro Full timeCandidate Requirement Looking for an experienced Spark and Scala developer able to create an end-to-end data pipeline. Associate should be self-driven, can work with minimal guidance and guide the team technically. Job Details: Expertise in Spark framework with scala language and Pyspark Expertise in ETL and Data Warehousing and cloud concepts ...
-
Big Data Architect
4 months ago
Chennai, Tamil Nadu, India RiskInsight Consulting Pvt Ltd Full time**Responsibilities**: - Design and architect Big Data solutions to meet business requirements. - Collaborate with stakeholders to understand their data and analytics needs. - Create and maintain data models, data flow diagrams, and data integration strategies. - Develop and implement data ingestion, processing, and storage solutions using Big Data...
-
Big Data Lead
2 months ago
Chennai, India Virtusa Full timeBig Data Lead - CREQ194625 Description Job Description: 5+ years of hands-on experience in designing, building and supporting Data Applications using Spark, Sqoop and Hive Strong knowledge of working with large data sets and high-capacity big data processing platform Strong experience in Unix and Shell scripting Advanced knowledge of the Hadoop...
-
Solution Architect
2 months ago
Chennai, India Recro Full timeResponsibilities :- Work collaboratively with product managers, engineers, and data scientists to understand business requirements and translate them into scalable, secure, and cost-effective big data solutions leveraging AWS services.- Design and document big data architectures that incorporate data ingestion, processing, storage, analytics, and...
-
Big Data Engineer
2 days ago
Chennai, India People Prime Worldwide Full timeAbout Company: Our client is a global technology consulting and digital solutions company that enables enterprises to reimagine business models and accelerate innovation through digital technologies. Powered by more than 84000 entrepreneurial professionals across more than 30 countries it caters to over 700 clients with its extensive domain and technology...
-
Big Data Engineer
4 weeks ago
Chennai, India People Prime Worldwide Full timeAbout Company: Our client is a global technologyconsulting and digital solutions company that enables enterprisesto reimagine business models and accelerate innovation throughdigital technologies. Powered by more than 84000 entrepreneurialprofessionals across more than 30 countries it caters to over 700clients with its extensive domain and technology...
-
Senior Big Data Engineer
2 weeks ago
Chennai, India Sriven Full timeJob Title: Senior Big Data Engineer Experience Required: 7+ years Educational Qualification: Bachelor's degree from an accredited college or university Job Description: We are looking for a highly skilled Senior Big Data Engineer to join our dynamic team. The ideal candidate will have extensive experience in designing and developing...
-
Senior Big Data Engineer
3 weeks ago
Chennai, India Sriven Full timeJob Title: Senior Big Data Engineer Experience Required: 7+ years Educational Qualification: Bachelor's degree from an accredited college or university Job Description: We are looking for a highly skilled Senior Big Data Engineer to join our dynamic team. The ideal candidate will have extensive experience in designing and developing complex Big Data...