Big Data Developer
3 weeks ago
Candidate Requirement
Looking for an experienced Spark and Scala developer able to create an end-to-end data pipeline.
Associate should be self-driven, can work with minimal guidance and guide the team technically.
Job Details:
- Expertise in Spark framework with scala language and Pyspark
- Expertise in ETL and Data Warehousing and cloud concepts
- Good work experience in SQL in hive and impala
- Basic understanding in Spark, Hive and Impala architecture along with cloud integration concepts
- Knowledge in shell scripting and git commands
- Able to design and create data flows diagrams and do data modelling.
- Expertise in data profiling and decision making.
- Able to understand the Architecture and design end-to-end data flow.
- Excellent logical and analytical, troubleshooting, and problem-solving skills.
- Excellent working knowledge of version control system like GitHub and branching strategies.
- Able to understand and implement the spark optimization techniques and implement the same in the code.’
- Communicate effectively and concisely with multiple stakeholders.
- To monitor and support the year end activities, if needed
- Ability to co-ordinate and collaborate with cross functional teams.
- Well versed with security and compliance aspects in Cloud.
- Good to have Big data related certifications and health care domain knowledge
Work Location
Chennai, Noida, Gurugram, Mumbai
-
Big Data Developer
2 months ago
Chennai, India Virtusa Full timeBig Data Developer - CREQ188135 Description Job Description: 5+ years of hands-on experience in designing, building and supporting Data Applications using Spark, Sqoop and Hive Bachelors or masters degree in Computer Science or related field Strong knowledge of working with large data sets and high-capacity big data processing platform Strong experience...
-
Big Data Developer
4 months ago
Chennai, India RiskInsight Consulting Pvt Ltd Full timeResponsibilities Design, develop, and deploy scalable Big Data applications using Apache Spark. Collaborate with data scientists and business analysts to understand requirements and translate them into technical solutions. Write efficient and optimized code to process and analyze large volumes of data. Implement data ingestion processes from various data...
-
GCP Big Data Engineer
2 weeks ago
Chennai, India IntraEdge Full timeAbout the Role: We are seeking a highly motivated and experienced Big Data Engineer to join our growing team in Chennai, Bangalore, or Gurgaon. In this role, you will play a key part in designing, developing, and managing our big data infrastructure on Google Cloud Platform (GCP). You will leverage your expertise in big data technologies and GCP services to...
-
GCP Big Data Engineer
3 weeks ago
Chennai, India IntraEdge Full timeAbout the Role:We are seeking a highly motivated and experienced Big Data Engineer to join our growing team in Chennai, Bangalore, or Gurgaon. In this role, you will play a key part in designing, developing, and managing our big data infrastructure on Google Cloud Platform (GCP). You will leverage your expertise in big data technologies and GCP services to...
-
Big Data Developer
2 weeks ago
Chennai, India Wipro Full timeCandidate Requirement Looking for an experienced Spark and Scala developer able to create an end-to-end data pipeline. Associate should be self-driven, can work with minimal guidance and guide the team technically. Job Details: Expertise in Spark framework with scala language and Pyspark Expertise in ETL and Data Warehousing and cloud concepts ...
-
Big Data Developer
3 weeks ago
Chennai, India Wipro Full timeCandidate Requirement Looking for an experienced Spark and Scala developer able to create an end-to-end data pipeline. Associate should be self-driven, can work with minimal guidance and guide the team technically. Job Details: Expertise in Spark framework with scala language and Pyspark Expertise in ETL and Data Warehousing and cloud concepts Good work...
-
Big Data Architect
3 months ago
Chennai, Tamil Nadu, India RiskInsight Consulting Pvt Ltd Full time**Responsibilities**: - Design and architect Big Data solutions to meet business requirements. - Collaborate with stakeholders to understand their data and analytics needs. - Create and maintain data models, data flow diagrams, and data integration strategies. - Develop and implement data ingestion, processing, and storage solutions using Big Data...
-
Big Data Lead
2 months ago
Chennai, India Virtusa Full timeBig Data Lead - CREQ194625 Description Job Description: 5+ years of hands-on experience in designing, building and supporting Data Applications using Spark, Sqoop and Hive Strong knowledge of working with large data sets and high-capacity big data processing platform Strong experience in Unix and Shell scripting Advanced knowledge of the Hadoop...
-
Big Data Developer
3 months ago
Chennai, India ProPMO Services Private Limited Full timeGCP + Big Data DeveloperExperience : 2-5 YearsNotice Period : Immediate Joiners only (max 2 weeks)Location : Bangalore, Chennai, GurgaonEmployment Type : Contract BasisJob Overview :We are seeking a highly skilled and motivated GCP + Big Data Developer to join our team on a contract basis. The ideal candidate will have 2-5 years of relevant experience and...
-
Solution Architect
2 months ago
Chennai, India Recro Full timeResponsibilities :- Work collaboratively with product managers, engineers, and data scientists to understand business requirements and translate them into scalable, secure, and cost-effective big data solutions leveraging AWS services.- Design and document big data architectures that incorporate data ingestion, processing, storage, analytics, and...
-
Big Data Engineer
4 weeks ago
Chennai, India People Prime Worldwide Full timeAbout Company: Our client is a global technologyconsulting and digital solutions company that enables enterprisesto reimagine business models and accelerate innovation throughdigital technologies. Powered by more than 84000 entrepreneurialprofessionals across more than 30 countries it caters to over 700clients with its extensive domain and technology...
-
Senior Big Data Engineer
1 week ago
Chennai, India Sriven Full timeJob Title: Senior Big Data Engineer Experience Required: 7+ years Educational Qualification: Bachelor's degree from an accredited college or university Job Description: We are looking for a highly skilled Senior Big Data Engineer to join our dynamic team. The ideal candidate will have extensive experience in designing and developing...
-
Senior Big Data Engineer
2 weeks ago
Chennai, India Sriven Full timeJob Title: Senior Big Data Engineer Experience Required: 7+ years Educational Qualification: Bachelor's degree from an accredited college or university Job Description: We are looking for a highly skilled Senior Big Data Engineer to join our dynamic team. The ideal candidate will have extensive experience in designing and developing complex Big Data...
-
Senior Big Data Engineer
3 weeks ago
Chennai, India Sriven Full timeJob Title: Senior Big Data EngineerExperience Required: 7+ yearsEducational Qualification: Bachelor's degree from an accredited college or universityJob Description:We are looking for a highly skilled Senior Big Data Engineer to join our dynamic team. The ideal candidate will have extensive experience in designing and developing complex Big Data pipelines...
-
Senior Big Data Engineer
3 weeks ago
Chennai, India Sriven Full timeJob Title: Senior Big Data EngineerExperience Required: 7+ yearsEducational Qualification: Bachelor's degree from an accredited college or universityJob Description:We are looking for a highly skilled Senior Big Data Engineer to join our dynamic team. The ideal candidate will have extensive experience in designing and developing complex Big Data pipelines...
-
Big Data Developer
4 months ago
Chennai, India RiskInsight Consulting Pvt Ltd Full timeResponsibilities Design, develop, and deploy scalable Big Data applications using Hadoop ecosystem technologies (Hadoop, HDFS, Hive, etc.). Collaborate with data scientists and business analysts to understand requirements and translate them into technical solutions. Write efficient and optimized code to process and analyze large volumes of data. Implement...
-
Data Engineer IV
1 month ago
Chennai, India Sadup Softech Full timeMust have skills :- Minimum of 5-7 years of experience in software development, with a focus on Java and infrastructure tools.- Min 6+ years of experience as a Data Engineer.- Good Experience in handling Big Data Spark, Hive SQL, BigQuery, SQL.- Candidate worked on cloud platforms and GCP would be an added advantage.- Good understanding of Hadoop based...
-
Senior Data Engineer
3 days ago
Chennai, India Trinity Technology solutions Full timeWe're seeking a highly skilled and experienced Senior Data Engineer to join our team! You will play a pivotal role in designing, developing, and deploying robust data pipelines and data warehouse solutions leveraging Google Cloud Platform (GCP). You will leverage your expertise in big data technologies like Hadoop, Spark, and Airflow to build scalable...
-
Big Data Engineer
23 hours ago
Chennai, India Tata Consultancy Services Full timeGreetings fromTATA Consultancy Services !!We are currently Hiring ForBIG DATA ENGINEERJob Location :CHENNAIExp 5+Interview Mode: FACE TO FACEINTERVIEW DATE : 21-Aug-24Job description3+ years of relevant experience in Pyspark and Hive, HBaseProficiency in integrating, transforming, and consolidating data from various structured and unstructured data...
-
Big Data Architect
1 month ago
Chennai, India Selsoftinc Full timeJob Description :- Design and implement scalable big data architectures on Microsoft Azure and Azure Fabric to handle large volumes of data efficiently and securely.- Develop and manage data pipelines for ingesting, processing, and analyzing large datasets, ensuring data quality and integrity.- Collaborate with data scientists, data engineers, and business...