Big Data Engineer
24 hours ago
Role : Big Data Engineer
Looking for an experienced Spark and Scala developer able to create an end-to-end data pipeline.
Associate should be self-driven, can work with minimal guidance and guide the team technically.
Job Details :
1. Expertise in Spark framework with scala language and Pyspark
2. Expertise in ETL and Data Warehousing and cloud concepts
3. Good work experience in SQL in hive and impala
4. Basic understanding in Spark, Hive and Impala architecture along with cloud integration concepts
5. Knowledge in shell scripting and git commands
6. Able to design and create data flows diagrams and do data modelling.
7. Expertise in data profiling and decision making.
8. Able to understand the Architecture and design end-to-end data flow.
9. Excellent- logical and analytical, troubleshooting, and problem-solving skills.
10. Excellent working knowledge of version control system like GitHub and branching strategies.
11. Able to understand and implement the spark optimization techniques and implement the same in the code.'
12. Communicate effectively and concisely with multiple stakeholders.
13. To monitor and support the year end activities, if needed
14. Ability to co-ordinate and collaborate with cross functional teams.
15. Well versed with security and compliance aspects in Cloud.
16. Good to have Big data related certifications and health care domain knowledge
-
Big data Engineer
1 week ago
Bengaluru / Bangalore, Gurgaon / Gurugram, India Talodyn Networks Private Limited Full timeDescriptionWe are looking for an experienced Big Data Engineer to join our team. The ideal candidate will have 5-8 years of experience in the job market in India and will be responsible for designing, building, and maintaining our big data infrastructure. The candidate should have strong technical skills and experience working with big data technologies such...
-
Big Data Engineer
4 days ago
Chennai, Tamil Nadu, India Krishpar Technologies Pvt. Ltd Full timeWe are seeking an experienced Big Data Engineer to join our team at Krishpar Technologies Pvt. Ltd.**Salary:** ₹15,00,000 - ₹25,00,000 per annumAs a Big Data Engineer, you will be responsible for designing and developing scalable data pipelines using Pyspark on Hadoop, Hive, and Kafka.**Required Skills and Qualifications: 4+ years of experience in Big...
-
Big Data Engineer
2 days ago
Chennai, Tamil Nadu, India Virtusa Full timeJob Title: Big Data EngineerAbout the Job:Virtusa is seeking a skilled Big Data Engineer to join our team. As a key member of our data analytics team, you will be responsible for designing, building, and supporting data applications using Spark, Sqoop, and Hive.Responsibilities:• Develop components, application interfaces, and solution enablers while...
-
Big Data Engineer
4 weeks ago
Chennai, Tamil Nadu, India Krishpar Technologies Pvt. Ltd Full timeWe are seeking a skilled Big Data Engineer to join our team at Krishpar Technologies Pvt. Ltd.The ideal candidate will have experience with Big Data technologies, including Hadoop, Hive, and Spark.Responsibilities will include:Designing and implementing Big Data solutions using Hadoop, Hive, and Spark.Developing and maintaining large-scale data processing...
-
Senior Big Data Engineer
1 week ago
Gurgaon, Haryana, India Arrixa Full timeArrixa is seeking an experienced Senior Big Data Engineer to lead the design and implementation of our big data solutions on Azure Databricks. This role requires a strong background in big data technologies, including Apache Spark, and experience working with large-scale data processing pipelines.About ArrixaArrixa is a leading provider of innovative...
-
Big Data Engineer
2 months ago
Chennai/Noida/Gurgaon/Gurugram/Mumbai, IN ANRI Solutions HR Services Full timeRole : Big Data Engineer Looking for an experienced Spark and Scala developer able to create an end-to-end data pipeline.Associate should be self-driven, can work with minimal guidance and guide the team technically. Job Details : 1. Expertise in Spark framework with scala language and Pyspark 2. Expertise in ETL and Data Warehousing and cloud concepts 3....
-
Lead Big Data Engineer
2 months ago
Gurgaon/Gurugram, India Huntingcube Recruitment Solutions Full timeJob Description : - Lead the design and implementation of scalable and efficient big data architectures, ensuring optimal performance, security, and scalability. - Design, build, and maintain complex data pipelines that process large volumes of data from multiple sources, ensuring data is clean, reliable, and accessible.- Implement and manage big data...
-
Data Engineer
1 month ago
Gurgaon, Haryana, India Chiselon Technologies Pvt Ltd Full timeWe are seeking a talented Data Engineer with expertise in Big Data and Google Cloud Platform (GCP) to join our team at Chiselon Technologies Pvt Ltd.This role is ideal for individuals with hands-on experience in Big Query, Data Proc, Airflow, Cloud Composer, GCP Hydra Services, and Cloud Data Optimization.Key responsibilities:Design and develop scalable data...
-
Big Data Engineer
1 month ago
Gurgaon, Haryana, India ACS Consultants Full time**Job Title:** Big Data Engineer**Job Summary:We are seeking an experienced Big Data Engineer to join our team at ACS Consultants. As a key member of our data science team, you will be responsible for designing, developing, and managing large-scale data processing systems using Hadoop, Hive, and Spark.Main Responsibilities:• Design and implement scalable...
-
Big Data Engineer
1 month ago
Gurgaon, Haryana, India Spectral Consultants – Search & Recruitment firm Full timeJob Title: Big Data DeveloperJob Summary:We are seeking an experienced Big Data Developer to join our team at Spectral Consultants. The ideal candidate will have a strong background in building scalable and efficient data pipelines using Hive, Spark, Hadoop, and MapReduce.Key Responsibilities:Design, implement, and optimize large-scale data processing...
-
Data Engineer
1 month ago
Gurgaon, Haryana, India Spectral Consultants – Search & Recruitment firm Full timeJob Role : Data Engineer - Big Data ArchitectureWe are seeking a skilled Data Engineer to join our team at Spectral Consultants. As a Data Engineer, you will play a crucial role in designing, building, and maintaining large-scale data processing pipelines using Big Data technologies like Hive, Spark, Hadoop, and MapReduce.Key Responsibilities :Design and...
-
Data Engineer
4 weeks ago
Chennai, Tamil Nadu, India RiskInsight Consulting Pvt Ltd Full timeJob Title: Data Engineer - Big Data ArchitectureJob Summary:We are seeking a highly skilled Data Engineer to design, develop, and deploy scalable Big Data applications using Apache Spark.The successful candidate will collaborate with data scientists and business analysts to understand requirements and translate them into technical solutions.The Data Engineer...
-
Senior Big Data Engineer
1 month ago
Gurgaon, Haryana, India Uncap Research Labs Full timeData Engineering Role at Uncap Research LabsWe are seeking a highly skilled Data Engineer to join our team at Uncap Research Labs. This role will involve designing and implementing scalable data services, developing and deploying production data pipelines, and optimizing big data systems for performance and efficiency.Key Responsibilities Apache Spark and...
-
Senior Big Data Engineer
3 weeks ago
Chennai, Tamil Nadu, India RiskInsight Consulting Pvt Ltd Full timeRiskInsight Consulting Pvt Ltd seeks a highly skilled Senior Big Data Engineer to join its team of experts. As a key member of our data engineering team, you will be responsible for designing, developing, and deploying scalable Big Data applications using Hadoop ecosystem technologies. Your expertise in HDFS, Hive, and other related technologies will be...
-
Data Engineer
1 month ago
Chennai, Tamil Nadu, India Kiash Solutions LLP Full timeData Engineer - Big Data TechnologiesAt Kiash Solutions LLP, we are seeking a highly skilled Data Engineer - Big Data Technologies to join our team. The ideal candidate will have a strong background in Big Data technologies and Spark, with a minimum of 4 years of experience in data processing and analysis.Key Responsibilities:Analyze, organize and process...
-
Big Data Engineer
2 months ago
Chennai, India TapTalent.ai Full timeAboutCompany: Our Company is a globaltechnology consulting and digital solutions company that enablesenterprises to reimagine business models and accelerate innovationthrough digital technologies. Powered by more than 84000entrepreneurial professionals across more than 30 countries catersto over 700 clients. Our extensive domain and technology expertisehelps...
-
Big Data Engineer
1 month ago
Chennai/Pune, India Pan Asia Man power Consultants Recruiting agency Full timeBig Data EngineerWe are seeking a skilled Big Data Engineer to contribute to building backend data applications and services. This role requires expertise in various technologies to drive our data initiatives.Key Responsibilities:Design, develop, and maintain backend data applications and services.Collaborate with product owners and team members to gather...
-
Senior Big Data Engineer
3 weeks ago
Chennai, Tamil Nadu, India RiskInsight Consulting Pvt Ltd Full timeRiskInsight Consulting Pvt Ltd is seeking a Senior Big Data Engineer to join our team.Key Responsibilities:Design and Develop Big Data Applications: Utilize Apache Spark to create scalable and efficient Big Data applications.Collaborate with Data Scientists and Business Analysts: Work with cross-functional teams to understand requirements and translate them...
-
Big Data Engineer
2 weeks ago
navi mumbai, India Pert Telecom Solutions Full timeJob Description : We are seeking a skilled Big Data Engineer with deep expertise in PySpark, Python, MySQL, Hadoop and Linux. The ideal candidate should have extensive experience deploying and managing these tools within on-premises environments (no public cloud). Proficiency in cluster management, performance optimization, and monitoring is essential for...
-
Big Data Engineer
1 week ago
Coimbatore, Chennai, India Talodyn Networks Private Limited Full timeDescriptionWe are seeking a highly skilled Big Data Engineer with 5-9 years of experience to join our team in India. The ideal candidate should have a strong technical background in big data technologies and be able to design, develop, and maintain large-scale data processing systems. The candidate should also be able to work collaboratively with...