Big Data Engineer

24 hours ago


ChennaiNoidaGurgaonGurugramMumbai, India ANRI Solutions HR Services Full time

Role : Big Data Engineer


Looking for an experienced Spark and Scala developer able to create an end-to-end data pipeline.


Associate should be self-driven, can work with minimal guidance and guide the team technically.

Job Details :

1. Expertise in Spark framework with scala language and Pyspark

2. Expertise in ETL and Data Warehousing and cloud concepts

3. Good work experience in SQL in hive and impala

4. Basic understanding in Spark, Hive and Impala architecture along with cloud integration concepts

5. Knowledge in shell scripting and git commands

6. Able to design and create data flows diagrams and do data modelling.

7. Expertise in data profiling and decision making.

8. Able to understand the Architecture and design end-to-end data flow.

9. Excellent- logical and analytical, troubleshooting, and problem-solving skills.

10. Excellent working knowledge of version control system like GitHub and branching strategies.

11. Able to understand and implement the spark optimization techniques and implement the same in the code.'

12. Communicate effectively and concisely with multiple stakeholders.

13. To monitor and support the year end activities, if needed

14. Ability to co-ordinate and collaborate with cross functional teams.

15. Well versed with security and compliance aspects in Cloud.

16. Good to have Big data related certifications and health care domain knowledge

(ref:hirist.tech)
  • Big data Engineer

    1 week ago


    Bengaluru / Bangalore, Gurgaon / Gurugram, India Talodyn Networks Private Limited Full time

    DescriptionWe are looking for an experienced Big Data Engineer to join our team. The ideal candidate will have 5-8 years of experience in the job market in India and will be responsible for designing, building, and maintaining our big data infrastructure. The candidate should have strong technical skills and experience working with big data technologies such...

  • Big Data Engineer

    4 days ago


    Chennai, Tamil Nadu, India Krishpar Technologies Pvt. Ltd Full time

    We are seeking an experienced Big Data Engineer to join our team at Krishpar Technologies Pvt. Ltd.**Salary:** ₹15,00,000 - ₹25,00,000 per annumAs a Big Data Engineer, you will be responsible for designing and developing scalable data pipelines using Pyspark on Hadoop, Hive, and Kafka.**Required Skills and Qualifications: 4+ years of experience in Big...

  • Big Data Engineer

    2 days ago


    Chennai, Tamil Nadu, India Virtusa Full time

    Job Title: Big Data EngineerAbout the Job:Virtusa is seeking a skilled Big Data Engineer to join our team. As a key member of our data analytics team, you will be responsible for designing, building, and supporting data applications using Spark, Sqoop, and Hive.Responsibilities:• Develop components, application interfaces, and solution enablers while...

  • Big Data Engineer

    4 weeks ago


    Chennai, Tamil Nadu, India Krishpar Technologies Pvt. Ltd Full time

    We are seeking a skilled Big Data Engineer to join our team at Krishpar Technologies Pvt. Ltd.The ideal candidate will have experience with Big Data technologies, including Hadoop, Hive, and Spark.Responsibilities will include:Designing and implementing Big Data solutions using Hadoop, Hive, and Spark.Developing and maintaining large-scale data processing...


  • Gurgaon, Haryana, India Arrixa Full time

    Arrixa is seeking an experienced Senior Big Data Engineer to lead the design and implementation of our big data solutions on Azure Databricks. This role requires a strong background in big data technologies, including Apache Spark, and experience working with large-scale data processing pipelines.About ArrixaArrixa is a leading provider of innovative...

  • Big Data Engineer

    2 months ago


    Chennai/Noida/Gurgaon/Gurugram/Mumbai, IN ANRI Solutions HR Services Full time

    Role : Big Data Engineer Looking for an experienced Spark and Scala developer able to create an end-to-end data pipeline.Associate should be self-driven, can work with minimal guidance and guide the team technically. Job Details : 1. Expertise in Spark framework with scala language and Pyspark 2. Expertise in ETL and Data Warehousing and cloud concepts 3....

  • Lead Big Data Engineer

    2 months ago


    Gurgaon/Gurugram, India Huntingcube Recruitment Solutions Full time

    Job Description : - Lead the design and implementation of scalable and efficient big data architectures, ensuring optimal performance, security, and scalability. - Design, build, and maintain complex data pipelines that process large volumes of data from multiple sources, ensuring data is clean, reliable, and accessible.- Implement and manage big data...

  • Data Engineer

    1 month ago


    Gurgaon, Haryana, India Chiselon Technologies Pvt Ltd Full time

    We are seeking a talented Data Engineer with expertise in Big Data and Google Cloud Platform (GCP) to join our team at Chiselon Technologies Pvt Ltd.This role is ideal for individuals with hands-on experience in Big Query, Data Proc, Airflow, Cloud Composer, GCP Hydra Services, and Cloud Data Optimization.Key responsibilities:Design and develop scalable data...

  • Big Data Engineer

    1 month ago


    Gurgaon, Haryana, India ACS Consultants Full time

    **Job Title:** Big Data Engineer**Job Summary:We are seeking an experienced Big Data Engineer to join our team at ACS Consultants. As a key member of our data science team, you will be responsible for designing, developing, and managing large-scale data processing systems using Hadoop, Hive, and Spark.Main Responsibilities:• Design and implement scalable...

  • Big Data Engineer

    1 month ago


    Gurgaon, Haryana, India Spectral Consultants – Search & Recruitment firm Full time

    Job Title: Big Data DeveloperJob Summary:We are seeking an experienced Big Data Developer to join our team at Spectral Consultants. The ideal candidate will have a strong background in building scalable and efficient data pipelines using Hive, Spark, Hadoop, and MapReduce.Key Responsibilities:Design, implement, and optimize large-scale data processing...

  • Data Engineer

    1 month ago


    Gurgaon, Haryana, India Spectral Consultants – Search & Recruitment firm Full time

    Job Role : Data Engineer - Big Data ArchitectureWe are seeking a skilled Data Engineer to join our team at Spectral Consultants. As a Data Engineer, you will play a crucial role in designing, building, and maintaining large-scale data processing pipelines using Big Data technologies like Hive, Spark, Hadoop, and MapReduce.Key Responsibilities :Design and...

  • Data Engineer

    4 weeks ago


    Chennai, Tamil Nadu, India RiskInsight Consulting Pvt Ltd Full time

    Job Title: Data Engineer - Big Data ArchitectureJob Summary:We are seeking a highly skilled Data Engineer to design, develop, and deploy scalable Big Data applications using Apache Spark.The successful candidate will collaborate with data scientists and business analysts to understand requirements and translate them into technical solutions.The Data Engineer...


  • Gurgaon, Haryana, India Uncap Research Labs Full time

    Data Engineering Role at Uncap Research LabsWe are seeking a highly skilled Data Engineer to join our team at Uncap Research Labs. This role will involve designing and implementing scalable data services, developing and deploying production data pipelines, and optimizing big data systems for performance and efficiency.Key Responsibilities Apache Spark and...


  • Chennai, Tamil Nadu, India RiskInsight Consulting Pvt Ltd Full time

    RiskInsight Consulting Pvt Ltd seeks a highly skilled Senior Big Data Engineer to join its team of experts. As a key member of our data engineering team, you will be responsible for designing, developing, and deploying scalable Big Data applications using Hadoop ecosystem technologies. Your expertise in HDFS, Hive, and other related technologies will be...

  • Data Engineer

    1 month ago


    Chennai, Tamil Nadu, India Kiash Solutions LLP Full time

    Data Engineer - Big Data TechnologiesAt Kiash Solutions LLP, we are seeking a highly skilled Data Engineer - Big Data Technologies to join our team. The ideal candidate will have a strong background in Big Data technologies and Spark, with a minimum of 4 years of experience in data processing and analysis.Key Responsibilities:Analyze, organize and process...

  • Big Data Engineer

    2 months ago


    Chennai, India TapTalent.ai Full time

    AboutCompany: Our Company is a globaltechnology consulting and digital solutions company that enablesenterprises to reimagine business models and accelerate innovationthrough digital technologies. Powered by more than 84000entrepreneurial professionals across more than 30 countries catersto over 700 clients. Our extensive domain and technology expertisehelps...

  • Big Data Engineer

    1 month ago


    Chennai/Pune, India Pan Asia Man power Consultants Recruiting agency Full time

    Big Data EngineerWe are seeking a skilled Big Data Engineer to contribute to building backend data applications and services. This role requires expertise in various technologies to drive our data initiatives.Key Responsibilities:Design, develop, and maintain backend data applications and services.Collaborate with product owners and team members to gather...


  • Chennai, Tamil Nadu, India RiskInsight Consulting Pvt Ltd Full time

    RiskInsight Consulting Pvt Ltd is seeking a Senior Big Data Engineer to join our team.Key Responsibilities:Design and Develop Big Data Applications: Utilize Apache Spark to create scalable and efficient Big Data applications.Collaborate with Data Scientists and Business Analysts: Work with cross-functional teams to understand requirements and translate them...

  • Big Data Engineer

    2 weeks ago


    navi mumbai, India Pert Telecom Solutions Full time

    Job Description : We are seeking a skilled Big Data Engineer with deep expertise in PySpark, Python, MySQL, Hadoop and Linux. The ideal candidate should have extensive experience deploying and managing these tools within on-premises environments (no public cloud). Proficiency in cluster management, performance optimization, and monitoring is essential for...

  • Big Data Engineer

    1 week ago


    Coimbatore, Chennai, India Talodyn Networks Private Limited Full time

    DescriptionWe are seeking a highly skilled Big Data Engineer with 5-9 years of experience to join our team in India. The ideal candidate should have a strong technical background in big data technologies and be able to design, develop, and maintain large-scale data processing systems. The candidate should also be able to work collaboratively with...