Big Data Engineer

4 days ago


Hyderabad, Telangana, India data Full time

About the Role

We are seeking an experienced Big Data Engineer to join our team in Hyderabad, India. As a key member of our engineering team, you will be responsible for designing and implementing complex data product components based on requirements with possible technical solutions.

Key Responsibilities

  • Design and implement data processing programs using Python (e.g., PySpark) with a commitment to maintaining high-quality work while being confident in dealing with data mining challenges.
  • Discover new technologies in the Big Data ecosystem and share them with the team with your professional perspectives.
  • Get up to speed in the data science and machine learning domain, implementing analysis components in a distributed computing environment (e.g., MapReduce implementation) with instruction from Data Scientists.
  • Be comfortable conducting detailed discussions with Data Scientists regarding specific questions related to specific data models.

Requirements

  • Hands-on experience and deep knowledge of the Hadoop ecosystem.
  • Must: PySpark, MapReduce, HDFS.
  • Plus: Storm, Kafka.
  • Must have 2+ years of Linux environment development experience.
  • Proficient with programming in Python & Scala, experience in Pandas, Sklearn or Other data science and data analysis toolset is a big plus.
  • Experience in data pipeline design & automation.
  • Having a background in data mining, analytics & data science components implementation, and machine learning domain, familiarity with common algorithms and libs is a plus.
  • Passion for cloud computing (AWS in particular) and distributed systems.
  • Good communication, and cooperation globally.
  • Major in Math or Computer Science.

About Us

We are a dynamic and entrepreneurial start-up, passionate about innovation and pushing the boundaries of what is possible with AI. We are looking for someone who shares our vision and is excited to join our team.


  • Big Data Engineer

    6 days ago


    Hyderabad, Telangana, India data Full time

    About the RoleWe are seeking an experienced Big Data Engineer to join our team at data.ai India subsidiary entity. As a key member of our engineering team, you will be responsible for designing and implementing complex data product components based on requirements with possible technical solutions.Key ResponsibilitiesDesign and implement data processing...


  • Hyderabad, Telangana, India data Full time

    About the RoleWe are seeking an experienced Big Data Engineer to join our team at data.ai. As a key member of our engineering team, you will be responsible for designing and implementing complex data product components based on requirements with possible technical solutions.Key ResponsibilitiesDesign and implement data processing programs using Python (e.g.,...

  • Data Engineer

    9 hours ago


    Hyderabad, Telangana, India NTT DATA Services Full time

    Job Title: Data Engineer - Big Data SpecialistAt NTT DATA Services, we are seeking a skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing and developing scalable Big Data ecosystems for our clients. Your expertise will help us build stable and highly optimized data systems, ensuring seamless data processing and...

  • Big Data Engineer

    6 days ago


    Hyderabad, Telangana, India Virtusa Full time

    Job Title: Big Data Python EngineerWe are seeking a highly skilled Big Data Python Engineer to join our team at Virtusa. As a key member of our data engineering team, you will be responsible for designing and implementing data processing pipelines using Python and Scala programming languages, as well as big data technologies such as Hadoop, MapReduce, Hive,...

  • Big Data Engineer

    5 days ago


    Hyderabad, Telangana, India Virtusa Full time

    Job Title: Big Data EngineerWe are seeking a highly skilled Big Data Engineer to join our team at Virtusa. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using big data technologies such as Hadoop, Spark, and NoSQL databases.Key Responsibilities:Design and develop big data...

  • Big Data Engineer

    4 days ago


    Hyderabad, Telangana, India TechSophy Full time

    Job Title: Big Data EngineerJob Summary:We are seeking a highly skilled Big Data Engineer to join our team at TechSophy. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems.Key Responsibilities:Analyze large data sets to identify errors in the map.Design and implement complex...

  • Big Data Engineer

    6 days ago


    Hyderabad, Telangana, India Vidpro Consultancy Services Full time

    Job Title: Big Data Engineer JavaPython DSAThis is a unique opportunity to join Vidpro Consultancy Services as a Big Data Engineer, working on large-scale Big Data architectures. As a key member of our team, you will be responsible for designing, developing, and implementing scalable data processing systems using Java, Python, and other...

  • Big Data Engineer

    6 days ago


    Hyderabad, Telangana, India TechSophy Full time

    Job Title: Big Data EngineerJob Summary:We are seeking a highly skilled Big Data Engineer to join our team at TechSophy. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems. You will work closely with our data science team to develop and implement data-driven solutions that drive...

  • Big Data Engineer

    6 days ago


    Hyderabad, Telangana, India Virtusa Full time

    Job Title: Big Data EngineerWe are seeking a highly skilled Big Data Engineer to join our team at Virtusa. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using big data technologies such as Hadoop, Spark, and NoSQL databases.Key Responsibilities:Design and develop data pipelines...

  • Big Data Engineer

    6 days ago


    Hyderabad, Telangana, India Virtusa Full time

    Job Title: Big Data Python EngineerVirtusa is seeking a highly skilled Big Data Python Engineer to join our team.Key Responsibilities:Design and implement data processing pipelines using Python and big data technologies such as Hadoop, MapReduce, Hive, and Spark.Develop and maintain data assets using PySpark.Collaborate with data and business analysts to...

  • Big Data Engineer

    1 day ago


    Hyderabad, Telangana, India Nisum Full time

    About the RoleWe are seeking a highly skilled Big Data Engineer to join our team at Nisum. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems.Key ResponsibilitiesAnalyze complex business requirements and generate technical specifications to design or redesign complex software...

  • Big Data Engineer

    9 hours ago


    Hyderabad, Telangana, India Virtusa Full time

    Job Summary We are seeking a highly skilled Big Data Engineer to join our team at Virtusa. The ideal candidate will have experience in designing and implementing data processing pipelines using Python and big data technologies such as Hadoop, MapReduce, Hive, and Spark. Key ResponsibilitiesDesign and implement data processing pipelines using Python and big...

  • Big Data Engineer

    5 days ago


    Hyderabad, Telangana, India RiDiK (a Subsidiary of CLPS. Nasdaq: CLPS) Full time

    Job SummaryWe are seeking a highly skilled and innovative Big Data Engineer to join our dynamic team at RiDiK (a Subsidiary of CLPS. Nasdaq: CLPS). The ideal candidate will be responsible for designing, building, and maintaining scalable data processing systems that support analytics and machine learning initiatives.Key ResponsibilitiesDesign and implement...

  • Big Data Engineer

    9 hours ago


    Hyderabad, Telangana, India Nisum Full time

    About the RoleWe are seeking a highly skilled Big Data Engineer to join our team at Nisum. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems.Key ResponsibilitiesAnalyze complex business requirements and generate technical specifications to design or redesign complex software...

  • Big Data Engineer

    4 days ago


    Hyderabad, Telangana, India Virtusa Full time

    Job Title: Big Data Python EngineerWe are seeking a highly skilled Big Data Python Engineer to join our team at Virtusa. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Python and big data technologies such as Hadoop, MapReduce, Hive, and Spark.Key...


  • Hyderabad, Telangana, India Virtusa Full time

    Job Title: Senior Big Data EngineerJob Summary:We are seeking a highly skilled Senior Big Data Engineer to join our team at Virtusa. As a Senior Big Data Engineer, you will be responsible for designing, building, and supporting data applications using Spark, Sqoop, and Hive.Key Responsibilities:Design and develop data applications using Spark, Sqoop, and...

  • Big Data Engineer

    6 days ago


    Hyderabad, Telangana, India Nisum Full time

    About the RoleWe are seeking a highly skilled Big Data Engineer to join our team at Nisum India. As a key member of our data engineering team, you will be responsible for designing, developing, and implementing large-scale data processing systems using Hadoop, Python, and other related technologies.Key ResponsibilitiesAnalyze complex business requirements...

  • Data Engineer

    5 days ago


    Hyderabad, Telangana, India data Full time

    Job DescriptionAbout the RoleWe are seeking a highly skilled Data Analyst to join our team at data.ai. As a Data Analyst, you will be responsible for analyzing, monitoring, and delivering comprehensive and high-quality app market data to app professionals.Key ResponsibilitiesTake full responsibility for data.ai core intelligence data qualityDeep...

  • Big Data Engineer

    4 days ago


    Hyderabad, Telangana, India Grid Dynamics Full time

    Big Data Developer RoleWe are seeking a highly skilled Big Data Developer to join our team at Grid Dynamics.Key Responsibilities:Design and develop scalable big data architectures using Java, Scala, and Python.Implement data processing pipelines using Kafka, Spark, and Airflow.Work with distributed databases such as PostgreSQL and Snowflake.Deploy and manage...


  • Hyderabad, Telangana, India Vidpro Consultancy Services Full time

    Job Title: Big Data Engineer JavaPython DSAThis is a unique opportunity to join Vidpro Consultancy Services as a Big Data Engineer JavaPython DSA. We are seeking a highly skilled and experienced professional to lead our Big Data initiatives and drive innovation in data-driven solutions.Key Responsibilities:Design and develop large-scale Big Data...