Innovative Big Data Solutions Engineer

18 hours ago


Hyderabad, Telangana, India data Full time
About the Role

We are seeking an experienced Big Data Solutions Engineer to join our team in Hyderabad, India. As a key member of our engineering team, you will be responsible for designing and implementing complex data products components based on requirements with possible technical solutions.

You will work closely with Data Scientists, Data Engineers, Product Managers, and Software Architects to build out new product features and applications using agile methodologies and open-source technologies.

Key Responsibilities
  • Design and implement complex data product components based on requirements with possible technical solutions.
  • Write data programs using Python (e.g., PySpark) with a commitment to maintaining high-quality work while being confident in dealing with data mining challenges.
  • Discover any feasible new technologies lying in the Big Data ecosystem, for example, the Hadoop ecosystem, and share them with the team with your professional perspectives.
  • Get up to speed in the data science and machine learning domain, implementing analysis components in a distributed computing environment (e.g., MapReduce implementation) with instruction from Data Scientists.
  • Be comfortable conducting detailed discussions with Data Scientists regarding specific questions related to specific data models.
Requirements
  • Hands-on experience and deep knowledge of the Hadoop ecosystem.
  • Must: PySpark, MapReduce, HDFS.
  • Plus: Storm, Kafka.
  • Must have 2+ years of Linux environment development experience.
  • Proficient with programming in Python & Scala, experience in Pandas, Sklearn or Other data science and data analysis toolset is a big plus.
  • Experience in data pipeline design & automation.
  • Having a background in data mining, analytics & data science components implementation, and machine learning domain, familiarity with common algorithms and libs is a plus.
  • Possion for cloud computing (AWS in particular) and distributed systems.
  • You must be a great problem solver with the ability to dive deeply into complex problems and emerge with clear and pragmatic solutions.
  • Good communication, and cooperation globally.

  • Big Data Engineer

    4 weeks ago


    Hyderabad, Telangana, India data Full time

    Overview: We're seeking a skilled Big Data Engineer to join our team at data.ai. As a key member of our engineering team, you will be responsible for designing and implementing innovative data solutions that drive business growth. If you're passionate about working with large data sets, have experience with big data technologies, and are eager to...


  • Hyderabad, Telangana, India NTT DATA Full time

    Job Title: Data EngineerJob Summary:We are seeking a skilled Data Engineer to design, build, and maintain large-scale data systems. The ideal candidate will have expertise in big data ecosystems, data processing, and data storage.Key Responsibilities:Design and develop scalable data systems for business applications.Work closely with data scientists to...


  • Hyderabad, Telangana, India DBS Bank Full time

    Job Title: Data Engineer for Big Data SolutionsRole Overview:As a Data Engineer for Big Data Solutions, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Big Data technologies. You will work closely with cross-functional teams to understand business requirements and translate them into effective...


  • Hyderabad, Telangana, India Epam Full time

    EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities.We embrace a dynamic and inclusive culture where collaboration with multi-national teams is encouraged, and innovative projects are delivered that showcase the most...

  • Big Data Engineer

    4 weeks ago


    Hyderabad, Telangana, India ANB IT Solutions Pvt Ltd Full time

    Key ResponsibilitiesCollaborate with cross-functional teams to design, develop, and maintain big data solutions using Google Cloud Big Query. Key responsibilities include data ingestion, transformation, and analytics.Data Engineering and DevelopmentDevelop and maintain ETL/ELT processes to ensure data integrity and consistency. Utilize Google Cloud Composer,...


  • Hyderabad, Telangana, India Alignity Solutions Full time

    We are seeking an experienced data engineer to join our team at Alignity Solutions in Mumbai. The ideal candidate will have expertise in Apache Spark and Python programming, focusing on building scalable, high-performance data processing pipelines.Job Description:The role of a PySpark Developer involves developing, testing, and maintaining large-scale data...

  • Big Data Engineer

    3 weeks ago


    Hyderabad, Telangana, India NTT DATA Services Full time

    Data Engineer RoleData engineers at NTT DATA Services are responsible for building and testing scalable Big Data ecosystems for our clients. They work closely with data scientists to ensure the source data is aggregated and cleansed, and with product managers to understand the business objectives. Data engineers must have expertise in all phases of data...


  • Hyderabad, Telangana, India Tiger Analytics Full time

    Job DescriptionWe are looking for a Senior Data Engineer to join our Tiger Analytics team based out of Chennai, Bangalore & Hyderabad offices.This role involves a combination of hands-on contribution, customer engagement, and technical team management. As a Senior Data Engineer, you will design and build solutions for near real-time stream processing as well...


  • Hyderabad, Telangana, India Mempage Full time

    About the RoleWe are seeking a highly skilled Data Engineering Specialist to contribute to the design, development, and maintenance of our data infrastructure at Mempage. You will be responsible for building and optimizing data pipelines to support our business analytics and machine learning initiatives.Key Responsibilities:- Design, develop, and implement...

  • Big Data Engineer

    1 month ago


    Hyderabad, Telangana, India TechSophy Full time

    Job Title: Big Data EngineerJob Summary:We are seeking a highly skilled Big Data Engineer to join our team at TechSophy. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems.Key Responsibilities:Analyze large data sets to identify errors in the map.Design and implement complex...


  • Hyderabad, Telangana, India Tata Consultancy Services Full time

    About Tata Consultancy ServicesTata Consultancy Services is a leading IT services company that empowers global businesses through its cutting-edge technology and innovative solutions.Compensation PackageThe estimated salary for this role is around $120,000 - $180,000 per annum, depending on the location and individual qualifications.About the RoleJob...


  • Hyderabad, Telangana, India NucleusTeq Full time

    Big Data Engineer Responsibilities:  Big Data Engineer with 5+ years of experience and expertise in Spark, Scala/Java, Airflow Orchestration, and AWS. Strategic leadership of teams, inspiring innovation and progress in the domain and implementation. Development and optimization of Big Data solutions to meet business needs. Collaboration with software...

  • Big Data Developer

    6 days ago


    Hyderabad, Telangana, India People Tech Group Inc Full time

    Job Title: Big Data Developer - Expert in Scalable Data SolutionsPeople Tech Group Inc. is seeking a highly skilled Big Data Developer to join our team.Estimated Salary: $120,000 - $180,000 per annum based on location and experience.Job Description:We are looking for an experienced Big Data Developer to work on complex enterprise-wide initiatives spanning...

  • Data Engineer

    4 weeks ago


    Hyderabad, Telangana, India UnitedHealth Group Full time

    About UnitedHealth GroupAt UnitedHealth Group, our mission is to help people live healthier lives and make the health system work better for everyone. We believe everyone–of every race, gender, sexuality, age, location and income–deserves the opportunity to live their healthiest life. Today, however, there are still far too many barriers to good health...


  • Hyderabad, Telangana, India Vidpro Consultancy Services Full time

    Job Title: Senior Big Data EngineerJob Summary: Vidpro Consultancy Services is seeking a highly skilled Senior Big Data Engineer to join our team. As a key member of our engineering team, you will be responsible for designing, developing, and maintaining large-scale big data architectures using Java, Python, and Hadoop technologies.Responsibilities:Design...


  • Hyderabad, Telangana, India Radiant Systems (India) Pvt. Ltd. Full time

    As a Big Data Solutions Architect at Radiant Systems (India) Pvt. Ltd., you will design, build, and maintain big data solutions using PySpark, Hadoop, and SQL Server. Key responsibilities include developing and optimizing ETL processes to handle large-scale data processing and integration, utilizing SQL and PySpark for data manipulation, transformation, and...


  • Hyderabad, Telangana, India Findernest Software Services Pvt Ltd Full time

    About the RoleWe are seeking a highly skilled Senior Big Data Engineer to join our team at Findernest Software Services Pvt Ltd. As a Senior Big Data Engineer, you will be responsible for designing, developing, and maintaining scalable big data solutions that drive business growth and decision-making.Key ResponsibilitiesDesign and implement big data...

  • Big Data Engineer

    1 month ago


    Hyderabad, Telangana, India Devenir Software Private Limited Full time

    Job DescriptionWe are seeking a skilled Big Data Engineer to join our team at Devenir Software Private Limited. The ideal candidate will have hands-on experience with Big Data Hadoop, Spark, and AWS Cloud technologies.Key Responsibilities:Design and develop scalable data pipelines using Big Data Hadoop and Spark.Implement data storage solutions using AWS S3,...


  • Hyderabad, Telangana, India Tiger Analytics Full time

    About the Role:We are seeking a Senior Data Engineer to be based out of our Chennai office. This role involves a combination of hands-on contribution, customer engagement, and technical team management. As a Senior Data Engineer, you willDesign and build solutions for near real-time stream processing as well as batch processing on the Big Data platform.Set...


  • Hyderabad, Telangana, India Tiger Analytics Full time

    Job Title: Big Data Solutions ArchitectAbout Tiger Analytics: Tiger Analytics is a leading provider of data analytics solutions, dedicated to helping businesses make informed decisions.Salary: $180,000 - $250,000 per year.Job Description: We are seeking an experienced Big Data Solutions Architect to lead the design and implementation of scalable and...