Senior Big Data Engineer

3 weeks ago


Hyderabad, Telangana, India Findernest Software Services Pvt Ltd Full time
Job Title: Senior Big Data Engineer

About the Role:

At Findernest Software Services Pvt Ltd, we are seeking a highly skilled Senior Big Data Engineer to join our team. As a Senior Big Data Engineer, you will play a crucial role in designing, developing, and maintaining scalable big data solutions. This role is essential in harnessing the power of data to drive informed business decisions and strategic initiatives.

Key Responsibilities:

• Design and implement big data solutions using technologies such as Hadoop and Spark.
• Design, develop, deploy, and maintain scalable software solutions.
• Build and manage large data lakes and data warehouses (e.g. Snowflake, Redshift, Synapse).
• Develop and optimize data pipelines for processing high volumes of data.
• Work with AWS resources including Kinesis, EMR, Glue, SQS, Lambda, etc.
• Collaborate with cross-functional teams within an Agile framework (Scrum).
• Ensure the performance, scalability, and reliability of data solutions.
• Lead medium to large-scale projects that align with strategic business objectives.
• Develop and maintain ETL processes to acquire and process large volumes of data.
• Optimize and tune the performance of big data applications and platforms.
• Collaborate with data scientists and analysts to understand data requirements and deliver appropriate solutions.
• Conduct data modeling to ensure efficient storage and retrieval of data.
• Implement and manage data security and privacy measures.
• Identify and address data quality issues and ensure data accuracy.
• Contribute to the development of data governance practices and standards.
• Stay updated on emerging big data technologies and recommend potential solutions.
• Provide technical leadership and mentorship to junior team members.

Requirements:

• Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
• Proven 7+ years of experience in developing and maintaining big data solutions.
• Strong experience with SQL and NoSQL databases.
• Proficient in data warehousing and data lake architecture.
• Experience with Snowflake or similar data warehousing technologies.
• At least 2 years of experience in deploying and maintaining software in public cloud environments like AWS or Azure.
• Proficiency in programming languages such as Python, Java, or Scala.
• Strong understanding of Hadoop ecosystem including HDFS, MapReduce, YARN, and Hive.
• Experience with real-time data processing frameworks like Kafka or Storm.
• Ability to design and optimize data storage and retrieval processes.
• Expertise in ETL tools and processes.
• Familiarity with cloud-based big data solutions such as AWS EMR or Azure HDInsight.
• Excellent problem-solving and analytical skills.
• Effective communication and teamwork abilities.
  • Big Data Engineer

    2 weeks ago


    Hyderabad, Telangana, India data Full time

    Overview: We're seeking a skilled Big Data Engineer to join our team at data.ai. As a key member of our engineering team, you will be responsible for designing and implementing innovative data solutions that drive business growth. If you're passionate about working with large data sets, have experience with big data technologies, and are eager to...


  • Hyderabad, Telangana, India Virtusa Full time

    Job Title: Senior Big Data EngineerJob Summary:We are seeking a highly skilled Senior Big Data Engineer to join our team at Virtusa. As a Senior Big Data Engineer, you will be responsible for designing, building, and supporting data applications using Spark, Sqoop, and Hive.Key Responsibilities:Design and develop data applications using Spark, Sqoop, and...


  • Hyderabad, Telangana, India Vidpro Consultancy Services Full time

    Job Title: Senior Big Data EngineerJob Summary: Vidpro Consultancy Services is seeking a highly skilled Senior Big Data Engineer to join our team. As a key member of our engineering team, you will be responsible for designing, developing, and maintaining large-scale big data architectures using Java, Python, and Hadoop technologies.Responsibilities:Design...


  • Hyderabad, Telangana, India data Full time

    About the RoleWe are seeking an experienced Big Data Engineer to join our team at data.ai. As a key member of our engineering team, you will be responsible for designing and implementing complex data product components based on requirements with possible technical solutions.Key ResponsibilitiesDesign and implement data processing programs using Python (e.g.,...


  • Hyderabad, Telangana, India Findernest Software Services Pvt Ltd Full time

    About the RoleWe are seeking a highly skilled Senior Big Data Engineer to join our team at Findernest Software Services Pvt Ltd. As a Senior Big Data Engineer, you will be responsible for designing, developing, and maintaining scalable big data solutions that drive business growth and decision-making.Key ResponsibilitiesDesign and implement big data...


  • Hyderabad, Telangana, India Nisum Full time

    Job Title: Senior Big Data EngineerAbout the Role:We are seeking a highly skilled Senior Big Data Engineer to join our team at Nisum. As a key member of our engineering team, you will be responsible for designing, building, and maintaining large-scale data processing systems using Hadoop, Python, and other big data technologies.Key Responsibilities:- Design...

  • Big Data Engineer

    4 weeks ago


    Hyderabad, Telangana, India data Full time

    About the RoleWe are seeking an experienced Big Data Engineer to join our team in Hyderabad, India. As a key member of our engineering team, you will be responsible for designing and implementing complex data product components based on requirements with possible technical solutions.Key ResponsibilitiesDesign and implement data processing programs using...


  • Hyderabad, Telangana, India data Full time

    Unlock the Power of Data with UsWe're seeking an experienced Big Data Engineer to join our team and contribute to the development of innovative analytics and data products. As a key member of our engineering team, you will work closely with Data Scientists, Data Engineers, Product Managers, and Software Architects to design and implement complex data product...


  • Hyderabad, Telangana, India NTT DATA Full time

    Job Title: Data EngineerJob Summary:We are seeking a skilled Data Engineer to design, build, and maintain large-scale data systems. The ideal candidate will have expertise in big data ecosystems, data processing, and data storage.Key Responsibilities:Design and develop scalable data systems for business applications.Work closely with data scientists to...


  • Hyderabad, Telangana, India Virtusa Full time

    Job Title: Senior Big Data EngineerJob Summary:We are seeking a Senior Big Data Engineer to join our team at Virtusa. The ideal candidate will have a strong background in designing, building, and supporting data applications using Spark, Sqoop, and Hive.Key Responsibilities:Design and develop complex data applications using Spark, Sqoop, and Hive.Work with...

  • Big Data Engineer

    2 weeks ago


    Hyderabad, Telangana, India NTT DATA Services Full time

    Data Engineer RoleData engineers at NTT DATA Services are responsible for building and testing scalable Big Data ecosystems for our clients. They work closely with data scientists to ensure the source data is aggregated and cleansed, and with product managers to understand the business objectives. Data engineers must have expertise in all phases of data...

  • Data Engineer

    4 weeks ago


    Hyderabad, Telangana, India NTT DATA Services Full time

    Job Title: Data Engineer - Big Data SpecialistAt NTT DATA Services, we are seeking a skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing and developing scalable Big Data ecosystems for our clients. Your expertise will help us build stable and highly optimized data systems, ensuring seamless data processing and...


  • Hyderabad, Telangana, India Findernest Software Services Pvt Ltd Full time

    About the Role:We are seeking a highly skilled Senior Big Data Engineer to join our team at Findernest Software Services Pvt Ltd. As a key member of our organization, you will play a crucial role in designing, developing, and maintaining scalable big data solutions.Key Responsibilities:Design and implement big data solutions using technologies such as Hadoop...


  • Hyderabad, Telangana, India SPG Consulting Full time

    At SPG Consulting, we are seeking a highly skilled and experienced Senior Big Data Engineer to join our team. As a key member of our engineering team, you will be working on designing, building, and maintaining large-scale distributed systems using Scala and Spark.Key Responsibilities:Design and develop high-performance, scalable, and fault-tolerant...


  • Hyderabad, Telangana, India Rightpath Computer Technologies Pvt Ltd Full time

    Job OverviewWe are seeking a highly skilled Senior Big Data Engineer to join our team at Rightpath Computer Technologies Pvt Ltd. This is a challenging role that requires expertise in designing, building, and maintaining large-scale data processing systems.


  • Hyderabad, Telangana, India Virtusa Full time

    Job Title: Senior Data Platform EngineerJob Summary:Job Description: We are seeking a talented Senior Data Platform Engineer to join our team at Virtusa. As a Senior Data Platform Engineer, you will be responsible for designing, developing, and maintaining large-scale data platforms using Python. You will work closely with cross-functional teams to...

  • Big Data Engineer

    2 weeks ago


    Hyderabad, Telangana, India ANB IT Solutions Pvt Ltd Full time

    Key ResponsibilitiesCollaborate with cross-functional teams to design, develop, and maintain big data solutions using Google Cloud Big Query. Key responsibilities include data ingestion, transformation, and analytics.Data Engineering and DevelopmentDevelop and maintain ETL/ELT processes to ensure data integrity and consistency. Utilize Google Cloud Composer,...

  • Big Data Engineer

    3 weeks ago


    Hyderabad, Telangana, India Virtusa Full time

    Job Title: Big Data EngineerJob Summary: We are seeking a skilled Big Data Engineer to design and implement data processing pipelines using Python and big data technologies such as Hadoop, MapReduce, Hive, and Spark.Key Responsibilities:Design and implement data processing pipelines using Python and big data technologies.Develop and maintain data assets...

  • Big Data Engineer

    4 weeks ago


    Hyderabad, Telangana, India Virtusa Full time

    Job Title: Big Data EngineerWe are seeking a highly skilled Big Data Engineer to join our team at Virtusa. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using big data technologies such as Hadoop, Spark, and NoSQL databases.Key Responsibilities:Design and develop big data...

  • Big Data Engineer

    3 weeks ago


    Hyderabad, Telangana, India Vidpro Consultancy Services Full time

    About the Role:Vidpro Consultancy Services is seeking a highly skilled Big Data Engineer to join our team. As a key member of our data architecture team, you will be responsible for designing and implementing large-scale Big Data architectures using Java and Python.Key Responsibilities:Design and implement Big Data architectures using Hadoop and SparkDevelop...