Senior Big Data Engineer

6 days ago

Hyderabad, Telangana, India Findernest Software Services Pvt Ltd Full time
About the Role:

We are seeking a highly skilled Senior Big Data Engineer to join our team at Findernest Software Services Pvt Ltd. As a key member of our organization, you will play a crucial role in designing, developing, and maintaining scalable big data solutions.

Key Responsibilities:
  • Design and implement big data solutions using technologies such as Hadoop and Spark.
  • Develop and deploy scalable software solutions, ensuring high performance, scalability, and reliability.
  • Build and manage large data lakes and data warehouses, leveraging technologies like Snowflake, Redshift, and Synapse.
  • Develop and optimize data pipelines for processing high volumes of data, ensuring efficient storage and retrieval.
  • Collaborate with cross-functional teams within an Agile framework, utilizing tools like Scrum.
  • Ensure the performance, scalability, and reliability of data solutions, leading medium to large-scale projects that align with strategic business objectives.
  • Develop and maintain ETL processes to acquire and process large volumes of data, optimizing and tuning the performance of big data applications and platforms.
  • Collaborate with data scientists and analysts to understand data requirements and deliver appropriate solutions, conducting data modeling to ensure efficient storage and retrieval of data.
  • Implement and manage data security and privacy measures, identifying and addressing data quality issues and ensuring data accuracy.
  • Contribute to the development of data governance practices and standards, staying updated on emerging big data technologies and recommending potential solutions.
  • Provide technical leadership and mentorship to junior team members.
Requirements:
  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
  • Proven 7+ years of experience in developing and maintaining big data solutions.
  • Strong experience with SQL and NoSQL databases, proficient in data warehousing and data lake architecture.
  • Experience with Snowflake or similar data warehousing technologies, at least 2 years of experience in deploying and maintaining software in public cloud environments like AWS or Azure.
  • Proficiency in programming languages such as Python, Java, or Scala, strong understanding of Hadoop ecosystem including HDFS, MapReduce, YARN, and Hive.
  • Experience with real-time data processing frameworks like Kafka or Storm, ability to design and optimize data storage and retrieval processes.
  • Expertise in ETL tools and processes, familiarity with cloud-based big data solutions such as AWS EMR or Azure HDInsight.
  • Excellent problem-solving and analytical skills, effective communication and teamwork abilities.

kinesis, emr, mapreduce, nosql, lambda, synapse, aws, java, spark, glue, hive, bigdata, yarn, hadoop, datamodeling, cloud, design, snowflake, scala, sql, scrum, hdfs, aws emr, azurehdinsight, data warehousing, etl tools, azure, data, storm, kafka, datasolutions, etl, sqs, python, redshift

  • Big Data Engineer

    6 days ago

    Hyderabad, Telangana, India data Full time

    About the RoleWe are seeking an experienced Big Data Engineer to join our team at data.ai India subsidiary entity. As a key member of our engineering team, you will be responsible for designing and implementing complex data product components based on requirements with possible technical solutions.Key ResponsibilitiesDesign and implement data processing...

  • Senior Big Data Engineer

    1 day ago

    Hyderabad, Telangana, India Virtusa Full time

    Job Title: Senior Big Data EngineerJob Summary:We are seeking a highly skilled Senior Big Data Engineer to join our team at Virtusa. As a Senior Big Data Engineer, you will be responsible for designing, building, and supporting data applications using Spark, Sqoop, and Hive.Key Responsibilities:Design and develop data applications using Spark, Sqoop, and...

  • Big Data Engineer, Data Modeling Expert

    24 hours ago

    Hyderabad, Telangana, India data Full time

    About the RoleWe are seeking an experienced Big Data Engineer to join our team at data.ai. As a key member of our engineering team, you will be responsible for designing and implementing complex data product components based on requirements with possible technical solutions.Key ResponsibilitiesDesign and implement data processing programs using Python (e.g.,...

  • Big Data Engineer

    4 days ago

    Hyderabad, Telangana, India data Full time

    About the RoleWe are seeking an experienced Big Data Engineer to join our team in Hyderabad, India. As a key member of our engineering team, you will be responsible for designing and implementing complex data product components based on requirements with possible technical solutions.Key ResponsibilitiesDesign and implement data processing programs using...

  • Data Engineer

    24 hours ago

    Hyderabad, Telangana, India NTT DATA Services Full time

    Job Title: Data Engineer - Big Data SpecialistAt NTT DATA Services, we are seeking a skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing and developing scalable Big Data ecosystems for our clients. Your expertise will help us build stable and highly optimized data systems, ensuring seamless data processing and...

  • Big Data Engineer

    6 days ago

    Hyderabad, Telangana, India Virtusa Full time

    Job Title: Big Data Python EngineerWe are seeking a highly skilled Big Data Python Engineer to join our team at Virtusa. As a key member of our data engineering team, you will be responsible for designing and implementing data processing pipelines using Python and Scala programming languages, as well as big data technologies such as Hadoop, MapReduce, Hive,...

  • Big Data Engineer

    6 days ago

    Hyderabad, Telangana, India Virtusa Full time

    Job Title: Big Data EngineerWe are seeking a highly skilled Big Data Engineer to join our team at Virtusa. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using big data technologies such as Hadoop, Spark, and NoSQL databases.Key Responsibilities:Design and develop big data...

  • Senior Big Data Engineer

    5 days ago

    Hyderabad, Telangana, India Virtusa Full time

    Job Summary: We are seeking a highly skilled Senior Big Data Engineer to lead our team in designing, building, and supporting data applications using Spark, Sqoop, and Hive. The ideal candidate will have a strong background in Unix and Shell scripting, as well as advanced knowledge of the Hadoop ecosystem and its components. Key Responsibilities: •...

  • Big Data Engineer

    5 days ago

    Hyderabad, Telangana, India TechSophy Full time

    Job Title: Big Data EngineerJob Summary:We are seeking a highly skilled Big Data Engineer to join our team at TechSophy. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems.Key Responsibilities:Analyze large data sets to identify errors in the map.Design and implement complex...

  • Big Data Engineer

    6 days ago

    Hyderabad, Telangana, India Vidpro Consultancy Services Full time

    Job Title: Big Data Engineer JavaPython DSAThis is a unique opportunity to join Vidpro Consultancy Services as a Big Data Engineer, working on large-scale Big Data architectures. As a key member of our team, you will be responsible for designing, developing, and implementing scalable data processing systems using Java, Python, and other...

  • Big Data Engineer

    6 days ago

    Hyderabad, Telangana, India TechSophy Full time

    Job Title: Big Data EngineerJob Summary:We are seeking a highly skilled Big Data Engineer to join our team at TechSophy. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems. You will work closely with our data science team to develop and implement data-driven solutions that drive...

  • Big Data Engineer

    6 days ago

    Hyderabad, Telangana, India Virtusa Full time

    Job Title: Big Data EngineerWe are seeking a highly skilled Big Data Engineer to join our team at Virtusa. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using big data technologies such as Hadoop, Spark, and NoSQL databases.Key Responsibilities:Design and develop data pipelines...

  • Big Data Engineer

    6 days ago

    Hyderabad, Telangana, India Virtusa Full time

    Job Title: Big Data Python EngineerVirtusa is seeking a highly skilled Big Data Python Engineer to join our team.Key Responsibilities:Design and implement data processing pipelines using Python and big data technologies such as Hadoop, MapReduce, Hive, and Spark.Develop and maintain data assets using PySpark.Collaborate with data and business analysts to...

  • Big Data Engineer

    2 days ago

    Hyderabad, Telangana, India Nisum Full time

    About the RoleWe are seeking a highly skilled Big Data Engineer to join our team at Nisum. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems.Key ResponsibilitiesAnalyze complex business requirements and generate technical specifications to design or redesign complex software...

  • Big Data Engineer

    23 hours ago

    Hyderabad, Telangana, India Virtusa Full time

    Job Summary We are seeking a highly skilled Big Data Engineer to join our team at Virtusa. The ideal candidate will have experience in designing and implementing data processing pipelines using Python and big data technologies such as Hadoop, MapReduce, Hive, and Spark. Key ResponsibilitiesDesign and implement data processing pipelines using Python and big...

  • Big Data Engineer

    6 days ago

    Hyderabad, Telangana, India RiDiK (a Subsidiary of CLPS. Nasdaq: CLPS) Full time

    Job SummaryWe are seeking a highly skilled and innovative Big Data Engineer to join our dynamic team at RiDiK (a Subsidiary of CLPS. Nasdaq: CLPS). The ideal candidate will be responsible for designing, building, and maintaining scalable data processing systems that support analytics and machine learning initiatives.Key ResponsibilitiesDesign and implement...

  • Big Data Engineer

    24 hours ago

    Hyderabad, Telangana, India Nisum Full time

    About the RoleWe are seeking a highly skilled Big Data Engineer to join our team at Nisum. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems.Key ResponsibilitiesAnalyze complex business requirements and generate technical specifications to design or redesign complex software...

  • Big Data Engineer

    5 days ago

    Hyderabad, Telangana, India Virtusa Full time

    Job Title: Big Data Python EngineerWe are seeking a highly skilled Big Data Python Engineer to join our team at Virtusa. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Python and big data technologies such as Hadoop, MapReduce, Hive, and Spark.Key...

  • Big Data Solutions Architect

    24 hours ago

    Hyderabad, Telangana, India Findernest Software Services Pvt Ltd Full time

    Job SummaryWe are seeking a highly skilled Senior Big Data Engineer to join our team at Findernest Software Services Pvt Ltd. The ideal candidate will have a strong background in designing, developing, and maintaining scalable big data solutions.Key ResponsibilitiesDesign and implement big data solutions using technologies such as Hadoop and Spark.Develop...

  • Big Data Engineer

    7 days ago

    Hyderabad, Telangana, India Nisum Full time

    About the RoleWe are seeking a highly skilled Big Data Engineer to join our team at Nisum India. As a key member of our data engineering team, you will be responsible for designing, developing, and implementing large-scale data processing systems using Hadoop, Python, and other related technologies.Key ResponsibilitiesAnalyze complex business requirements...