Senior Big Data Engineer
6 days ago
We are seeking a highly skilled Senior Big Data Engineer to join our team at Findernest Software Services Pvt Ltd. As a key member of our organization, you will play a crucial role in designing, developing, and maintaining scalable big data solutions.
Key Responsibilities:- Design and implement big data solutions using technologies such as Hadoop and Spark.
- Develop and deploy scalable software solutions, ensuring high performance, scalability, and reliability.
- Build and manage large data lakes and data warehouses, leveraging technologies like Snowflake, Redshift, and Synapse.
- Develop and optimize data pipelines for processing high volumes of data, ensuring efficient storage and retrieval.
- Collaborate with cross-functional teams within an Agile framework, utilizing tools like Scrum.
- Ensure the performance, scalability, and reliability of data solutions, leading medium to large-scale projects that align with strategic business objectives.
- Develop and maintain ETL processes to acquire and process large volumes of data, optimizing and tuning the performance of big data applications and platforms.
- Collaborate with data scientists and analysts to understand data requirements and deliver appropriate solutions, conducting data modeling to ensure efficient storage and retrieval of data.
- Implement and manage data security and privacy measures, identifying and addressing data quality issues and ensuring data accuracy.
- Contribute to the development of data governance practices and standards, staying updated on emerging big data technologies and recommending potential solutions.
- Provide technical leadership and mentorship to junior team members.
- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
- Proven 7+ years of experience in developing and maintaining big data solutions.
- Strong experience with SQL and NoSQL databases, proficient in data warehousing and data lake architecture.
- Experience with Snowflake or similar data warehousing technologies, at least 2 years of experience in deploying and maintaining software in public cloud environments like AWS or Azure.
- Proficiency in programming languages such as Python, Java, or Scala, strong understanding of Hadoop ecosystem including HDFS, MapReduce, YARN, and Hive.
- Experience with real-time data processing frameworks like Kafka or Storm, ability to design and optimize data storage and retrieval processes.
- Expertise in ETL tools and processes, familiarity with cloud-based big data solutions such as AWS EMR or Azure HDInsight.
- Excellent problem-solving and analytical skills, effective communication and teamwork abilities.
kinesis, emr, mapreduce, nosql, lambda, synapse, aws, java, spark, glue, hive, bigdata, yarn, hadoop, datamodeling, cloud, design, snowflake, scala, sql, scrum, hdfs, aws emr, azurehdinsight, data warehousing, etl tools, azure, data, storm, kafka, datasolutions, etl, sqs, python, redshift
-
Big Data Engineer
6 days ago
Hyderabad, Telangana, India data Full timeAbout the RoleWe are seeking an experienced Big Data Engineer to join our team at data.ai India subsidiary entity. As a key member of our engineering team, you will be responsible for designing and implementing complex data product components based on requirements with possible technical solutions.Key ResponsibilitiesDesign and implement data processing...
-
Senior Big Data Engineer
1 day ago
Hyderabad, Telangana, India Virtusa Full timeJob Title: Senior Big Data EngineerJob Summary:We are seeking a highly skilled Senior Big Data Engineer to join our team at Virtusa. As a Senior Big Data Engineer, you will be responsible for designing, building, and supporting data applications using Spark, Sqoop, and Hive.Key Responsibilities:Design and develop data applications using Spark, Sqoop, and...
-
Big Data Engineer, Data Modeling Expert
24 hours ago
Hyderabad, Telangana, India data Full timeAbout the RoleWe are seeking an experienced Big Data Engineer to join our team at data.ai. As a key member of our engineering team, you will be responsible for designing and implementing complex data product components based on requirements with possible technical solutions.Key ResponsibilitiesDesign and implement data processing programs using Python (e.g.,...
-
Big Data Engineer
4 days ago
Hyderabad, Telangana, India data Full timeAbout the RoleWe are seeking an experienced Big Data Engineer to join our team in Hyderabad, India. As a key member of our engineering team, you will be responsible for designing and implementing complex data product components based on requirements with possible technical solutions.Key ResponsibilitiesDesign and implement data processing programs using...
-
Data Engineer
24 hours ago
Hyderabad, Telangana, India NTT DATA Services Full timeJob Title: Data Engineer - Big Data SpecialistAt NTT DATA Services, we are seeking a skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing and developing scalable Big Data ecosystems for our clients. Your expertise will help us build stable and highly optimized data systems, ensuring seamless data processing and...
-
Big Data Engineer
6 days ago
Hyderabad, Telangana, India Virtusa Full timeJob Title: Big Data Python EngineerWe are seeking a highly skilled Big Data Python Engineer to join our team at Virtusa. As a key member of our data engineering team, you will be responsible for designing and implementing data processing pipelines using Python and Scala programming languages, as well as big data technologies such as Hadoop, MapReduce, Hive,...
-
Big Data Engineer
6 days ago
Hyderabad, Telangana, India Virtusa Full timeJob Title: Big Data EngineerWe are seeking a highly skilled Big Data Engineer to join our team at Virtusa. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using big data technologies such as Hadoop, Spark, and NoSQL databases.Key Responsibilities:Design and develop big data...
-
Senior Big Data Engineer
5 days ago
Hyderabad, Telangana, India Virtusa Full timeJob Summary: We are seeking a highly skilled Senior Big Data Engineer to lead our team in designing, building, and supporting data applications using Spark, Sqoop, and Hive. The ideal candidate will have a strong background in Unix and Shell scripting, as well as advanced knowledge of the Hadoop ecosystem and its components. Key Responsibilities: •...
-
Big Data Engineer
5 days ago
Hyderabad, Telangana, India TechSophy Full timeJob Title: Big Data EngineerJob Summary:We are seeking a highly skilled Big Data Engineer to join our team at TechSophy. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems.Key Responsibilities:Analyze large data sets to identify errors in the map.Design and implement complex...
-
Big Data Engineer
6 days ago
Hyderabad, Telangana, India Vidpro Consultancy Services Full timeJob Title: Big Data Engineer JavaPython DSAThis is a unique opportunity to join Vidpro Consultancy Services as a Big Data Engineer, working on large-scale Big Data architectures. As a key member of our team, you will be responsible for designing, developing, and implementing scalable data processing systems using Java, Python, and other...
-
Big Data Engineer
6 days ago
Hyderabad, Telangana, India TechSophy Full timeJob Title: Big Data EngineerJob Summary:We are seeking a highly skilled Big Data Engineer to join our team at TechSophy. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems. You will work closely with our data science team to develop and implement data-driven solutions that drive...
-
Big Data Engineer
6 days ago
Hyderabad, Telangana, India Virtusa Full timeJob Title: Big Data EngineerWe are seeking a highly skilled Big Data Engineer to join our team at Virtusa. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using big data technologies such as Hadoop, Spark, and NoSQL databases.Key Responsibilities:Design and develop data pipelines...
-
Big Data Engineer
6 days ago
Hyderabad, Telangana, India Virtusa Full timeJob Title: Big Data Python EngineerVirtusa is seeking a highly skilled Big Data Python Engineer to join our team.Key Responsibilities:Design and implement data processing pipelines using Python and big data technologies such as Hadoop, MapReduce, Hive, and Spark.Develop and maintain data assets using PySpark.Collaborate with data and business analysts to...
-
Big Data Engineer
2 days ago
Hyderabad, Telangana, India Nisum Full timeAbout the RoleWe are seeking a highly skilled Big Data Engineer to join our team at Nisum. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems.Key ResponsibilitiesAnalyze complex business requirements and generate technical specifications to design or redesign complex software...
-
Big Data Engineer
23 hours ago
Hyderabad, Telangana, India Virtusa Full timeJob Summary We are seeking a highly skilled Big Data Engineer to join our team at Virtusa. The ideal candidate will have experience in designing and implementing data processing pipelines using Python and big data technologies such as Hadoop, MapReduce, Hive, and Spark. Key ResponsibilitiesDesign and implement data processing pipelines using Python and big...
-
Big Data Engineer
6 days ago
Hyderabad, Telangana, India RiDiK (a Subsidiary of CLPS. Nasdaq: CLPS) Full timeJob SummaryWe are seeking a highly skilled and innovative Big Data Engineer to join our dynamic team at RiDiK (a Subsidiary of CLPS. Nasdaq: CLPS). The ideal candidate will be responsible for designing, building, and maintaining scalable data processing systems that support analytics and machine learning initiatives.Key ResponsibilitiesDesign and implement...
-
Big Data Engineer
24 hours ago
Hyderabad, Telangana, India Nisum Full timeAbout the RoleWe are seeking a highly skilled Big Data Engineer to join our team at Nisum. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems.Key ResponsibilitiesAnalyze complex business requirements and generate technical specifications to design or redesign complex software...
-
Big Data Engineer
5 days ago
Hyderabad, Telangana, India Virtusa Full timeJob Title: Big Data Python EngineerWe are seeking a highly skilled Big Data Python Engineer to join our team at Virtusa. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Python and big data technologies such as Hadoop, MapReduce, Hive, and Spark.Key...
-
Big Data Solutions Architect
24 hours ago
Hyderabad, Telangana, India Findernest Software Services Pvt Ltd Full timeJob SummaryWe are seeking a highly skilled Senior Big Data Engineer to join our team at Findernest Software Services Pvt Ltd. The ideal candidate will have a strong background in designing, developing, and maintaining scalable big data solutions.Key ResponsibilitiesDesign and implement big data solutions using technologies such as Hadoop and Spark.Develop...
-
Big Data Engineer
7 days ago
Hyderabad, Telangana, India Nisum Full timeAbout the RoleWe are seeking a highly skilled Big Data Engineer to join our team at Nisum India. As a key member of our data engineering team, you will be responsible for designing, developing, and implementing large-scale data processing systems using Hadoop, Python, and other related technologies.Key ResponsibilitiesAnalyze complex business requirements...