Big Data Engineer
4 days ago
About the Role
We are seeking an experienced Big Data Engineer to join our team in Hyderabad, India. As a key member of our engineering team, you will be responsible for designing and implementing complex data product components based on requirements with possible technical solutions.
Key Responsibilities
- Design and implement data processing programs using Python (e.g., PySpark) with a commitment to maintaining high-quality work while being confident in dealing with data mining challenges.
- Discover new technologies in the Big Data ecosystem and share them with the team with your professional perspectives.
- Get up to speed in the data science and machine learning domain, implementing analysis components in a distributed computing environment (e.g., MapReduce implementation) with instruction from Data Scientists.
- Be comfortable conducting detailed discussions with Data Scientists regarding specific questions related to specific data models.
Requirements
- Hands-on experience and deep knowledge of the Hadoop ecosystem.
- Must: PySpark, MapReduce, HDFS.
- Plus: Storm, Kafka.
- Must have 2+ years of Linux environment development experience.
- Proficient with programming in Python & Scala, experience in Pandas, Sklearn or Other data science and data analysis toolset is a big plus.
- Experience in data pipeline design & automation.
- Having a background in data mining, analytics & data science components implementation, and machine learning domain, familiarity with common algorithms and libs is a plus.
- Passion for cloud computing (AWS in particular) and distributed systems.
- Good communication, and cooperation globally.
- Major in Math or Computer Science.
About Us
We are a dynamic and entrepreneurial start-up, passionate about innovation and pushing the boundaries of what is possible with AI. We are looking for someone who shares our vision and is excited to join our team.
-
Big Data Engineer
6 days ago
Hyderabad, Telangana, India data Full timeAbout the RoleWe are seeking an experienced Big Data Engineer to join our team at data.ai India subsidiary entity. As a key member of our engineering team, you will be responsible for designing and implementing complex data product components based on requirements with possible technical solutions.Key ResponsibilitiesDesign and implement data processing...
-
Big Data Engineer, Data Modeling Expert
9 hours ago
Hyderabad, Telangana, India data Full timeAbout the RoleWe are seeking an experienced Big Data Engineer to join our team at data.ai. As a key member of our engineering team, you will be responsible for designing and implementing complex data product components based on requirements with possible technical solutions.Key ResponsibilitiesDesign and implement data processing programs using Python (e.g.,...
-
Data Engineer
9 hours ago
Hyderabad, Telangana, India NTT DATA Services Full timeJob Title: Data Engineer - Big Data SpecialistAt NTT DATA Services, we are seeking a skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing and developing scalable Big Data ecosystems for our clients. Your expertise will help us build stable and highly optimized data systems, ensuring seamless data processing and...
-
Big Data Engineer
6 days ago
Hyderabad, Telangana, India Virtusa Full timeJob Title: Big Data Python EngineerWe are seeking a highly skilled Big Data Python Engineer to join our team at Virtusa. As a key member of our data engineering team, you will be responsible for designing and implementing data processing pipelines using Python and Scala programming languages, as well as big data technologies such as Hadoop, MapReduce, Hive,...
-
Big Data Engineer
5 days ago
Hyderabad, Telangana, India Virtusa Full timeJob Title: Big Data EngineerWe are seeking a highly skilled Big Data Engineer to join our team at Virtusa. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using big data technologies such as Hadoop, Spark, and NoSQL databases.Key Responsibilities:Design and develop big data...
-
Big Data Engineer
4 days ago
Hyderabad, Telangana, India TechSophy Full timeJob Title: Big Data EngineerJob Summary:We are seeking a highly skilled Big Data Engineer to join our team at TechSophy. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems.Key Responsibilities:Analyze large data sets to identify errors in the map.Design and implement complex...
-
Big Data Engineer
6 days ago
Hyderabad, Telangana, India Vidpro Consultancy Services Full timeJob Title: Big Data Engineer JavaPython DSAThis is a unique opportunity to join Vidpro Consultancy Services as a Big Data Engineer, working on large-scale Big Data architectures. As a key member of our team, you will be responsible for designing, developing, and implementing scalable data processing systems using Java, Python, and other...
-
Big Data Engineer
6 days ago
Hyderabad, Telangana, India TechSophy Full timeJob Title: Big Data EngineerJob Summary:We are seeking a highly skilled Big Data Engineer to join our team at TechSophy. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems. You will work closely with our data science team to develop and implement data-driven solutions that drive...
-
Big Data Engineer
6 days ago
Hyderabad, Telangana, India Virtusa Full timeJob Title: Big Data EngineerWe are seeking a highly skilled Big Data Engineer to join our team at Virtusa. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using big data technologies such as Hadoop, Spark, and NoSQL databases.Key Responsibilities:Design and develop data pipelines...
-
Big Data Engineer
6 days ago
Hyderabad, Telangana, India Virtusa Full timeJob Title: Big Data Python EngineerVirtusa is seeking a highly skilled Big Data Python Engineer to join our team.Key Responsibilities:Design and implement data processing pipelines using Python and big data technologies such as Hadoop, MapReduce, Hive, and Spark.Develop and maintain data assets using PySpark.Collaborate with data and business analysts to...
-
Big Data Engineer
1 day ago
Hyderabad, Telangana, India Nisum Full timeAbout the RoleWe are seeking a highly skilled Big Data Engineer to join our team at Nisum. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems.Key ResponsibilitiesAnalyze complex business requirements and generate technical specifications to design or redesign complex software...
-
Big Data Engineer
9 hours ago
Hyderabad, Telangana, India Virtusa Full timeJob Summary We are seeking a highly skilled Big Data Engineer to join our team at Virtusa. The ideal candidate will have experience in designing and implementing data processing pipelines using Python and big data technologies such as Hadoop, MapReduce, Hive, and Spark. Key ResponsibilitiesDesign and implement data processing pipelines using Python and big...
-
Big Data Engineer
5 days ago
Hyderabad, Telangana, India RiDiK (a Subsidiary of CLPS. Nasdaq: CLPS) Full timeJob SummaryWe are seeking a highly skilled and innovative Big Data Engineer to join our dynamic team at RiDiK (a Subsidiary of CLPS. Nasdaq: CLPS). The ideal candidate will be responsible for designing, building, and maintaining scalable data processing systems that support analytics and machine learning initiatives.Key ResponsibilitiesDesign and implement...
-
Big Data Engineer
9 hours ago
Hyderabad, Telangana, India Nisum Full timeAbout the RoleWe are seeking a highly skilled Big Data Engineer to join our team at Nisum. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems.Key ResponsibilitiesAnalyze complex business requirements and generate technical specifications to design or redesign complex software...
-
Big Data Engineer
4 days ago
Hyderabad, Telangana, India Virtusa Full timeJob Title: Big Data Python EngineerWe are seeking a highly skilled Big Data Python Engineer to join our team at Virtusa. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Python and big data technologies such as Hadoop, MapReduce, Hive, and Spark.Key...
-
Senior Big Data Engineer
11 hours ago
Hyderabad, Telangana, India Virtusa Full timeJob Title: Senior Big Data EngineerJob Summary:We are seeking a highly skilled Senior Big Data Engineer to join our team at Virtusa. As a Senior Big Data Engineer, you will be responsible for designing, building, and supporting data applications using Spark, Sqoop, and Hive.Key Responsibilities:Design and develop data applications using Spark, Sqoop, and...
-
Big Data Engineer
6 days ago
Hyderabad, Telangana, India Nisum Full timeAbout the RoleWe are seeking a highly skilled Big Data Engineer to join our team at Nisum India. As a key member of our data engineering team, you will be responsible for designing, developing, and implementing large-scale data processing systems using Hadoop, Python, and other related technologies.Key ResponsibilitiesAnalyze complex business requirements...
-
Data Engineer
5 days ago
Hyderabad, Telangana, India data Full timeJob DescriptionAbout the RoleWe are seeking a highly skilled Data Analyst to join our team at data.ai. As a Data Analyst, you will be responsible for analyzing, monitoring, and delivering comprehensive and high-quality app market data to app professionals.Key ResponsibilitiesTake full responsibility for data.ai core intelligence data qualityDeep...
-
Big Data Engineer
4 days ago
Hyderabad, Telangana, India Grid Dynamics Full timeBig Data Developer RoleWe are seeking a highly skilled Big Data Developer to join our team at Grid Dynamics.Key Responsibilities:Design and develop scalable big data architectures using Java, Scala, and Python.Implement data processing pipelines using Kafka, Spark, and Airflow.Work with distributed databases such as PostgreSQL and Snowflake.Deploy and manage...
-
Big Data Engineer JavaPython DSA
5 days ago
Hyderabad, Telangana, India Vidpro Consultancy Services Full timeJob Title: Big Data Engineer JavaPython DSAThis is a unique opportunity to join Vidpro Consultancy Services as a Big Data Engineer JavaPython DSA. We are seeking a highly skilled and experienced professional to lead our Big Data initiatives and drive innovation in data-driven solutions.Key Responsibilities:Design and develop large-scale Big Data...