Big Data Engineer
1 month ago
Job Description : Big Data Engineer - Scala, Spark
Years of exp: 6 to 13 years
Job location: Chennai / Hyderabad / Bangalore / Pune / Mumbai / Delhi / Coimbatore
About the Role :
We are seeking a highly skilled Big Data Engineer to join our team and help us leverage the power of big data to drive innovation and business value. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining scalable and efficient big data solutions. You will work closely with data scientists, analysts, and other stakeholders to extract valuable insights from large datasets.
Key Responsibilities :
- Design, develop, and maintain scalable big data architectures and pipelines.
- Develop and optimize data ingestion, processing, and storage solutions using Apache Spark and other big data technologies.
- Write clean, efficient, and maintainable Scala code for big data applications.
- Collaborate with data scientists and analysts to understand business requirements and translate them into technical solutions.
- Optimize data pipelines for performance and cost-efficiency.
- Implement data governance and security best practices.
- Stay up-to-date with the latest big data technologies and trends.
Required Skills and Experience :
- Strong proficiency in Scala programming.
- In-depth knowledge of Apache Spark and its core components (Spark SQL, Spark Streaming, GraphX).
- Experience with big data platforms like Hadoop, Hive, and HBase.
- Understanding of data warehousing and data lake concepts.
- Experience with cloud platforms (AWS, GCP, Azure) is a plus.
- Strong problem-solving and debugging skills.
- Excellent communication and collaboration skills.
- A passion for working with large datasets and extracting valuable insights.
Notice Period - 30 days
(ref:hirist.tech)-
Big Data Engineer
4 weeks ago
Hyderabad, Telangana, India data Full timeAbout the RoleWe are seeking an experienced Big Data Engineer to join our team at data.ai India subsidiary entity. As a key member of our engineering team, you will be responsible for designing and implementing complex data product components based on requirements with possible technical solutions.Key ResponsibilitiesDesign and implement data processing...
-
Big Data Engineer
1 week ago
Hyderabad, Telangana, India data Full timeOverview: We're seeking a skilled Big Data Engineer to join our team at data.ai. As a key member of our engineering team, you will be responsible for designing and implementing innovative data solutions that drive business growth. If you're passionate about working with large data sets, have experience with big data technologies, and are eager to...
-
Big Data Engineer, Data Modeling Expert
3 weeks ago
Hyderabad, Telangana, India data Full timeAbout the RoleWe are seeking an experienced Big Data Engineer to join our team at data.ai. As a key member of our engineering team, you will be responsible for designing and implementing complex data product components based on requirements with possible technical solutions.Key ResponsibilitiesDesign and implement data processing programs using Python (e.g.,...
-
Big Data Engineer
3 weeks ago
Hyderabad, Telangana, India data Full timeAbout the RoleWe are seeking an experienced Big Data Engineer to join our team in Hyderabad, India. As a key member of our engineering team, you will be responsible for designing and implementing complex data product components based on requirements with possible technical solutions.Key ResponsibilitiesDesign and implement data processing programs using...
-
Big Data Systems Engineer
6 days ago
Hyderabad, Telangana, India NTT DATA Full timeJob Title: Data EngineerJob Summary:We are seeking a skilled Data Engineer to design, build, and maintain large-scale data systems. The ideal candidate will have expertise in big data ecosystems, data processing, and data storage.Key Responsibilities:Design and develop scalable data systems for business applications.Work closely with data scientists to...
-
Big Data Engineer, Data Modeling Expert
2 weeks ago
Hyderabad, Telangana, India data Full timeUnlock the Power of Data with UsWe're seeking an experienced Big Data Engineer to join our team and contribute to the development of innovative analytics and data products. As a key member of our engineering team, you will work closely with Data Scientists, Data Engineers, Product Managers, and Software Architects to design and implement complex data product...
-
Big Data Engineer
6 days ago
Hyderabad, Telangana, India NTT DATA Services Full timeData Engineer RoleData engineers at NTT DATA Services are responsible for building and testing scalable Big Data ecosystems for our clients. They work closely with data scientists to ensure the source data is aggregated and cleansed, and with product managers to understand the business objectives. Data engineers must have expertise in all phases of data...
-
Data Engineer
3 weeks ago
Hyderabad, Telangana, India NTT DATA Services Full timeJob Title: Data Engineer - Big Data SpecialistAt NTT DATA Services, we are seeking a skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing and developing scalable Big Data ecosystems for our clients. Your expertise will help us build stable and highly optimized data systems, ensuring seamless data processing and...
-
Big Data Engineer
4 weeks ago
Hyderabad, Telangana, India Virtusa Full timeJob Title: Big Data Python EngineerWe are seeking a highly skilled Big Data Python Engineer to join our team at Virtusa. As a key member of our data engineering team, you will be responsible for designing and implementing data processing pipelines using Python and Scala programming languages, as well as big data technologies such as Hadoop, MapReduce, Hive,...
-
Big Data Engineer
1 week ago
Hyderabad, Telangana, India ANB IT Solutions Pvt Ltd Full timeKey ResponsibilitiesCollaborate with cross-functional teams to design, develop, and maintain big data solutions using Google Cloud Big Query. Key responsibilities include data ingestion, transformation, and analytics.Data Engineering and DevelopmentDevelop and maintain ETL/ELT processes to ensure data integrity and consistency. Utilize Google Cloud Composer,...
-
Big Data Engineer
2 weeks ago
Hyderabad, Telangana, India Virtusa Full timeJob Title: Big Data EngineerJob Summary: We are seeking a skilled Big Data Engineer to design and implement data processing pipelines using Python and big data technologies such as Hadoop, MapReduce, Hive, and Spark.Key Responsibilities:Design and implement data processing pipelines using Python and big data technologies.Develop and maintain data assets...
-
Big Data Engineer
3 weeks ago
Hyderabad, Telangana, India Virtusa Full timeJob Title: Big Data EngineerWe are seeking a highly skilled Big Data Engineer to join our team at Virtusa. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using big data technologies such as Hadoop, Spark, and NoSQL databases.Key Responsibilities:Design and develop big data...
-
Big Data Engineer
2 weeks ago
Hyderabad, Telangana, India Vidpro Consultancy Services Full timeAbout the Role:Vidpro Consultancy Services is seeking a highly skilled Big Data Engineer to join our team. As a key member of our data architecture team, you will be responsible for designing and implementing large-scale Big Data architectures using Java and Python.Key Responsibilities:Design and implement Big Data architectures using Hadoop and SparkDevelop...
-
Big Data Engineer
2 months ago
Hyderabad, India NucleusTeq Full timeBig Data Engineer Responsibilities: Big Data Engineer with 5+ years of experienceExperience in leading a team of engineers and a good attitude toward learning the domain and implementationStrong exposure and expertise in Spark (Primary), Scala/Java (Scala Primary), Airflow Orchestration and AWS.Finalizing the scope of the system and delivering...
-
Big Data Engineer
3 weeks ago
Hyderabad, Telangana, India TechSophy Full timeJob Title: Big Data EngineerJob Summary:We are seeking a highly skilled Big Data Engineer to join our team at TechSophy. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems.Key Responsibilities:Analyze large data sets to identify errors in the map.Design and implement complex...
-
Big Data Engineer
4 weeks ago
Hyderabad, Telangana, India Vidpro Consultancy Services Full timeJob Title: Big Data Engineer JavaPython DSAThis is a unique opportunity to join Vidpro Consultancy Services as a Big Data Engineer, working on large-scale Big Data architectures. As a key member of our team, you will be responsible for designing, developing, and implementing scalable data processing systems using Java, Python, and other...
-
Big Data Engineer
3 weeks ago
Hyderabad, India TECHSTAR SOFTWARE DEVELOPMENT INDIA PVT LTD Full timeJob Title: Big Data EngineerAs a Big Data Engineer at TECHSTAR SOFTWARE DEVELOPMENT INDIA PVT LTD, you will be responsible for designing and developing big data solutions that drive business growth and innovation.Key Responsibilities:Design and develop big data pipelines for data ingestion and transformation using Java, Scala, or Python.Partner with domain...
-
Big Data Engineer
4 weeks ago
Hyderabad, Telangana, India TechSophy Full timeJob Title: Big Data EngineerJob Summary:We are seeking a highly skilled Big Data Engineer to join our team at TechSophy. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems. You will work closely with our data science team to develop and implement data-driven solutions that drive...
-
Big Data Engineer
4 weeks ago
Hyderabad, Telangana, India Virtusa Full timeJob Title: Big Data EngineerWe are seeking a highly skilled Big Data Engineer to join our team at Virtusa. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using big data technologies such as Hadoop, Spark, and NoSQL databases.Key Responsibilities:Design and develop data pipelines...
-
Big Data Engineer
4 weeks ago
Hyderabad, Telangana, India Virtusa Full timeJob Title: Big Data Python EngineerVirtusa is seeking a highly skilled Big Data Python Engineer to join our team.Key Responsibilities:Design and implement data processing pipelines using Python and big data technologies such as Hadoop, MapReduce, Hive, and Spark.Develop and maintain data assets using PySpark.Collaborate with data and business analysts to...