Big Data Engineer
2 weeks ago
Job Title: Senior Scala Developer for Big Data
Location: Type: Full-Time
Job Overview:
We are seeking a highly skilled Senior Scala Developer for Big Data to lead our team in designing, developing, and optimizing data processing pipelines using Apache Spark. The ideal candidate will have a deep understanding of big data technologies and strong programming skills in Scala. In this role, you will work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet business needs.
Key Responsibilities:
- Design, develop, and maintain scalable and high-performance data pipelines using Apache Spark and Scala to process and analyze large datasets. Ensure data consistency and quality across all data sources.
- Optimize Spark jobs for performance, including tuning job configurations, optimizing query performance, and managing resources effectively. Collaborate with the team to identify areas for improvement and implement changes to enhance data processing capabilities.
- Write clean, maintainable, and efficient code. Conduct code reviews and ensure adherence to best practices and coding standards. Implement robust testing strategies to ensure reliability and accuracy of data processing pipelines.
- Stay up-to-date with the latest industry trends, tools, and technologies related to big data and Spark. Propose and implement improvements to enhance data processing capabilities.
Qualifications:
- Education: Bachelor's or Master's degree in Computer Science, Data Science, Engineering, or a related field.
- Experience: Minimum of 7 years of experience in big data technologies, with a focus on Apache Spark and Scala development. Proficiency in Scala for big data processing, as well as experience with Hadoop, Hive, HBase, or other big data technologies.
- Technical Skills: Apache Spark, Spark SQL, DataFrames, and RDDs. Experience with data integration tools and technologies, such as Kafka, Flume. Strong analytical and problem-solving skills with the ability to work with complex data structures and derive meaningful insights.
Desired Attributes:
- Attention to Detail: High level of accuracy and attention to detail in data processing and analysis.
- Innovation: Ability to think creatively and propose innovative solutions to complex data challenges.
- Team Player: Collaborative approach with a strong ability to work effectively in a team environment.
-
Big Data Engineer
3 weeks ago
Hyderabad, Telangana, India data Full timeAbout the RoleWe are seeking an experienced Big Data Engineer to join our team at data.ai India subsidiary entity. As a key member of our engineering team, you will be responsible for designing and implementing complex data product components based on requirements with possible technical solutions.Key ResponsibilitiesDesign and implement data processing...
-
Big Data Engineer
6 days ago
Hyderabad, Telangana, India data Full timeOverview: We're seeking a skilled Big Data Engineer to join our team at data.ai. As a key member of our engineering team, you will be responsible for designing and implementing innovative data solutions that drive business growth. If you're passionate about working with large data sets, have experience with big data technologies, and are eager to...
-
Big Data Engineer, Data Modeling Expert
2 weeks ago
Hyderabad, Telangana, India data Full timeAbout the RoleWe are seeking an experienced Big Data Engineer to join our team at data.ai. As a key member of our engineering team, you will be responsible for designing and implementing complex data product components based on requirements with possible technical solutions.Key ResponsibilitiesDesign and implement data processing programs using Python (e.g.,...
-
Big Data Engineer
3 weeks ago
Hyderabad, Telangana, India data Full timeAbout the RoleWe are seeking an experienced Big Data Engineer to join our team in Hyderabad, India. As a key member of our engineering team, you will be responsible for designing and implementing complex data product components based on requirements with possible technical solutions.Key ResponsibilitiesDesign and implement data processing programs using...
-
Big Data Engineer, Data Modeling Expert
2 weeks ago
Hyderabad, Telangana, India data Full timeUnlock the Power of Data with UsWe're seeking an experienced Big Data Engineer to join our team and contribute to the development of innovative analytics and data products. As a key member of our engineering team, you will work closely with Data Scientists, Data Engineers, Product Managers, and Software Architects to design and implement complex data product...
-
Big Data Systems Engineer
3 days ago
Hyderabad, Telangana, India NTT DATA Full timeJob Title: Data EngineerJob Summary:We are seeking a skilled Data Engineer to design, build, and maintain large-scale data systems. The ideal candidate will have expertise in big data ecosystems, data processing, and data storage.Key Responsibilities:Design and develop scalable data systems for business applications.Work closely with data scientists to...
-
Big Data Engineer
3 days ago
Hyderabad, Telangana, India NTT DATA Services Full timeData Engineer RoleData engineers at NTT DATA Services are responsible for building and testing scalable Big Data ecosystems for our clients. They work closely with data scientists to ensure the source data is aggregated and cleansed, and with product managers to understand the business objectives. Data engineers must have expertise in all phases of data...
-
Data Engineer
2 weeks ago
Hyderabad, Telangana, India NTT DATA Services Full timeJob Title: Data Engineer - Big Data SpecialistAt NTT DATA Services, we are seeking a skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing and developing scalable Big Data ecosystems for our clients. Your expertise will help us build stable and highly optimized data systems, ensuring seamless data processing and...
-
Big Data Developer
3 weeks ago
Hyderabad/Bangalore/Chennai/Bhubaneshwar, India Rigel networks Full timeJob Title : Big Data/Spark Scala DeveloperLocation : Type : Full-TimeJob Overview :We are seeking a highly skilled Big Data/Spark Scala Developer to design, develop, and optimize data processing pipelines using Apache Spark and Scala. The ideal candidate will have a deep understanding of big data technologies and strong programming skills in Scala.Key...
-
Big Data Engineer
3 weeks ago
Bangalore, India Draup Full timeJob Title: Big Data EngineerJob Summary:The Big Data Engineer at Draup is responsible for designing and implementing scalable data storage, transformation, and analysis techniques. This role involves working with a proficient team of developers, engineers, and product team to build generic and reusable data platforms and pipelines.Key Responsibilities:Design...
-
Big Data Engineer
3 weeks ago
Bangalore, India Draup Full timeJob Title: Big Data EngineerAbout the Role:The Big Data Engineer at Draup is responsible for designing and implementing scalable techniques and processes for data storage, transformations, and analysis. This role involves building generic and reusable data platforms and pipelines. You will work with a team of experienced developers, engineers, and product...
-
Big Data Engineer
3 weeks ago
Bangalore, India Draup Full timeJob Title: Big Data EngineerAt Draup, we are seeking a highly skilled Big Data Engineer to join our team. As a Big Data Engineer, you will be responsible for designing and implementing scalable techniques and processes for data storage, transformations, and analysis.Key Responsibilities:Design and develop scalable architectures for data storage,...
-
Big Data Engineer
3 weeks ago
Bangalore, India Talpro Full timeJob Title: Big Data EngineerJob Summary:Talpro is seeking a highly skilled Big Data Engineer to join our team. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining scalable data pipelines using Python, PySpark, and Scala.Key Responsibilities:Develop and maintain scalable data pipelines using Python, PySpark, and...
-
Big Data Engineer
2 weeks ago
Bangalore, India Rigel networks Full timeJob Title: Big Data EngineerJob Description:At Rigel Networks, we are seeking a highly skilled Big Data Engineer to lead our data engineering efforts. The ideal candidate will have extensive experience in designing and implementing big data systems using PySpark, database migration, transformation, and integration solutions for data warehousing projects.Key...
-
Big Data Engineer
3 weeks ago
Hyderabad, Telangana, India Virtusa Full timeJob Title: Big Data Python EngineerWe are seeking a highly skilled Big Data Python Engineer to join our team at Virtusa. As a key member of our data engineering team, you will be responsible for designing and implementing data processing pipelines using Python and Scala programming languages, as well as big data technologies such as Hadoop, MapReduce, Hive,...
-
Big Data Engineer
3 weeks ago
Bangalore, India Talpro Full timeJob Title: Big Data EngineerAt Talpro, we are seeking a highly skilled Big Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems.Key Responsibilities:Design and implement scalable data pipelines using Python, PySpark, and...
-
Big Data Engineer
2 weeks ago
Bangalore, India Draup Full timeRole : Big Data EngineerJob Description :The Big Data Engineer at Draup is responsible for designing, implementing, and maintaining scalable techniques and processes for data storage, transformations, and analysis. This role involves working with a proficient team of developers, engineers, and product team to shape up the data products. The ideal candidate...
-
Big Data Engineer
2 weeks ago
Chennai, Tamil Nadu, India ZF Group Full timeJob Title: Big Data DeveloperJob Summary:At ZF Group, we are searching for a skilled Big Data Developer to contribute to the success of our organization. Responsibilities:- Demonstrable experience as a Big Data Developer, Data Engineer, or similar role with a minimum of 5 years in Big Data technologies and platforms.- Strong understanding of distributed...
-
Big Data Engineer
6 days ago
Hyderabad, Telangana, India ANB IT Solutions Pvt Ltd Full timeKey ResponsibilitiesCollaborate with cross-functional teams to design, develop, and maintain big data solutions using Google Cloud Big Query. Key responsibilities include data ingestion, transformation, and analytics.Data Engineering and DevelopmentDevelop and maintain ETL/ELT processes to ensure data integrity and consistency. Utilize Google Cloud Composer,...
-
Big Data Engineer
2 weeks ago
Hyderabad, Telangana, India Virtusa Full timeJob Title: Big Data EngineerJob Summary: We are seeking a skilled Big Data Engineer to design and implement data processing pipelines using Python and big data technologies such as Hadoop, MapReduce, Hive, and Spark.Key Responsibilities:Design and implement data processing pipelines using Python and big data technologies.Develop and maintain data assets...