Big Data Engineer
4 weeks ago
Job Title: Senior Scala Developer for Big Data
Location: Type: Full-Time
Job Overview:
We are seeking a highly skilled Senior Scala Developer for Big Data to lead our team in designing, developing, and optimizing data processing pipelines using Apache Spark. The ideal candidate will have a deep understanding of big data technologies and strong programming skills in Scala. In this role, you will work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet business needs.
Key Responsibilities:
- Design, develop, and maintain scalable and high-performance data pipelines using Apache Spark and Scala to process and analyze large datasets. Ensure data consistency and quality across all data sources.
- Optimize Spark jobs for performance, including tuning job configurations, optimizing query performance, and managing resources effectively. Collaborate with the team to identify areas for improvement and implement changes to enhance data processing capabilities.
- Write clean, maintainable, and efficient code. Conduct code reviews and ensure adherence to best practices and coding standards. Implement robust testing strategies to ensure reliability and accuracy of data processing pipelines.
- Stay up-to-date with the latest industry trends, tools, and technologies related to big data and Spark. Propose and implement improvements to enhance data processing capabilities.
Qualifications:
- Education: Bachelor's or Master's degree in Computer Science, Data Science, Engineering, or a related field.
- Experience: Minimum of 7 years of experience in big data technologies, with a focus on Apache Spark and Scala development. Proficiency in Scala for big data processing, as well as experience with Hadoop, Hive, HBase, or other big data technologies.
- Technical Skills: Apache Spark, Spark SQL, DataFrames, and RDDs. Experience with data integration tools and technologies, such as Kafka, Flume. Strong analytical and problem-solving skills with the ability to work with complex data structures and derive meaningful insights.
Desired Attributes:
- Attention to Detail: High level of accuracy and attention to detail in data processing and analysis.
- Innovation: Ability to think creatively and propose innovative solutions to complex data challenges.
- Team Player: Collaborative approach with a strong ability to work effectively in a team environment.
-
Big Data Engineer
3 weeks ago
Hyderabad, Telangana, India data Full timeOverview: We're seeking a skilled Big Data Engineer to join our team at data.ai. As a key member of our engineering team, you will be responsible for designing and implementing innovative data solutions that drive business growth. If you're passionate about working with large data sets, have experience with big data technologies, and are eager to...
-
Big Data Systems Engineer
3 weeks ago
Hyderabad, Telangana, India NTT DATA Full timeJob Title: Data EngineerJob Summary:We are seeking a skilled Data Engineer to design, build, and maintain large-scale data systems. The ideal candidate will have expertise in big data ecosystems, data processing, and data storage.Key Responsibilities:Design and develop scalable data systems for business applications.Work closely with data scientists to...
-
Big Data Engineer, Data Modeling Expert
4 weeks ago
Hyderabad, Telangana, India data Full timeUnlock the Power of Data with UsWe're seeking an experienced Big Data Engineer to join our team and contribute to the development of innovative analytics and data products. As a key member of our engineering team, you will work closely with Data Scientists, Data Engineers, Product Managers, and Software Architects to design and implement complex data product...
-
Big Data Engineer
3 weeks ago
Hyderabad, Telangana, India NTT DATA Services Full timeData Engineer RoleData engineers at NTT DATA Services are responsible for building and testing scalable Big Data ecosystems for our clients. They work closely with data scientists to ensure the source data is aggregated and cleansed, and with product managers to understand the business objectives. Data engineers must have expertise in all phases of data...
-
Big Data Developer
1 month ago
Hyderabad/Bangalore/Chennai/Bhubaneshwar, India Rigel networks Full timeJob Title : Big Data/Spark Scala DeveloperLocation : Type : Full-TimeJob Overview :We are seeking a highly skilled Big Data/Spark Scala Developer to design, develop, and optimize data processing pipelines using Apache Spark and Scala. The ideal candidate will have a deep understanding of big data technologies and strong programming skills in Scala.Key...
-
Big Data Engineer
1 month ago
Bangalore, India Draup Full timeJob Title: Big Data EngineerAbout the Role:The Big Data Engineer at Draup is responsible for designing and implementing scalable techniques and processes for data storage, transformations, and analysis. This role involves building generic and reusable data platforms and pipelines. You will work with a team of experienced developers, engineers, and product...
-
Big Data Engineer
1 month ago
Bangalore, India Rigel networks Full timeJob Title: Big Data EngineerJob Description:At Rigel Networks, we are seeking a highly skilled Big Data Engineer to lead our data engineering efforts. The ideal candidate will have extensive experience in designing and implementing big data systems using PySpark, database migration, transformation, and integration solutions for data warehousing projects.Key...
-
Big Data Engineer
1 month ago
Bangalore, India Talpro Full timeJob Title: Big Data EngineerAt Talpro, we are seeking a highly skilled Big Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems.Key Responsibilities:Design and implement scalable data pipelines using Python, PySpark, and...
-
Big Data Engineer
4 weeks ago
Bangalore, India Draup Full timeRole : Big Data EngineerJob Description :The Big Data Engineer at Draup is responsible for designing, implementing, and maintaining scalable techniques and processes for data storage, transformations, and analysis. This role involves working with a proficient team of developers, engineers, and product team to shape up the data products. The ideal candidate...
-
Big Data Engineer
4 weeks ago
Chennai, Tamil Nadu, India ZF Group Full timeJob Title: Big Data DeveloperJob Summary:At ZF Group, we are searching for a skilled Big Data Developer to contribute to the success of our organization. Responsibilities:- Demonstrable experience as a Big Data Developer, Data Engineer, or similar role with a minimum of 5 years in Big Data technologies and platforms.- Strong understanding of distributed...
-
Big Data Engineer
3 weeks ago
Hyderabad, Telangana, India ANB IT Solutions Pvt Ltd Full timeKey ResponsibilitiesCollaborate with cross-functional teams to design, develop, and maintain big data solutions using Google Cloud Big Query. Key responsibilities include data ingestion, transformation, and analytics.Data Engineering and DevelopmentDevelop and maintain ETL/ELT processes to ensure data integrity and consistency. Utilize Google Cloud Composer,...
-
Big Data Engineer
4 weeks ago
Hyderabad, Telangana, India Virtusa Full timeJob Title: Big Data EngineerJob Summary: We are seeking a skilled Big Data Engineer to design and implement data processing pipelines using Python and big data technologies such as Hadoop, MapReduce, Hive, and Spark.Key Responsibilities:Design and implement data processing pipelines using Python and big data technologies.Develop and maintain data assets...
-
Big Data Engineer
1 month ago
Hyderabad/Chennai/Kolkata, India Risk Resources LLP Full timeJob Title: Big Data EngineerJob Summary:We are seeking a highly skilled Big Data Engineer to join our team at Risk Resources LLP. The ideal candidate will have expertise in designing and implementing Big Data pipelines using PySpark, database migration, transformation, and integration solutions for Data warehousing projects.Key Responsibilities:- Develop...
-
Big Data Engineer
4 weeks ago
Bangalore, India Madhees Techno Consulting Pvt. Ltd Full timeJob Title: Senior Data Engineer at Madhees Techno Consulting Pvt. LtdAbout the Role:We are seeking a highly skilled Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing, developing, and implementing scalable and efficient big data solutions using Spark, Scala, and other relevant...
-
Big Data Engineer
1 month ago
Bangalore, India MaimsD Technology Full timeAbout the Role:At MaimsD Technology, we are seeking a highly skilled Big Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining applications that process and analyze large datasets. You will work closely with data analysts, data scientists, and other team members to...
-
Big Data Developer
4 weeks ago
Hyderabad/Bangalore/Chennai/Bhubaneshwar, India Rigel networks Full timeJob Title : Big Data/Spark Scala DeveloperLocation : Type : Full-TimeJob Overview : We are looking for an experienced Big Data/Spark Scala Developer to join our team. The ideal candidate will have a deep understanding of big data technologies and strong programming skills in Scala. In this role, you will be responsible for designing, developing, and...
-
Big Data Developer
2 months ago
Hyderabad/Bangalore/Chennai/Bhubaneshwar, IN Rigel networks Full timeJob Title : Big Data/Spark Scala DeveloperLocation : Type : Full-TimeJob Overview : We are looking for an experienced Big Data/Spark Scala Developer to join our team. The ideal candidate will have a deep understanding of big data technologies and strong programming skills in Scala. In this role, you will be responsible for designing, developing, and...
-
Big Data Engineer
2 months ago
Hyderabad, India NucleusTeq Full timeBig Data Engineer Responsibilities: Big Data Engineer with 5+ years of experienceExperience in leading a team of engineers and a good attitude toward learning the domain and implementationStrong exposure and expertise in Spark (Primary), Scala/Java (Scala Primary), Airflow Orchestration and AWS.Finalizing the scope of the system and delivering...
-
Big Data Engineer
4 weeks ago
Hyderabad, Telangana, India Vidpro Consultancy Services Full timeAbout the Role:Vidpro Consultancy Services is seeking a highly skilled Big Data Engineer to join our team. As a key member of our data architecture team, you will be responsible for designing and implementing large-scale Big Data architectures using Java and Python.Key Responsibilities:Design and implement Big Data architectures using Hadoop and SparkDevelop...
-
Big Data Engineer
4 weeks ago
Bangalore, India Talpro Full timeJob Title: Big Data EngineerJob Summary:Talpro is seeking an experienced Big Data Engineer to join our team. The successful candidate will be responsible for designing, developing, and maintaining scalable data pipelines using Python, PySpark, and Scala.Key Responsibilities:Develop and maintain scalable data pipelines using Python, PySpark, and Scala.Work...