Big Data Developer

4 weeks ago

HyderabadBangaloreChennaiBhubaneshwar, India Rigel networks Full time

Job Title : Big Data/Spark Scala Developer

Location : Type : Full-Time

Job Overview :

We are looking for an experienced Big Data/Spark Scala Developer to join our team. The ideal candidate will have a deep understanding of big data technologies and strong programming skills in Scala. In this role, you will be responsible for designing, developing, and optimizing data processing pipelines using Apache Spark, as well as working with large datasets to derive actionable insights.

Key Responsibilities :

- Data Pipeline Development : Design, develop, and maintain scalable and high-performance data pipelines using Apache Spark and Scala to process and analyze large datasets.

- Data Integration : Integrate data from various sources, including databases, data lakes, and real-time data streams. Ensure data consistency and quality across all data sources.

- Optimization : Optimize Spark jobs for performance, including tuning job configurations, optimizing query performance, and managing resources effectively.

- Collaboration : Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet business needs.

- Code Quality : Write clean, maintainable, and efficient code. Conduct code reviews and ensure adherence to best practices and coding standards.

- Testing and Debugging : Implement robust testing strategies and debug issues in data processing pipelines to ensure reliability and accuracy.

- Documentation : Create and maintain comprehensive documentation for data processing workflows, system configurations, and development procedures.

- Continuous Improvement : Stay up-to-date with the latest industry trends, tools, and technologies related to big data and Spark. Propose and implement improvements to enhance data processing capabilities.

Qualifications :

- Education : Bachelor's or Master's degree in Computer Science, Data Science, Engineering, or a related field.

- Experience : Minimum of 7 years of experience in big data technologies, with a focus on Apache Spark and Scala development.

- Technical Skills :

1. Apache Spark : Extensive experience with Apache Spark, including Spark SQL, DataFrames, and RDDs.

2. Programming : Proficiency in Scala for big data processing. Knowledge of other programming languages such as Python or Java is a plus.

3. Big Data Ecosystem : Experience with Hadoop, Hive, HBase, or other big data technologies.

4. Data Integration Tools : Familiarity with data integration tools and technologies (e.g., Kafka, Flume).

5. Databases : Experience with SQL and NoSQL databases.

- Analytical Skills : Strong analytical and problem-solving skills with the ability to work with complex data structures and derive meaningful insights.

- Communication : Excellent verbal and written communication skills, with the ability to convey technical information to non-technical stakeholders.

- Project Management : Experience with Agile methodologies and tools is a plus.

Desired Attributes :

- Attention to Detail : High level of accuracy and attention to detail in data processing and analysis.

- Innovation : Ability to think creatively and propose innovative solutions to complex data challenges.

- Team Player : Collaborative approach with a strong ability to work effectively in a team environment.

(ref:hirist.tech)

  • Big Data Developer

    1 month ago

    Hyderabad/Bangalore/Chennai/Bhubaneshwar, India Rigel networks Full time

    Job Title : Big Data/Spark Scala DeveloperLocation : Type : Full-TimeJob Overview :We are seeking a highly skilled Big Data/Spark Scala Developer to design, develop, and optimize data processing pipelines using Apache Spark and Scala. The ideal candidate will have a deep understanding of big data technologies and strong programming skills in Scala.Key...

  • Big Data Engineer

    4 weeks ago

    Hyderabad/Bangalore/Chennai/Bhubaneshwar, India Rigel networks Full time

    Job Title: Senior Scala Developer for Big DataLocation: Type: Full-TimeJob Overview:We are seeking a highly skilled Senior Scala Developer for Big Data to lead our team in designing, developing, and optimizing data processing pipelines using Apache Spark. The ideal candidate will have a deep understanding of big data technologies and strong programming...

  • Big Data Engineer

    4 weeks ago

    Hyderabad, Telangana, India data Full time

    Overview: We're seeking a skilled Big Data Engineer to join our team at data.ai. As a key member of our engineering team, you will be responsible for designing and implementing innovative data solutions that drive business growth. If you're passionate about working with large data sets, have experience with big data technologies, and are eager to...

  • Big Data Developer

    2 months ago

    Hyderabad/Bangalore/Chennai/Bhubaneshwar, IN Rigel networks Full time

    Job Title : Big Data/Spark Scala DeveloperLocation : Type : Full-TimeJob Overview : We are looking for an experienced Big Data/Spark Scala Developer to join our team. The ideal candidate will have a deep understanding of big data technologies and strong programming skills in Scala. In this role, you will be responsible for designing, developing, and...

  • Big Data Engineer, Data Modeling Expert

    1 month ago

    Hyderabad, Telangana, India data Full time

    Unlock the Power of Data with UsWe're seeking an experienced Big Data Engineer to join our team and contribute to the development of innovative analytics and data products. As a key member of our engineering team, you will work closely with Data Scientists, Data Engineers, Product Managers, and Software Architects to design and implement complex data product...

  • Big Data Systems Engineer

    3 weeks ago

    Hyderabad, Telangana, India NTT DATA Full time

    Job Title: Data EngineerJob Summary:We are seeking a skilled Data Engineer to design, build, and maintain large-scale data systems. The ideal candidate will have expertise in big data ecosystems, data processing, and data storage.Key Responsibilities:Design and develop scalable data systems for business applications.Work closely with data scientists to...

  • Big Data Specialist

    3 months ago

    Bhubaneshwar, India Deloitte Full time

    We are looking for Candidates who are having experience as Big Data.Experience Required: 10+ years.Location: Bhubaneswar, OdishaResponsibilities:Design, develop and deploy solutions using different tools, design principles and conventions.Assemble large, complex data sets that meet functional / non-functional business requirements.Identify, design, and...

  • Big Data Developer

    1 month ago

    Chennai, Tamil Nadu, India RiskInsight Consulting Pvt Ltd Full time

    Job Title: Big Data DeveloperJob Summary:RiskInsight Consulting Pvt Ltd is seeking a skilled Big Data Developer to join our team. As a Big Data Developer, you will design, develop, and deploy scalable Big Data applications using Apache Spark.Responsibilities:Data Ingestion: Implement data ingestion processes from various data sources to the Big Data...

  • Big Data Developer

    1 month ago

    Chennai, Tamil Nadu, India RiskInsight Consulting Pvt Ltd Full time

    Job Title: Big Data DeveloperAbout the Role:RiskInsight Consulting Pvt Ltd is seeking a skilled Big Data Developer to join our team. As a Big Data Developer, you will be responsible for designing, developing, and deploying scalable Big Data applications using Hadoop ecosystem technologies.Key Responsibilities:Design and develop scalable Big Data applications...

  • Big Data Developer

    7 days ago

    Bangalore, India Pixomania Full time

    Job Title: Big Data Developer (Scala + Spark)Location: Remote Experience: 5+ years Job Type: Contractual Remote About Us: We are a forward-thinking technology company committed to delivering innovative solutions in Big Data analytics. Join our talented team as a Big Data Developer with expertise in Scala and Apache Spark to drive impactful projects and...

  • Big Data Developer

    2 months ago

    Chennai, Tamil Nadu, India Mavinsys Full time

    Minimum Required Skills & Experience :1. Big Data Technologies (6+ years) :- Extensive experience with Big Data frameworks like Hadoop and Spark.- Deep understanding of Hadoop ecosystem (HDFS, YARN, MapReduce).- Familiarity with big data schedulers (e.g., Oozie, Airflow).2. Scala & Spark Expertise (4+ years each) :- Strong proficiency in Scala programming...

  • Big Data Developer

    2 months ago

    Chennai, India Mavinsys Full time

    Minimum Required Skills & Experience :1. Big Data Technologies (6+ years) :- Extensive experience with Big Data frameworks like Hadoop and Spark.- Deep understanding of Hadoop ecosystem (HDFS, YARN, MapReduce).- Familiarity with big data schedulers (e.g., Oozie, Airflow).2. Scala & Spark Expertise (4+ years each) :- Strong proficiency in Scala programming...

  • Big Data Developer

    3 weeks ago

    bangalore, India Amossys Consulting Services Full time

    Position Title: Data EngineerExperience Required: 5+ yearsEmployment Type: Full-timeEmployment Mode: HybridLocation: Bangalore, Pune, Trivandrum.Industry: Banking & Insurance sectorJob Summary:We are looking for a skilled Data Engineer with hands-on experience in PySpark and Big Data platforms to join our growing team. The ideal candidate will have...

  • Big Data Developer

    2 weeks ago

    bangalore, India Advent Global Solutions Full time

    Position : Big Data Developer/Big Data Senior Developer Location : Chennai, Bangalore, Pune, Gurgaon, and Mumbai Experience : 5 to 14 years Relevant : should be 4+ yrs for Junior and 7+ yrs for Senior Primary skills : Spark, SQL,Hive Develop and maintain architectures such as databases and large-scale processing systems using Python, Scala, SQL, and Unix...

  • Big Data Developer

    2 weeks ago

    bangalore, India Advent Global Solutions Full time

    Position : Big Data Developer/Big Data Senior DeveloperLocation : Chennai, Bangalore, Pune, Gurgaon, and MumbaiExperience : 5 to 14 yearsRelevant : should be 4+ yrs for Junior and 7+ yrs for SeniorPrimary skills : Spark, SQL,HiveDevelop and maintain architectures such as databases and large-scale processing systems using Python, Scala, SQL, and Unix...

  • Big Data Developer

    1 week ago

    bangalore, India Advent Global Solutions Full time

    Position : Big Data Developer/Big Data Senior DeveloperLocation : Chennai, Bangalore, Pune, Gurgaon, and MumbaiExperience : 5 to 14 yearsRelevant : should be 4+ yrs for Junior and 7+ yrs for SeniorPrimary skills : Spark, SQL,HiveDevelop and maintain architectures such as databases and large-scale processing systems using Python, Scala, SQL, and Unix...

  • Big Data Developer

    1 month ago

    Chennai, India ZF Group Full time

    Job Description:We are currently seeking dynamic individuals to join our team and contribute to the success for our organization.Experience - 5 to 10 yrsRequirementBachelor’s degree in Computer Science, Engineering, Information Technology, or a related field.Demonstrable experience as a Big Data Developer, Data Engineer, or similar role with a minimum of 5...

  • Big data developer

    1 month ago

    Bangalore, India HARMAN India Full time

    Harman India is looking for Big Data Developer. Location: Bangalore Experience: 4-6 Years. Notice Period: Immediate to 15 Days. Skill Set required: 1. Design, develop, and implement highly scalable and distributed big data solutions using Hadoop ecosystem technologies such as HBase, Hive, Kudu, and Spark. 2. Architect HBase schemas and data...

  • Big Data Developer

    3 weeks ago

    Chennai, India ZF Group Full time

    Job Description:We are currently seeking dynamic individuals to join our team and contribute to the success for our organization.Experience - 5 to 10 yrsRequirement- Bachelor’s degree in Computer Science, Engineering, Information Technology, or a related field.- Demonstrable experience as a Big Data Developer, Data Engineer, or similar role with a minimum...

  • Big Data Developer

    1 month ago

    bangalore, India HARMAN India Full time

    Harman India is looking for Big Data Developer.Location: Bangalore Experience: 4-6Years.Notice Period: Immediate to 15Days.Skill Set required: 1. Design, develop, and implement highly scalable and distributed big data solutions using Hadoop ecosystem technologies such as HBase, Hive, Kudu, and Spark. 2. Architect HBase schemas and data models to accommodate...