Big Data Developer

3 weeks ago

Chennai, Tamil Nadu, India Risk Resources Full time

Overview :

The Bigdata Developer plays a vital role in today's data-driven organizations by enabling the extraction, transformation, and loading (ETL) of large volumes of data from diverse sources to generate actionable insights.

This position leverages advanced technologies that support the storage, processing, and analysis of big data. Bigdata Developers are crucial for ensuring that organizations can efficiently manage and utilize their data assets, contributing to business decisions and strategic planning.

They collaborate closely with data architects, data analysts, and business stakeholders to design and implement robust data solutions that cater to both operational and analytical requirements.

The role requires a strong technical background combined with a deep understanding of data management concepts and tools.

As businesses increasingly rely on big data analytics, the demand for skilled Bigdata Developers continues to grow, underscoring the importance of this position in driving innovation and maintaining a competitive edge.

Key Responsibilities :

- Design and develop data processing pipelines using Hadoop and Spark.

- Collaborate with data architects to create data models that meet business requirements.

- Implement ETL processes for data extraction, transformation, and loading.

- Conduct data analysis to identify patterns, trends, and insights.

- Optimize data storage solutions for performance and scalability.

- Create and maintain technical documentation for data solutions.

- Ensure data quality and integrity across various data sources.

- Monitor performance and troubleshoot issues in data processing workflows.

- Implement data governance and security best practices.

- Work with cloud platforms to manage and analyze big data.

- Integrate APIs for data ingestion from external sources.

- Collaborate with business users to understand their data needs.

- Stay updated on emerging big data technologies and tools.

- Engage in code reviews and best practices for data development.

- Provide training and support to team members on big data tools.

Required Qualifications :

- Bachelor's degree in Computer Science, Information Technology, or a related field.

- 3+ years of experience in big data development or related roles.

- Strong proficiency in SQL for data manipulation and querying.

- Hands-on experience with Hadoop ecosystem components such as HDFS, MapReduce, and YARN.

- Proficient in Apache Spark, including Spark SQL and DataFrames.

- Experience with data modeling techniques and best practices.

- Familiarity with ETL tools and methodologies.

- Programming skills in Java, Scala, or Python for data processing.

- Knowledge of cloud technologies like AWS, Azure, or Google Cloud.

- Understanding of API design and integration.

- Strong analytical and problem-solving abilities.

- Excellent communication skills for stakeholder engagement.

- Experience with data visualization tools is a plus.

- Understanding of data governance standards and best practices.

- Ability to work in a fast-paced, team-oriented environment.

(ref:hirist.tech)

  • Big Data Developer

    7 days ago

    Chennai, Tamil Nadu, India beBee Careers Full time

    Job Title: Big Data DeveloperWe are seeking a skilled engineer to design, develop, and optimize big data solutions using Scala and Apache Spark.This role involves end-to-end development from coding to deployment ensuring high performance and reliability of big data applications.Designing, developing, and optimizing big data solutions using Scala and Apache...

  • Big Data Developer

    1 day ago

    Chennai, Tamil Nadu, India beBee Careers Full time

    Job Overview">We are seeking a skilled Data Insights Engineer to join our team. In this role, you will be responsible for designing, developing, and implementing data-driven solutions using big data technologies.">About the Role">This permanent position involves working with various big data tools and technologies, including Spark, PySpark, Hive, and HBase....

  • Big Data Developer

    2 weeks ago

    Chennai, Tamil Nadu, India Nasugroup Full time

    We are seeking a highly motivated and experienced Big Data Developer. You will be responsible for designing, developing, and implementing scalable and efficient big data solutions. The ideal candidate will possess strong expertise in Big Data technologies, particularly Spark and Scala, and have hands-on experience with cloud platforms. As an immediate...

  • Big Data Developer

    4 weeks ago

    Chennai, Tamil Nadu, India Tata Consultancy Services Full time

    TCS has always been in the spotlight for being adept in "the next big technologies" What we can offer you is a space to explore varied technologies and quench your techie soul.Role: Big Data DeveloperLocation: Bangalore/ChennaiExperience:5-10 YearsRequired Technical skills: Bigdata, Hadoop Technologies4+ years of experience in Big Data, HadoopSound Knowledge...

  • Big Data Developer

    3 weeks ago

    Chennai, Tamil Nadu, India Hrizen Techno Services Full time

    We are seeking an experienced Big Data Developer to join our dynamic team. The ideal candidate will have a strong background in big data technologies, data engineering, and distributed systems. This role requires expertise in handling large-scale data processing systems, ensuring data reliability, and driving data-driven : - Design, develop, and implement...

  • Big Data Developer

    1 day ago

    Chennai, Tamil Nadu, India beBee Careers Full time

    Job Description:We are seeking an experienced Big Data Developer with a strong background in building scalable data solutions using Scala and Apache Spark. The ideal candidate will have hands-on experience in build tools like Maven, SBT, and Gradle.Responsibilities:Design, develop, and optimize big data solutions using Scala and Apache Spark.Implement data...

  • Big data developer

    4 weeks ago

    Chennai, Tamil Nadu, India Synechron Full time

    Position Review: We are seeking a highly skilled and experienced Senior Big Data Engineer to join our dynamic team. The ideal candidate will design, develop, and maintain scalable and efficient data processing systems using Java and Apache Spark. You will work closely with data scientists, analysts, and other engineering teams to implement data-driven...

  • Big Data Developer

    2 weeks ago

    Chennai, Tamil Nadu, India Tata Consultancy Services Full time

    TCS has always been in the spotlight for being adept in "the next big technologies" What we can offer you is a space to explore varied technologies and quench your techie soul.Role: Big Data DeveloperLocation: Bangalore/ChennaiExperience:5-10 YearsRequired Technical skills: Bigdata, Hadoop Technologies4+ years of experience in Big Data, HadoopSound Knowledge...

  • Big Data Developer

    6 days ago

    Chennai, Tamil Nadu, India beBee Careers Full time

    Job SummaryWe are seeking a highly skilled Big Data Developer to join our team. The successful candidate will have extensive experience in Informatica Big Data Management, with a strong background in development and design.The ideal candidate will be well-versed in Oozie scheduling, HQL, Hive, HDFS, and data partitioning. Additionally, they will have...

  • Big Data Developer

    2 days ago

    Chennai, Tamil Nadu, India beBee Careers Full time

    About the RoleWe are seeking an experienced Big Data Developer to join our team. The ideal candidate will have a strong background in Informatica Big Data Management and a proven track record of delivering high-quality solutions.Responsibilities include:Designing, building, and testing data management systems using Informatica tools.Collaborating with...