Big Data Developer

4 weeks ago

Bengaluru, Karnataka, India Impetus Full time

Big Data Developer

Experience- 3 to 12 years

Locations- Indore, Noida, Hyderabad, Bangalore, Gurgaon

Job Description

We are looking for a Big Data Developer to design and oversee the implementation of large-scale data solutions, lead a talented team, and ensure the efficient processing and analysis of massive datasets.

Roles & Responsibilities

Key Responsibilities

  • Architect Data Solutions: Design and implement scalable, high-performance big data architectures using industry-leading tools and technologies.
  • Lead Development Efforts: Oversee the end-to-end development of big data workflows, pipelines, and applications.
  • Mentor Team Members: Provide technical guidance, conduct code reviews, and foster a culture of continuous improvement within the team.
  • Optimize Performance: Identify bottlenecks in data processing workflows and implement strategies for optimization.
  • Collaborate: Work closely with data scientists, engineers, analysts, and business stakeholders to understand requirements and deliver solutions.
  • Data Governance: Ensure compliance with data privacy regulations and best practices in data management.
  • Innovate and Stay Current: Research emerging big data technologies and incorporate them into the organization's tech stack as appropriate.

Required Skills and Qualifications

  • Big Data Expertise: Experience working with big data technologies like Apache Spark, Hadoop, Hive, and HBase.
  • Programming Skills: Advanced proficiency in Python, Scala, or Java, with experience in functional programming.
  • ETL and Data Pipelines: Extensive experience in building and optimizing ETL pipelines for large-scale data ingestion and transformation.
  • Data Management: Expertise in handling structured and unstructured data in formats like Parquet, Avro, ORC, JSON, and CSV.
  • Performance Tuning: Proven ability to optimize distributed computing jobs for resource and cost efficiency.
  • Database Knowledge: Proficiency in SQL and NoSQL databases (e.g., PostgreSQL, Cassandra, MongoDB).
  • DevOps Integration: Experience with CI/CD pipelines, containerization (Docker), and orchestration (Kubernetes).
  • Leadership: Demonstrated ability to lead teams, manage projects, and mentor junior developers.

  • Big Data Developer

    1 day ago

    Bengaluru, Karnataka, India beBee Careers Full time

    Senior Big Data EngineerWe are seeking an experienced Senior Big Data Engineer to fill a key role in our organization. The ideal candidate will have a strong background in Hadoop, big data analytics, and software development.The successful candidate will be responsible for:Scheduling deployments into the Hadoop environment, ensuring seamless integration with...

  • Big Data Developer

    4 weeks ago

    Bengaluru, Karnataka, India Prakhar Software Solutions Private Limited Full time

    Objectives of this role : - Designing, developing, and implementing scalable and efficient data processing pipelines using Big Data technologies.- Collaborating with data architects, data scientists, and business analysts to understand and translate data requirements into technical solutions.- Developing and optimising ETL (Extract, Transform, Load)...

  • Big Data Developer

    2 days ago

    Bengaluru, Karnataka, India beBee Careers Full time

    Big Data Developer Role OverviewAbout the JobWe are seeking a highly motivated and experienced Big Data Developer to join our team.

  • Big Data Developer

    2 weeks ago

    Bengaluru, Karnataka, India beBee Careers Full time

    We are seeking a highly motivated and experienced Big Data Developer to join our team.About the RoleIn this role, you will design, develop, and maintain big data processing systems for efficient data storage and retrieval.You will collaborate with data scientists and analysts to understand their data requirements and provide data solutions.Mandatory...

  • Big Data Developer

    20 hours ago

    Bengaluru, Karnataka, India beBee Careers Full time

    The ideal candidate will have extensive experience in designing and developing data pipelines, data models, and spark-based applications in large-scale Big Data environments.ResponsibilitiesDesign and Development: Lead the design and development of data pipelines, data models, and spark-based applications in large-scale Big Data environments.Data Modeling...

  • Big Data Developer

    1 week ago

    Bengaluru, Karnataka, India beBee Careers Full time

    Job Title: Big Data DeveloperAbout the RoleWe are seeking a skilled and passionate Big Data Developer with 4+ years of IT/development experience. The ideal candidate will have a strong background in building data-driven applications using Spark (Scala or PySpark). This role is ideal for someone who enjoys working with large-scale data systems and is eager to...

  • Big Data Developer

    2 weeks ago

    Bengaluru, Karnataka, India beBee Careers Full time

    Key Requirements:To succeed in this role, you will need to have advanced skills in programming languages such as Python and SQL, as well as experience with big data development tools like Hive and PySpark.Main Responsibilities:Data Engineering:Design and develop scalable data pipelines using Hive and PySpark.Implement data integration and processing...

  • Big Data Developer

    3 weeks ago

    Bengaluru, Karnataka, India Kiash Solutions LLp Full time

    Skills :Big Data Technologies :- Extensive experience with Apache Spark and Scala- Proficient in Hive and HDFS- Hands-on experience with Oozie or similar workflow management toolsProgramming Languages :- Strong expertise in Scala and object-oriented programming conceptsData Modeling & Processing :- Solid understanding of data models, data mining techniques,...

  • Big Data Developer

    2 weeks ago

    Bengaluru, Karnataka, India beBee Careers Full time

    Job Title: Big Data Engineer (Java Spark Developer)We are seeking a seasoned Big Data Engineer with 6-8 years of experience in Big Data/legacy platforms, who can start immediately.The ideal candidate should have expertise in designing, developing, and optimizing real-time & batch data pipelines in a Big Data environment at an enterprise scale application...

  • Big Data Developer

    1 week ago

    Bengaluru, Karnataka, India CORTEX Consultants Full time

    Job Title : Big Data Developer (Scala/Spark)Experience : 4-7 YearsLocation : Chennai / Bangalore / PuneAbout the Role :We are looking for a skilled and passionate Big Data Developer with 4+ years of IT/development experience and a strong background in building data-driven applications using Spark (Scala or PySpark). This role is ideal for someone who enjoys...