Senior Big Data Developer

6 hours ago

Bengaluru, Karnataka, India beBeeBigDataEngineer Full time ₹ 9,00,000 - ₹ 12,00,000
Big Data Engineer

We are seeking a skilled and innovative Big Data Engineer to join our team. This role involves designing, developing, implementing, and troubleshooting scalable Big Data solutions that process, store, and manage large volumes of diverse data.

Key Responsibilities:

  • Data Pipeline Development: Design, build, and maintain robust and scalable ETL (Extract, Transform, Load) pipelines for ingesting, transforming, and loading large datasets from various sources into Big Data platforms.
  • Big Data Ecosystem Utilization: Work with and optimize components of the Hadoop ecosystem (e.g., HDFS, Hive) and Apache Spark for distributed data processing and analysis.
  • Data Processing & Transformation: Develop efficient code using programming languages (e.g., Python, Scala, Java) to perform data manipulation, cleansing, and transformation for analytical purposes.
  • Database Management: Interact with and manage various databases, including relational (SQL) and NoSQL databases (e.g., Cassandra, MongoDB, HBase), for data storage and retrieval.
  • Troubleshooting & Optimization: Identify, troubleshoot, and resolve performance bottlenecks and issues within Big Data pipelines and infrastructure.
  • Data Quality & Governance: Assist in implementing data quality checks and contribute to data governance practices to ensure data accuracy, consistency, and reliability.
  • Collaboration: Collaborate effectively with Data Scientists, Data Analysts, and other engineering teams to understand data requirements and deliver reliable data solutions.
  • Monitoring & Support: Monitor Big Data jobs and processes, providing operational support and maintenance for developed solutions.
  • Continuous Learning: Stay updated with the latest trends and advancements in Big Data technologies and contribute to the adoption of new tools and best practices.

Required Skills and Qualifications:

  • Experience: 2-4 years of hands-on experience in Big Data engineering or a related data-centric role.
  • Big Data Technologies: Practical experience with key Big Data technologies such as Apache Hadoop, Apache Spark, and data warehousing concepts (e.g., Hive).
  • Programming Skills: Proficiency in at least one programming language relevant to Big Data (e.g., Python, Scala, or Java).
  • Database Skills: Strong command of SQL for data querying and manipulation. Familiarity with NoSQL databases is a plus.
  • Cloud Exposure (Plus): Exposure to Big Data services on cloud platforms (e.g., AWS EMR, Azure Data Lake Analytics, Google Cloud Dataproc) is advantageous.
  • Problem-Solving: Excellent analytical and problem-solving skills with a keen eye for detail in complex data environments.
  • Communication: Good verbal and written communication skills to effectively collaborate with team members and stakeholders.
  • Education: Bachelor's degree in Computer Science, Engineering, Data Science, or a related quantitative field.

  • Senior Big Data Developer

    4 days ago

    Bengaluru, Karnataka, India beBeeBigData Full time ₹ 15,00,000 - ₹ 20,00,000

    Big Data DeveloperWe are seeking a skilled Big Data developer to help prevent financial crime and benefit our customers, societies and partners. As a Senior Developer, you will be responsible for designing and building solutions that follow industry-standard regarding usability, performance, reliability, and scalability.

  • Big Data Developer

    4 days ago

    Bengaluru, Karnataka, India Kezan Consulting Full time

    Position : Big Data Engineer (Immediate Joiner)Experience : 5+ YearsLocation : (Gurugram / Bangalore)Joining : Immediate JoinerJob Summary : We're seeking an experienced Senior Big Data Engineer with 5+ years of experience in designing, developing, and implementing large-scale data systems using Redshift, AWS, Spark, and Scala.The ideal candidate will...

  • Senior Big Data Architect

    1 week ago

    Bengaluru, Karnataka, India beBeeDataArchitect Full time ₹ 25,00,000 - ₹ 35,00,000

    Job SummaryWe are seeking a highly skilled Senior Big Data Architect to design and implement large-scale data architectures that drive business growth and innovation. The ideal candidate will have extensive experience in big data technologies, including data warehousing, ETL, and data visualization.Key ResponsibilitiesDesign and implement scalable data...

  • Senior Big Data Developer

    6 days ago

    Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Opportunity: Data EngineerAbout the RoleWe are seeking a highly skilled data engineer to join our team in shaping the future of technology and product development.The ideal candidate will be part of a fast-paced, entrepreneurial environment focused on delivering innovative marketing capabilities.The team is responsible for marketing campaign tracking,...

  • Senior Big Data Engineer

    6 days ago

    Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 1,04,000 - ₹ 1,30,878

    ">Big Data Engineer">Job Description: As a senior big data engineer, you will play a key role in designing and implementing large-scale data processing systems. You will work with cross-functional teams to develop and deploy data pipelines that integrate with various data sources and enable business insights.">Develop scalable and efficient data pipelines...

  • Senior Big Data Engineer

    3 days ago

    Bengaluru, Karnataka, India Guide&Bridge Full time US$ 1,50,000 - US$ 2,00,000 per year

    Job Title: Senior Big Data EngineerExperience Required: 3+ YearsAbout the RoleWe are looking for an experiencedSenior Big Data Engineerto design, build, and optimize large-scale data pipelines and platforms. The ideal candidate will have strong expertise in distributed data processing, cloud-based data solutions, and a proven ability to work with complex...

  • Big Data Developer

    5 days ago

    Bengaluru, Karnataka, India beBeeDataEngineer Full time US$ 1,50,000 - US$ 2,50,000

    The primary objective of this role is to design and develop data pipelines utilizing Big Data technologies. A deep understanding of Py Spark, Hive, and Spark optimization is crucial for success in this position.Key Responsibilities Develop and maintain data pipelines using Big Data technologies. Collaborate with cross-functional teams to identify and...

  • Senior Big Data Developer

    1 week ago

    Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Summary:We are seeking a highly skilled Data Engineer to join our team. The successful candidate will have extensive experience in big data and data-related technologies, with a strong understanding of distributed computing principles.Key Responsibilities:Design and develop large-scale data processing systems using Apache Spark and Python.Work with...

  • Big Data Developer

    3 days ago

    Bengaluru, Karnataka, India LION AND ELEPHANTS Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Job Description:We are looking for skilled Big Data Engineers using Java Spark with 5-10 years of experience in Big Data / legacy platforms, who can join immediately. We have openings in Bengaluru, Chennai, Hyderabad, Pune, Delhi.Desired candidates should have design, development and optimization of real-time & batch data pipelines experience in a Big Data...

  • Big Data Developer

    2 weeks ago

    Bengaluru, Karnataka, India Recro Full time

    Role Overview: Spark/Scala Developer (Big Data) We are seeking experienced Big Data Engineers with strong expertise in Scala and Apache Spark to join our team. The ideal candidate will be responsible for designing and implementing scalable data solutions, optimizing performance, and translating business requirements into technical deliverables. Key...