Big Data Developer

4 weeks ago

Bengaluru, Karnataka, India Coders Brain Technology Private Limited Full time

Role : Big Data Developer

Location : Bangalore / Pune

Experience Required : 10+ Years

Employment Type : Full-Time

About the Role :

We are seeking an experienced Big Data Developer who has strong hands-on expertise in building scalable data pipelines and solutions using technologies like Java, Python, Spark, Scala, Kafka, and AWS. The ideal candidate will have a deep understanding of big data ecosystems, cloud platforms, and distributed systems to help drive complex data initiatives.

Key Responsibilities :

- Design, develop, and optimize scalable data pipelines for large-scale data processing using Spark and Scala.

- Develop robust data integration solutions using Kafka for real-time data ingestion and streaming.

- Write efficient code in Java and Python for backend data processing and analytics workflows.

- Work closely with data architects, data scientists, and cloud teams to integrate big data solutions on AWS infrastructure.

- Implement and maintain data storage, ETL processes, and data transformation pipelines.

- Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.

- Monitor and troubleshoot data pipelines to ensure high performance and reliability.

- Apply best practices in coding, security, and compliance for data processing at scale.

Key Skills and Technologies :

- Strong programming experience with Java and Python.

- Expertise in Apache Spark (batch and streaming) and Scala development.

- Proficient with Apache Kafka for real-time messaging and data streaming.

- Deep understanding and hands-on experience with AWS services (S3, EMR, Redshift, Lambda, Glue, etc.).

- Solid experience with distributed computing, big data architecture, and data warehousing.

- Strong knowledge of SQL, data modeling, and NoSQL databases is a plus.

- Good understanding of DevOps practices, CI/CD, and containerization (Docker, Kubernetes) is advantageous.

Preferred Qualifications :

- Bachelors/Masters degree in Computer Science, Information Technology, or related field.

- 10+ years of industry experience in Big Data and Cloud Technologies.

- Certifications in AWS, Big Data, or related technologies are a plus.

Why Join Us?

- Opportunity to work on cutting-edge big data projects.

- Collaborate with top industry experts in data engineering.

- Competitive salary and career growth opportunities.

(ref:hirist.tech)

  • Big Data Developer

    4 weeks ago

    Bengaluru, Karnataka, India Ampcus Tech Full time

    Big Data Developer (Spark, Scala, Azure Focus)Locations : Delhi, Mumbai, Bangalore, Hyderabad, ChennaiEmployment Type : Full-Time Employee (FTE) / Contract-To-Hire (CTH)Experience : 6+ YearsAre you a highly skilled and experienced Big Data Developer with a passion for building robust and scalable data processing solutions? Do you have a strong command of...

  • Big Data Developer

    2 weeks ago

    Bengaluru, Karnataka, India Nasugroup Full time

    Job Description :We are seeking a highly motivated and experienced Big Data Developer. You will be responsible for designing, developing, and implementing scalable and efficient big data solutions. The ideal candidate will possess strong expertise in Big Data technologies, particularly Spark and Scala, and have hands-on experience with cloud platforms. As an...

  • Big Data Developer

    3 weeks ago

    Bengaluru, Karnataka, India Myhashtagss Full time

    Job Description :We are seeking a highly skilled Big Data Developer with expertise in Hadoop, Python, and PySpark to join our team on a 12-month contract-to-hire basis. In this role, you will be responsible for designing and implementing scalable big data solutions, ensuring the efficient processing of large datasets in a distributed computing environment....

  • Big Data Developer

    6 days ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    TCS has always been in the spotlight for being adept in "the next big technologies" What we can offer you is a space to explore varied technologies and quench your techie soul.Role: Big Data DeveloperLocation: BangaloreExperience:5-10 Years- Required Technical skills: Bigdata, Hadoop Technologies- 4+ years of experience in Big Data, Hadoop- Sound Knowledge...

  • Big Data Developer

    1 week ago

    Bengaluru, Karnataka, India beBeeDataScientist Full time

    Job Title: Data ScientistWe are seeking an experienced Data Scientist to join our team in Bangalore. The ideal candidate will have a strong background in Python, Java, and Scala development, with proven experience in big data processing using PySpark.Key Responsibilities:Analyze large datasets to identify trends and insightsDevelop and implement data-driven...

  • Big Data Developer

    2 days ago

    Bengaluru, Karnataka, India Talpro Full time

    Job Description : We are seeking immediate joiners (available to start in May) for the role of Big Data Developer (Python / PySpark). The ideal candidate will have 58 years of industry experience, with at least 3+ years of hands-on work in Big Data technologies. You will play a key role in building and maintaining scalable data pipelines, supporting...

  • Big Data Developer

    4 weeks ago

    Bengaluru, Karnataka, India Impetus Full time

    Impetus Technologies is seeking a skilled Java Bigdata Engineer to join our dynamic team. The ideal candidate will possess strong expertise in Java programming and have hands-on experience with Bigdata technologies. If you are interested and can join us for Bangalore location. Please do share your resume at Responsibilities: - Design, develop, and...

  • Senior Big Data Developer

    4 days ago

    Bengaluru, Karnataka, India beBeeData Full time

    Big Data Engineer RoleBig data engineering involves designing and developing scalable big data solutions using PySpark. As a big data engineer, you will work on large datasets, ensuring data quality, and implementing efficient data processing techniques.Job Responsibilities:Design and Develop Scalable Big Data SolutionsDevelop big data solutions using...

  • Big Data Developer

    1 week ago

    Bengaluru, Karnataka, India Grid Dynamics Full time

    Key ResponsibilitiesDesign and develop scalable data pipelines to migrate user knowledge objects from Splunk to Click House and Grafana.Implement data ingestion, transformation, and validation processes to ensure data integrity and performance.Collaborate with cross-functional teams to automate and optimize data migration workflows.Monitor and troubleshoot...

  • Big Data Developer

    4 weeks ago

    Bengaluru, Karnataka, India Impetus Full time

    Impetus Technologies is seeking a skilled Java + Bigdata Engineer to join our dynamic team. The ideal candidate will possess strong expertise in Java programming and have hands-on experience with Bigdata technologies. If you are interested and can join us for Bangalore location. Please do share your resume at Responsibilities: - Design, develop, and...