Big Data Developer
4 weeks ago
Role : Big Data Developer
Location : Bangalore / Pune
Experience Required : 10+ Years
Employment Type : Full-Time
About the Role :
We are seeking an experienced Big Data Developer who has strong hands-on expertise in building scalable data pipelines and solutions using technologies like Java, Python, Spark, Scala, Kafka, and AWS. The ideal candidate will have a deep understanding of big data ecosystems, cloud platforms, and distributed systems to help drive complex data initiatives.
Key Responsibilities :
- Design, develop, and optimize scalable data pipelines for large-scale data processing using Spark and Scala.
- Develop robust data integration solutions using Kafka for real-time data ingestion and streaming.
- Write efficient code in Java and Python for backend data processing and analytics workflows.
- Work closely with data architects, data scientists, and cloud teams to integrate big data solutions on AWS infrastructure.
- Implement and maintain data storage, ETL processes, and data transformation pipelines.
- Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.
- Monitor and troubleshoot data pipelines to ensure high performance and reliability.
- Apply best practices in coding, security, and compliance for data processing at scale.
Key Skills and Technologies :
- Strong programming experience with Java and Python.
- Expertise in Apache Spark (batch and streaming) and Scala development.
- Proficient with Apache Kafka for real-time messaging and data streaming.
- Deep understanding and hands-on experience with AWS services (S3, EMR, Redshift, Lambda, Glue, etc.).
- Solid experience with distributed computing, big data architecture, and data warehousing.
- Strong knowledge of SQL, data modeling, and NoSQL databases is a plus.
- Good understanding of DevOps practices, CI/CD, and containerization (Docker, Kubernetes) is advantageous.
Preferred Qualifications :
- Bachelors/Masters degree in Computer Science, Information Technology, or related field.
- 10+ years of industry experience in Big Data and Cloud Technologies.
- Certifications in AWS, Big Data, or related technologies are a plus.
Why Join Us?
- Opportunity to work on cutting-edge big data projects.
- Collaborate with top industry experts in data engineering.
- Competitive salary and career growth opportunities.
-
Big Data Developer
4 weeks ago
Bengaluru, Karnataka, India Ampcus Tech Full timeBig Data Developer (Spark, Scala, Azure Focus)Locations : Delhi, Mumbai, Bangalore, Hyderabad, ChennaiEmployment Type : Full-Time Employee (FTE) / Contract-To-Hire (CTH)Experience : 6+ YearsAre you a highly skilled and experienced Big Data Developer with a passion for building robust and scalable data processing solutions? Do you have a strong command of...
-
Big Data Developer
2 weeks ago
Bengaluru, Karnataka, India Nasugroup Full timeJob Description :We are seeking a highly motivated and experienced Big Data Developer. You will be responsible for designing, developing, and implementing scalable and efficient big data solutions. The ideal candidate will possess strong expertise in Big Data technologies, particularly Spark and Scala, and have hands-on experience with cloud platforms. As an...
-
Big Data Developer
2 weeks ago
Bengaluru, Karnataka, India Myhashtagss Full timeJob Description :We are seeking a highly skilled Big Data Developer with expertise in Hadoop, Python, and PySpark to join our team on a 12-month contract-to-hire basis. In this role, you will be responsible for designing and implementing scalable big data solutions, ensuring the efficient processing of large datasets in a distributed computing environment....
-
Big Data Developer
3 days ago
Bengaluru, Karnataka, India Tata Consultancy Services Full timeTCS has always been in the spotlight for being adept in "the next big technologies" What we can offer you is a space to explore varied technologies and quench your techie soul.Role: Big Data DeveloperLocation: BangaloreExperience:5-10 Years- Required Technical skills: Bigdata, Hadoop Technologies- 4+ years of experience in Big Data, Hadoop- Sound Knowledge...
-
Big Data Developer
1 week ago
Bengaluru, Karnataka, India beBeeDataScientist Full timeJob Title: Data ScientistWe are seeking an experienced Data Scientist to join our team in Bangalore. The ideal candidate will have a strong background in Python, Java, and Scala development, with proven experience in big data processing using PySpark.Key Responsibilities:Analyze large datasets to identify trends and insightsDevelop and implement data-driven...
-
Big Data Developer
2 weeks ago
Bengaluru, Karnataka, India beBeeBigData Full timeJob Title: Big Data Developer">About the RoleWe are seeking a highly skilled and experienced Big Data Developer to join our team. As a key member of our data engineering group, you will be responsible for designing and developing large-scale data processing applications using Apache Spark.Your primary focus will be on developing high-quality code that meets...
-
Senior Big Data Developer
22 hours ago
Bengaluru, Karnataka, India beBeeData Full timeBig Data Engineer RoleBig data engineering involves designing and developing scalable big data solutions using PySpark. As a big data engineer, you will work on large datasets, ensuring data quality, and implementing efficient data processing techniques.Job Responsibilities:Design and Develop Scalable Big Data SolutionsDevelop big data solutions using...
-
Big Data Developer
4 weeks ago
Bengaluru, Karnataka, India Impetus Full timeImpetus Technologies is seeking a skilled Java Bigdata Engineer to join our dynamic team. The ideal candidate will possess strong expertise in Java programming and have hands-on experience with Bigdata technologies. If you are interested and can join us for Bangalore location. Please do share your resume at Responsibilities: - Design, develop, and...
-
Big Data Developer
4 weeks ago
Bengaluru, Karnataka, India Tata Consultancy Services Full timeGreetings from TCSTCS has been a great pioneer in feeding the fire of young Techies like you. We are a global leader in the technology arena and there's nothing that can stop us from growing together.Your role is of key importance, as it lays down the foundation for the entire project.Position: Big Data DeveloperJob Location: BangaloreExperience: 5+Job...
-
Big Data Developer
3 weeks ago
Bengaluru, Karnataka, India Mphasis Full timeJob Title: Big Data Engineer Tech Primary Skills:Hadoop (HDFS, Map-Reduce, YARN)SPARK (SQL, DataFrame)ETL/ELT (Professional experience with Teradata, Ab Initio)Python or PySparkMongoDB, GCP, Big QueryCI/CD, HiveUnix, AutosysResponsibilities:Design, develop, and test robust ETL/ELT data pipelines using Map-Reduce and SPARK.Process large datasets in...