Big Data Developer

1 day ago

Bengaluru, India Pradeepit Consulting Services Full time

Job Description L3 Big data developer: 1. Design, develop, and implement highly scalable and distributed big data solutions using Hadoop ecosystem technologies such as HBase, Hive, Kudu, and Spark. 2. Architect HBase schemas and data models to accommodate evolving business requirements and ensure optimal performance for data storage and retrieval operations. 3. Develop complex Hive queries and data processing pipelines to transform raw data into structured formats suitable for analysis and reporting. 4. Implement data ingestion pipelines using Spark Streaming and Spark SQL for real-time processing of streaming data sources, ensuring high throughput and low latency. 5. Optimize Spark applications for performance and resource utilization, including tuning RDD transformations, optimizing data partitioning strategies, and leveraging in-memory caching. 6. Utilize advanced features of Spark MLlib for machine learning tasks such as classification, regression, clustering, and collaborative filtering. 7. Design and deploy Kudu tables for fast analytical queries and real-time analytics, leveraging Kudus unique combination of fast analytics and fast data ingestion. 8. Collaborate with data scientists to integrate machine learning models into Spark workflows and productionize them for real-time predictions and analytics. 9. Troubleshoot performance bottlenecks, data quality issues, and system failures in big data applications and infrastructure, and implement solutions to address them. 10. Stay abreast of emerging technologies and best practices in big data processing and analytics, and evaluate their potential impact on our architecture and solutions.

  • Big Basket

    2 weeks ago

    Bengaluru, India big basket Full time

    What would you be doing/ Expected from this role ?- Collaborate with cross-functional teams including data scientists, engineers, and product managers to deliver AI-driven solutions.- Drive the architecture of machine learning pipelines from data collection and preprocessing to model training, evaluation, and deployment.- Implement scalable machine learning...

  • Big Data Developer

    2 weeks ago

    Bengaluru, Karnataka, India Talent Worx Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    We're hiring for one of the world's leading professional services firms, renowned for its commitment to innovation, excellence, and global impact. With a presence in over 150 countries, this organization provides services across consulting, audit, tax, risk advisory, and financial advisory — helping Fortune 500 companies and governments navigate complex...

  • Big Data Developer

    4 days ago

    Bengaluru, Karnataka, India LION AND ELEPHANTS Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job Description:We are looking for skilled Big Data Engineers using Java Spark with 5-10 years of experience in Big Data / legacy platforms, who can join immediately. We have openings in Bengaluru, Chennai, Hyderabad, Pune, Delhi.Desired candidates should have design, development and optimization of real-time & batch data pipelines experience in a Big Data...

  • Big Data

    1 day ago

    Bengaluru, India Teamware Solutions Full time

    Job Description Teamware Solutions is seeking a talented and passionate Big Data Engineer with 2-4 years of experience to join our dynamic team. This role is crucial for designing, developing, implementing, and troubleshooting scalable Big Data solutions that process, store, and manage large volumes of diverse data. The successful candidate will contribute...

  • Big data developer

    6 hours ago

    Bengaluru, India Tata Consultancy Services Full time

    Greetings from TCS!!!TCS has been a great pioneer in feeding the fire of young Techies like you. We are a global leader in the technology arena and there’s nothing that can stop us from growing together.Your role is of key importance, as it lays down the foundation for the entire project.Position: Bigdata DeveloperJob Location: BangaloreExperience: 6-12...

  • Big Data Developer

    4 days ago

    Bengaluru, Karnataka, India Grid Dynamics Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    7 to 15 Years of experience in Big Data Developer (Mandatory Splunk to ClickHouse and Grafana)Essential FunctionsKey Responsibilities7 to 15 Years of experience in Big Data DeveloperDesign and develop scalable data pipelines to migrate user knowledge objects from Splunk to ClickHouse and Grafana.Implement data ingestion, transformation, and validation...

  • Big Data Developer

    2 weeks ago

    Bengaluru, Karnataka, India Hashone Careers Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Description : Experience yrs Mode of Working - Hybrid (3 days WFO, 2 days WFH) Location - Bangalore / Pune / Hyderabad.Big Data Developer : Focus : Building applications and solutions - Writes code and develops software applications that process big data - Creates data-driven applications and analytical tools - Focuses on implementing...

  • Big Data Developer

    1 day ago

    Bengaluru, India Tata Consultancy Services Full time

    Dear Candidates, Greetings from Tata Consultancy Services!!! TCS has been a great pioneer in feeding the fire of young techies like you. We are a global leader in the technology arena and there’s nothing that can stop us from growing together. Kindly attach your updated resumes What we are looking for? - Role: Big Data Developer - Experience: 4 to 10 years...

  • Big Data Developer

    1 day ago

    Bengaluru, India Tata Consultancy Services Full time

    Dear Candidates, Greetings from Tata Consultancy Services!!! TCS has been a great pioneer in feeding the fire of young techies like you. We are a global leader in the technology arena and there’s nothing that can stop us from growing together. Kindly attach your updated resumes What we are looking for? Role: Big Data Developer Experience: 4 to 10 years...

  • Big Data Developer

    1 day ago

    Bengaluru, India Tata Consultancy Services Full time

    Dear Candidates,Greetings from Tata Consultancy Services!!!TCS has been a great pioneer in feeding the fire of young techies like you. We are a global leader in the technology arena and there’s nothing that can stop us from growing together.Kindly attach your updated resumesWhat we are looking for?- Role: Big Data Developer- Experience: 4 to 10 years...