Big Data Developer

2 days ago

Bengaluru, Karnataka, India PradeepIT Consulting Services Full time ₹ 12,00,000 - ₹ 36,00,000 per year


L3 Big data
developer Years)

1. Design, develop, and implement highly scalable and distributed big data
solutions using Hadoop ecosystem technologies such as HBase, Hive, Kudu, and
Spark.

2. Architect HBase schemas and data models to accommodate evolving business
requirements and ensure optimal performance for data storage and retrieval
operations.

3. Develop complex Hive queries and data processing pipelines to transform raw
data into structured formats suitable for analysis and reporting.

4. Implement data ingestion pipelines using Spark Streaming and Spark SQL for
real-time processing of streaming data sources, ensuring high throughput and
low latency.

5. Optimize Spark applications for performance and resource utilization,
including tuning RDD transformations, optimizing data partitioning strategies,
and leveraging in-memory caching.

6. Utilize advanced features of Spark MLlib for machine learning tasks such as
classification, regression, clustering, and collaborative filtering.

7. Design and deploy Kudu tables for fast analytical queries and real-time
analytics, leveraging Kudus unique combination of fast analytics and fast data
ingestion.

8. Collaborate with data scientists to integrate machine learning models into
Spark workflows and productionize them for real-time predictions and analytics.

9. Troubleshoot performance bottlenecks, data quality issues, and system
failures in big data applications and infrastructure, and implement solutions
to address them.

10. Stay abreast of emerging technologies and best practices in big data processing
and analytics, and evaluate their potential impact on our architecture and
solutions.


  • Big Data Developer

    2 weeks ago

    Bengaluru, Karnataka, India Sourcebae Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Alert: Senior Big Data Engineer (5-8 Yrs) | Spark, Python, Scala Are you a seasonedBig Data Engineerready to build and optimize large-scale, distributed data processing applications? We are seeking a senior engineer with5-8 yearsof experience in the core Big Data ecosystem to deliver high-performance solutions.This is a great opportunity to join a...

  • Big Data Developer

    6 days ago

    Bengaluru, Karnataka, India Hashone Careers Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Description : Experience yrs Mode of Working - Hybrid (3 days WFO, 2 days WFH) Location - Bangalore / Pune / Hyderabad.Big Data Developer : Focus : Building applications and solutions - Writes code and develops software applications that process big data - Creates data-driven applications and analytical tools - Focuses on implementing...

  • Senior Big Data Developer

    7 days ago

    Bengaluru, Karnataka, India Info Origin Inc. Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    NEW OPPORTUNITY || IMMEDIATE TO 30 DAYS JOINERS REQUIRED || SENIOR BIG DATA DEVELOPER ||Job Title: Senior Big Data DeveloperRequired Experience: 6+ YearsLocation: BangaloreEmployment Type: Full-timeJob SummaryKey Responsibilities· Develop, test, and deploy high-performance data pipelines using Hadoop, Spark, Kudu, and HBase.· Implement ETL/ELT workflows...

  • Big Data Developer

    7 days ago

    Bengaluru, Karnataka, India First Due Solutions Full time ₹ 12,00,000 - ₹ 25,00,000 per year

    Job Description:Experience yrsMode of Working - Hybrid (3 days WFO, 2 days WFH)Location - Bangalore / Pune / Hyderabad.Big Data DeveloperFocus: Building applications and solutionsWrites code and develops software applications that process big dataCreates data-driven applications and analytical toolsFocuses on implementing business logic and algorithmsBuild...

  • Big Data Developer

    2 days ago

    Bengaluru, Karnataka, India VidPro Consultancy Services Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Python, pyspark, SQL, DSA, AWS, Hadoop, Hive, Mapreduce and Spark5+ years of hands-on experience in designing, building and supporting Data Applications using Spark, Sqoop and HiveBachelors or masters degree in Computer Science or related fieldStrong knowledge of working with large data sets and high-capacity big data processing platformStrong experience in...

  • Big Data

    2 days ago

    Bengaluru, Karnataka, India PradeepIT Consulting Services Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About the jobAccelerate your career with PradeepITPradeepIT is one of the largest, globally recognized IT Consulting firm to connect Indias deeply vetted talent team to global customer.Were headquartered in Bengaluru, Silicon Valley of India. PradeepITs customers include SAP Lab, Bosch, Rolls-Royce, Daikin, Daimler and J&J and hundreds of other Fortune 500...

  • Big Data Developer

    2 weeks ago

    Bengaluru, Karnataka, India Infobell IT Full time ₹ 1,20,000 - ₹ 1,80,000 per year

    Job Title:Big Data DeveloperLocation:Bangalore (Work from Office)Experience:5+ YearsNotice Period:Immediate Joiners PreferredAbout Us:Infobell IT is a technology-driven company specializing inproduct engineering,AI,cloud modernization, anddata analytics. We work with leading enterprises to build scalable, high-performance, and cloud-native solutions.Key...

  • Big Data Developer

    2 weeks ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Greetings from TCSTCS has been a great pioneer in feeding the fire of young Techies like you. We are a global leader in the technology arena and there's nothing that can stop us from growing together.Your role is of key importance, as it lays down the foundation for the entire project.Position:Bigdata DeveloperJob Location:BangaloreExperience:6-12 YearsMust...

  • Big Data Engineer

    4 days ago

    Bengaluru, Karnataka, India Etaclam Techno Services Full time ₹ 12,00,000 - ₹ 14,40,000 per year

    Job Title: Big Data EngineerLocation: BengaluruExperience Required: 5 to 8 yearsJob Description:We are looking for a skilled Big Data Engineer with strong hands-on experience in PySpark and SQL. This is a hybrid role, requiring the candidate to work both remotely and from the office as needed. The ideal candidate should be comfortable working on large-scale...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Brillio Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Key skills - Hive, SQL, Python, Spark, Hadoop and kafka , apache airflowJob Title Big Data EngineerRole OverviewWe are seeking a highly skilled Big Data Engineer to join our team. The ideal candidate will have strong experience in building, maintaining, and optimizing large-scale data pipelines and distributed data processing systems. This role involves...