Big Data Developer

6 hours ago

Bengaluru, Karnataka, India PradeepIT Consulting Services Full time ₹ 12,00,000 - ₹ 36,00,000 per year


L3 Big data
developer Years)

1. Design, develop, and implement highly scalable and distributed big data
solutions using Hadoop ecosystem technologies such as HBase, Hive, Kudu, and
Spark.

2. Architect HBase schemas and data models to accommodate evolving business
requirements and ensure optimal performance for data storage and retrieval
operations.

3. Develop complex Hive queries and data processing pipelines to transform raw
data into structured formats suitable for analysis and reporting.

4. Implement data ingestion pipelines using Spark Streaming and Spark SQL for
real-time processing of streaming data sources, ensuring high throughput and
low latency.

5. Optimize Spark applications for performance and resource utilization,
including tuning RDD transformations, optimizing data partitioning strategies,
and leveraging in-memory caching.

6. Utilize advanced features of Spark MLlib for machine learning tasks such as
classification, regression, clustering, and collaborative filtering.

7. Design and deploy Kudu tables for fast analytical queries and real-time
analytics, leveraging Kudus unique combination of fast analytics and fast data
ingestion.

8. Collaborate with data scientists to integrate machine learning models into
Spark workflows and productionize them for real-time predictions and analytics.

9. Troubleshoot performance bottlenecks, data quality issues, and system
failures in big data applications and infrastructure, and implement solutions
to address them.

10. Stay abreast of emerging technologies and best practices in big data processing
and analytics, and evaluate their potential impact on our architecture and
solutions.


  • Big Data Developer

    2 weeks ago

    Bengaluru, Karnataka, India Xebia Full time ₹ 5,00,000 - ₹ 25,00,000 per year

    Job Title : Big Data Developer - Spark/ScalaJob location : BengaluruNotice Period : immediate - 15 daysPosition Overview : We are looking for Scala/Spark developers with strong expertise on Python / Hadoop and Azure cloud ..Big Data Orchestration: Airflow, Spark on Kubernetes, Yarn, OozieBig Data Processing: Hadoop, Kafka, Spark & Spark Structured...

  • Big Data Developer

    1 week ago

    Bengaluru, Karnataka, India Sourcebae Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Alert: Senior Big Data Engineer (5-8 Yrs) | Spark, Python, Scala Are you a seasonedBig Data Engineerready to build and optimize large-scale, distributed data processing applications? We are seeking a senior engineer with5-8 yearsof experience in the core Big Data ecosystem to deliver high-performance solutions.This is a great opportunity to join a...

  • Senior Big Data Developer

    5 days ago

    Bengaluru, Karnataka, India Info Origin Inc. Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    NEW OPPORTUNITY || IMMEDIATE TO 30 DAYS JOINERS REQUIRED || SENIOR BIG DATA DEVELOPER ||Job Title: Senior Big Data DeveloperRequired Experience: 6+ YearsLocation: BangaloreEmployment Type: Full-timeJob SummaryKey Responsibilities· Develop, test, and deploy high-performance data pipelines using Hadoop, Spark, Kudu, and HBase.· Implement ETL/ELT workflows...

  • Big Data Developer

    5 days ago

    Bengaluru, Karnataka, India First Due Solutions Full time ₹ 12,00,000 - ₹ 25,00,000 per year

    Job Description:Experience yrsMode of Working - Hybrid (3 days WFO, 2 days WFH)Location - Bangalore / Pune / Hyderabad.Big Data DeveloperFocus: Building applications and solutionsWrites code and develops software applications that process big dataCreates data-driven applications and analytical toolsFocuses on implementing business logic and algorithmsBuild...

  • Big Data Developer

    8 hours ago

    Bengaluru, Karnataka, India VidPro Consultancy Services Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Python, pyspark, SQL, DSA, AWS, Hadoop, Hive, Mapreduce and Spark5+ years of hands-on experience in designing, building and supporting Data Applications using Spark, Sqoop and HiveBachelors or masters degree in Computer Science or related fieldStrong knowledge of working with large data sets and high-capacity big data processing platformStrong experience in...

  • Big Data Developer

    8 hours ago

    Bengaluru, Karnataka, India Workassist Full time ₹ 10,00,000 - ₹ 30,00,000 per year

    Work Level: IndividualCore: Result Driven, Adaptable, OrganizedLeadership: Influencing, Decisive, ResponsiveIndustry Type: Software ProductFunction: Software DevelopmentKey Skills: Bigdata,Big Data Platforms,Hadoop,PySpark,SparkEducation: GraduateNote: This is a requirement for one of the Workassist Hiring Partner.Focus : Building applications and...

  • Big Data

    16 hours ago

    Bengaluru, Karnataka, India PradeepIT Consulting Services Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About the jobAccelerate your career with PradeepITPradeepIT is one of the largest, globally recognized IT Consulting firm to connect Indias deeply vetted talent team to global customer.Were headquartered in Bengaluru, Silicon Valley of India. PradeepITs customers include SAP Lab, Bosch, Rolls-Royce, Daikin, Daimler and J&J and hundreds of other Fortune 500...

  • Big Data Developer

    2 weeks ago

    Bengaluru, Karnataka, India Infobell IT Full time ₹ 1,20,000 - ₹ 1,80,000 per year

    Job Title:Big Data DeveloperLocation:Bangalore (Work from Office)Experience:5+ YearsNotice Period:Immediate Joiners PreferredAbout Us:Infobell IT is a technology-driven company specializing inproduct engineering,AI,cloud modernization, anddata analytics. We work with leading enterprises to build scalable, high-performance, and cloud-native solutions.Key...

  • Big Data Developer

    2 weeks ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Greetings from TCSTCS has been a great pioneer in feeding the fire of young Techies like you. We are a global leader in the technology arena and there's nothing that can stop us from growing together.Your role is of key importance, as it lays down the foundation for the entire project.Position:Bigdata DeveloperJob Location:BangaloreExperience:6-12 YearsMust...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Acme Services Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    We are looking for Big Data Engineer who has experience with:- 1) Big Query 2) Pyspark 3) GCP or AWS or Azure Required Candidate profileCandidate should have more than 5 Years of overall experience in Data Engineer. We are not looking for Data Analyst or Snowflake Developer.