Big Data Solutions Architect

16 hours ago

Bengaluru, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000
Senior Big Data Engineer

Leverage your expertise in big data processing to drive business growth and innovation.

  • Design and implement scalable big data solutions using Hadoop ecosystem technologies such as HBase, Hive, Kudu, and Spark.
  • Architect HBase schemas and data models to meet evolving business requirements and ensure optimal performance for data storage and retrieval operations.
  • Develop complex Hive queries and data processing pipelines to transform raw data into structured formats suitable for analysis and reporting.
  • Implement real-time data ingestion pipelines using Spark Streaming and Spark SQL to process streaming data sources with high throughput and low latency.
  • Optimize Spark applications for performance and resource utilization, including tuning RDD transformations, optimizing data partitioning strategies, and leveraging in-memory caching.
  • Utilize advanced features of Spark MLlib for machine learning tasks such as classification, regression, clustering, and collaborative filtering.
  • Design and deploy Kudu tables for fast analytical queries and real-time analytics, taking advantage of Kudu's unique combination of fast analytics and fast data ingestion.
  • Collaborate with data scientists to integrate machine learning models into Spark workflows and productionize them for real-time predictions and analytics.
  • Troubleshoot performance bottlenecks, data quality issues, and system failures in big data applications and infrastructure, and implement solutions to address them.
  • Stay up-to-date with emerging technologies and best practices in big data processing and analytics, and evaluate their potential impact on our architecture and solutions.
Key Responsibilities

As a Senior Big Data Engineer, you will be responsible for:

  • Big Data Solutions Architect

    5 days ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Key Role: Big Data Solutions ArchitectThis position is responsible for designing and implementing scalable data pipelines and ETL processes.Main Responsibilities:Architect, optimize big data and analytics solutions using Spark, Delta Lake, and MLflow technologies.Collaborate with stakeholders to translate business requirements into technical solutions that...

  • Big Data Solution Architect

    1 day ago

    Bengaluru, Karnataka, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 40,00,000

    Job Title: Big Data Solution ArchitectAbout the Role:As a Big Data Solution Architect, you will play a key role in designing and implementing scalable data architectures for our clients. You will be responsible for leading teams of engineers and architects to deliver complex data solutions that meet the evolving needs of our clients.Key...

  • Lead Big Data Solutions Architect

    1 day ago

    Bengaluru, Karnataka, India beBeeSolutions Full time ₹ 20,00,000 - ₹ 30,00,000

    Big Data Solutions ArchitectWe are seeking a seasoned Big Data Solutions Architect to design, develop, and optimize data pipelines and ETL workflows.About the Role:The successful candidate will have strong hands-on experience with big data technologies such as Apache Hadoop, Spark, and PySpark.They will be proficient in Scala, Python, and SQL, and have...

  • Big Data Architect

    5 days ago

    Bengaluru, Karnataka, India EdgeVerve Full time

    Job Tittle- Big Data ArchitectLocation - Bangalore/ PuneExperience: 10Yrs to 16 YearsExperienced profile with strong integration data architecture, data modeling, database design, proficient in SQL and familiar with at least one cloud platforms. Good understanding of data integration and management tools (MuleSoft/IBM Sterling Integrator/Talend/Informatica.)...

  • Big Data Architect

    2 weeks ago

    Bengaluru, Karnataka, India EdgeVerve Full time

    Job Tittle- Big Data Architect Location - Bangalore/ Pune Experience: 10Yrs to 16 Years Experienced profile with strong integration data architecture, data modeling, database design, proficient in SQL and familiar with at least one cloud platforms. Good understanding of data integration and management tools (MuleSoft/IBM Sterling...

  • Big Data Architect

    15 hours ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Big Data Architect We are seeking a skilled professional to oversee the collection, storage, and analysis of vast amounts of data. The primary responsibility will be to select and implement optimal solutions for these purposes, maintaining, implementing, and monitoring them. Your duties will include:Selecting and integrating appropriate Big Data...

  • Big Data Architect Lead

    3 days ago

    Bengaluru, Karnataka, India beBeeBigData Full time ₹ 1,04,000 - ₹ 1,30,878

    Lead Big Data EngineerYou will be responsible for translating client requirements into design, architecting and implementing big data solutions on Azure Cloud.Provide technical leadership in the areas of data engineering including data ingestion, data access, modeling, data processing, visualization, design and implementation.Lead a team to deliver high...

  • Big Data Solutions Expert

    15 hours ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    About the RoleThe Big Data Architect will be responsible for the design, implementation, and management of the organization's big data infrastructure.Design and implement scalable and efficient big data architecture solutions to meet business requirements.Develop and maintain data pipelines, ensuring the availability and quality of data.Collaborate with...

  • High-Performance Big Data Architect

    13 hours ago

    Bengaluru, Karnataka, India beBeeBigData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    About the Position: We are seeking a highly skilled Big Data Architect to design and implement large-scale data platforms on AWS. The ideal candidate will have strong expertise in Big Data technologies, cloud-native architecture, and hands-on experience building scalable, secure, and high-performance data solutions.Key Responsibilities:Create end-to-end Big...

  • AWS Big Data Engineer/Architect

    21 hours ago

    Bengaluru, Karnataka, India Coders Brain Technology Private Limited Full time

    About the Role :We are looking for an experienced AWS Big Data Engineer & Architect to design, implement, and manage large-scale data platforms on AWS. The ideal candidate will have strong expertise in Big Data technologies, cloud-native architecture, and hands-on experience building scalable, secure, and high-performance data solutions.Key Responsibilities...