Big Data Architect

1 day ago

Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 25,00,000
Job Title: Big Data Engineer

We are seeking a skilled professional to lead the development and optimization of large-scale data pipelines and distributed data processing systems.

The ideal candidate will have a strong track record in designing, building, and scaling big data architectures, as well as hands-on experience with cloud-based solutions.

Key Responsibilities:

  • Design, develop, and optimize large-scale data pipelines and distributed data processing systems.
  • Work extensively with Scala, Spark (PySpark), and Python for data processing and transformation.
  • Develop and integrate streaming solutions using Apache Kafka and orchestration tools like NiFi / Airflow.
  • Write efficient queries and perform data analysis using Jupyter Notebooks and SQL.
  • Collaborate with cross-functional teams to design scalable cloud-based data architectures.
  • Ensure delivery of high-quality code through code reviews, performance tuning, and best practices.
  • Build monitoring and alerting systems leveraging Splunk or equivalent tools.
  • Participate in CI/CD workflows using Git, Jenkins, and other DevOps tools.
  • Contribute to product development with a focus on scalability, maintainability, and performance.

Mandatory Skills:

  • Scala – Minimum 3+ years of hands-on experience.
  • Strong expertise in Spark (PySpark) and Python.
  • Hands-on experience with Apache Kafka.
  • Knowledge of NiFi / Airflow for orchestration.
  • Strong experience in Distributed Data Systems (5+ years).
  • Proficiency in SQL and query optimization.
  • Good understanding of Cloud Architecture.

Benefits:

This role offers opportunities for growth and professional development, working with cutting-edge technologies and innovative solutions. The ideal candidate will be part of a collaborative team environment that values knowledge-sharing, open communication, and continuous learning.

Requirements:

  • Big Data Architect

    3 days ago

    Bengaluru, Karnataka, India EdgeVerve Full time

    Job Tittle- Big Data ArchitectLocation - Bangalore/ PuneExperience: 10Yrs to 16 YearsExperienced profile with strong integration data architecture, data modeling, database design, proficient in SQL and familiar with at least one cloud platforms. Good understanding of data integration and management tools (MuleSoft/IBM Sterling Integrator/Talend/Informatica.)...

  • Big Data Architect

    2 weeks ago

    Bengaluru, Karnataka, India EdgeVerve Full time

    Job Tittle- Big Data Architect Location - Bangalore/ Pune Experience: 10Yrs to 16 Years Experienced profile with strong integration data architecture, data modeling, database design, proficient in SQL and familiar with at least one cloud platforms. Good understanding of data integration and management tools (MuleSoft/IBM Sterling...

  • Big Data Solutions Architect

    3 days ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Key Role: Big Data Solutions ArchitectThis position is responsible for designing and implementing scalable data pipelines and ETL processes.Main Responsibilities:Architect, optimize big data and analytics solutions using Spark, Delta Lake, and MLflow technologies.Collaborate with stakeholders to translate business requirements into technical solutions that...

  • Big Data Architect Lead

    2 days ago

    Bengaluru, Karnataka, India beBeeBigData Full time ₹ 1,04,000 - ₹ 1,30,878

    Lead Big Data EngineerYou will be responsible for translating client requirements into design, architecting and implementing big data solutions on Azure Cloud.Provide technical leadership in the areas of data engineering including data ingestion, data access, modeling, data processing, visualization, design and implementation.Lead a team to deliver high...

  • Senior Big Data Architect

    2 days ago

    Bengaluru, Karnataka, India beBeeDataArchitect Full time ₹ 25,00,000 - ₹ 35,00,000

    Job SummaryWe are seeking a highly skilled Senior Big Data Architect to design and implement large-scale data architectures that drive business growth and innovation. The ideal candidate will have extensive experience in big data technologies, including data warehousing, ETL, and data visualization.Key ResponsibilitiesDesign and implement scalable data...

  • Data Architect

    19 hours ago

    Bengaluru, Karnataka, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Data Engineering and ArchitectureWe are seeking a highly skilled Data Engineer to develop and maintain our core data framework and key infrastructures. Create and support ETL pipelines to get data flowing correctly from existing and new sources to our data warehouse.Design and model data warehouses for efficient and cost-effective reporting.Collaborate with...

  • Big Data Architect

    2 days ago

    Bengaluru, Karnataka, India Harman Full time

    We re a global multi-disciplinary team that s putting the innovative power of technology to work and transforming tomorrow At HARMAN HTS you solve challenges by creating innovative solutions Combine the physical and digital making technology a more dynamic force to solve challenges and serve humanity s needs Empower the company to create new digital...

  • Big Data Architect

    10 hours ago

    Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Are you looking for a challenging opportunity to build scalable data pipelines? Do you have experience with big data technologies and want to contribute to a dynamic team?About the RoleWe are seeking an experienced EDH Data Engineer to join our team. As an EDH Data Engineer, you will be responsible for designing and implementing robust and scalable data...

  • Chief Big Data Strategist

    4 days ago

    Bengaluru, Karnataka, India beBeeDataLeader Full time

    Big Data LeaderThis role offers an exciting opportunity to lead a team of technical professionals in the design, development, and implementation of big data solutions and data analytics projects within the financial services domain.Key Responsibilities:Provide technical expertise and guidance on the selection, hands-on implementation, and optimization of big...

  • Big Data Specialist

    3 days ago

    Bengaluru, Karnataka, India beBeeData Full time US$ 1,20,000 - US$ 2,00,000

    Senior Data Solutions ArchitectWe're seeking an experienced data solutions architect to lead the design and development of scalable data architectures, pipelines and workflows for large volumes of structured and unstructured data.About the Role:This is a key leadership position that requires strong technical expertise in data engineering, cloud computing and...