Senior Big Data Architect

2 months ago


Bangalore, India Yuma Full time

Job Title: Senior Data Engineer


Job Description:


In this role, you will be responsible for designing, developing, and implementing big data solutions using various technologies. You will work closely with the architect to design secure and scalable solutions.


Key Responsibilities:



  • Design and develop batch and streaming solutions using big data technologies.
  • Work closely with the architect to design secure and scalable solutions.
  • Be responsible for assessing technologies and approaches for ingestion, transformation, and storage.
  • Develop software utilizing open-source technologies to interface with distributed and relational data sources.
  • Work closely with team members from across Mastercard to identify functional and system requirements.

Required Skills:



  • Primary: Python or Scala, Spark, Data Modeling, Hadoop platforms & tools (Hive, Impala, Airflow, NiFi, Scoop), SQL to build Big Data products & platforms.
  • Experience with SQL, Parallel Data Processing, Message Queuing & Distributed Systems.
  • Plus: Experience in Java/.net, Scala, or Python technologies.
  • Nice to have: Performance Tuning of Database Schemas, Databases, SQL, ETL Jobs, and related scripts Experience in working with Cloud (e.g., Azure, AWS).

Ideal Candidate:



  • Hand-on experience of working with Big Data / Analytics technologies like Hadoop, Spark, Python, Scala.
  • Experience working with real-time or near real-time ingestion.
  • Strong programming knowledge in Java, Scala or Python.
  • Skill at explaining technical problems succinctly and clearly.
  • Strong aptitude for problem-solving.
  • Proven track record of delivering software projects and willingness to roll up sleeves to get the job done.
  • Excellent oral and written communication skills.
  • Familiarity with Agile/Scrum methodologies.
  • Demonstrated ability to adapt to new technologies and learn quickly.
  • Ability to manage multiple priorities simultaneously.
  • Bachelor's degree in Computer Science, Information Systems or related field.

About Yuma:


Yuma is a global company with a mission to provide innovative solutions for big data challenges. We are seeking a talented Senior Data Engineer to join our team.


Contact Information:


Please submit your application through our website.



  • Bangalore, India IntraEdge Full time

    We are looking for a highly skilled Senior Big Data Developer to join our engineering team. The successful candidate will be responsible for designing, developing, and maintaining large-scale data processing systems. You will work closely with cross-functional teams to architect scalable data pipelines and provide valuable insights through advanced data...


  • Bangalore City, India IntraEdge Full time

    We are looking for a highly skilled Senior Big Data Developer to join our engineering team. The successful candidate will be responsible for designing, developing, and maintaining large-scale data processing systems. You will work closely with cross-functional teams to architect scalable data pipelines and provide valuable insights through advanced data...


  • bangalore, India IntraEdge Full time

    We are looking for a highly skilled Senior Big Data Developer to join our engineering team. The successful candidate will be responsible for designing, developing, and maintaining large-scale data processing systems. You will work closely with cross-functional teams to architect scalable data pipelines and provide valuable insights through advanced data...


  • bangalore, India IntraEdge Full time

    We are looking for a highly skilled Senior Big Data Developer to join our engineering team. The successful candidate will be responsible for designing, developing, and maintaining large-scale data processing systems. You will work closely with cross-functional teams to architect scalable data pipelines and provide valuable insights through advanced data...

  • Big Data Architect

    5 days ago


    Bangalore/Gurgaon/Gurugram/Nagpur, India Intuitive Apps Full time

    About the RoleWe are seeking an experienced Big Data Architect to join our team at Intuitive Apps. As a key member of our technical staff, you will play a crucial role in designing and implementing our Hadoop and Spark infrastructure.

  • Senior Data Engineer

    2 weeks ago


    Bangalore, India Visionyle Solutions Full time

    Title : Senior Data EngineerExperience : 6+ YearsNotice Period : Immediate to 15 Days (Serving NP candidates)Work Location - BangaloreMandatory skills : Big data applications, Spark, python, scala , AWS S3,Airflow,Data bricks, data platforms, Jenkins, CICD PipelinesRequirements :- 6+ years of experience in developing scalable Big Data applications or...

  • Big Data Developer

    4 weeks ago


    bangalore, India Advent Global Solutions Full time

    Position : Big Data Developer/Big Data Senior Developer Location : Chennai, Bangalore, Pune, Gurgaon, and Mumbai Experience : 5 to 14 years Relevant : should be 4+ yrs for Junior and 7+ yrs for Senior Primary skills : Spark, SQL,Hive Develop and maintain architectures such as databases and large-scale processing systems using Python, Scala, SQL, and Unix...

  • Big Data Developer

    4 weeks ago


    bangalore, India Advent Global Solutions Full time

    Position : Big Data Developer/Big Data Senior DeveloperLocation : Chennai, Bangalore, Pune, Gurgaon, and MumbaiExperience : 5 to 14 yearsRelevant : should be 4+ yrs for Junior and 7+ yrs for SeniorPrimary skills : Spark, SQL,HiveDevelop and maintain architectures such as databases and large-scale processing systems using Python, Scala, SQL, and Unix...

  • Big Data Developer

    3 weeks ago


    bangalore, India Advent Global Solutions Full time

    Position : Big Data Developer/Big Data Senior DeveloperLocation : Chennai, Bangalore, Pune, Gurgaon, and MumbaiExperience : 5 to 14 yearsRelevant : should be 4+ yrs for Junior and 7+ yrs for SeniorPrimary skills : Spark, SQL,HiveDevelop and maintain architectures such as databases and large-scale processing systems using Python, Scala, SQL, and Unix...

  • SLK Software

    2 weeks ago


    Bangalore, India SLK SOFTWARE Full time

    About SLK Software : SLK Software is a global technology services provider focused on bringing AI, intelligent automation, and analytics together to create leading-edge technology solutions for our customers through a culture of partnership with them, led by an evolutionary mindset. For over 20 years, we've helped organizations across diverse industries...

  • Platform Architect

    1 month ago


    Bangalore, India Talpro Full time

    Educational Qualification : - BE./ B.Tech., M./M.Tech. or M.Sc. in Computer Science from Tier 1 university Skill Set :- 10+ years of experience in end-to-end software development and system architecture, preferably in a product development organisation- Hands-on experience in Java and Big Data tech stack - Apache Pinot/Druid/Hudi, HDFS, Hive, Presto, Flume,...


  • Bangalore, India Yuma Full time

    Job Description :In this role, you will :- Design & Develop batch and streaming solutions using various Big Data technologies- Work closely with architect to design secure and scalable- Be responsible for assessing technologies and approaches for ingestion, transformation and storage- Develop software utilizing open-source technologies to interface with...


  • Bangalore, India HEVO DATA Full time

    Job Title: Data Solutions ArchitectJob Summary:We are seeking a skilled Data Solutions Architect to join our team at Hevo Data. As a Data Solutions Architect, you will be responsible for working closely with our sales team to understand customer needs and demonstrate how Hevo's platform can solve their real-time data replication needs.Key...


  • bangalore, India JRD Systems Full time

    Databricks/PySpark offshore DeveloperLooking for an offshore Lead Databricks/PySpark Developer who is willing to learn new technologies if needed and able to work with a team.Essential Job Functions:Design and development of data ingestion pipelines (Databricks background preferred).Performance tune and optimize the data bricks jobsEvaluated new features and...

  • Data architect

    4 weeks ago


    Bangalore, India HCLSoftware Full time

    Experience: 5-9 years in data architecture, in a senior position Welcome to HCL Software! We are looking for an Enterprise Data Architect to help us build, optimize, and maintain conceptual and logical data models and inter-system information flows. As a Data Architect at HCL Software, you are responsible for the holistic design of HCL...


  • Bangalore, India Talpro Full time

    Job Description : Key Responsibilities :Design and Development :- Architect, design, and develop scalable and high-performance data platforms.- Implement data ingestion, transformation, and processing pipelines using technologies such as Apache Kafka, Hadoop, Spark, and Flink.- Develop real-time data processing and stream processing applications.Data...


  • Bangalore, India Aptean Full time

    Job Description : Aptean is seeking an experienced, hands-on and outcome driven Data Architect professional to drive our data architecture initiatives and ensure the scalability, reliability, and efficiency of our data infrastructure. As a Data Architect, you will play a critical role in designing and implementing robust data architectures that support our...

  • Data Architect

    3 weeks ago


    Bangalore, India Samsung Electronics Full time

    Job Posting Title Data Architect with 10-18 years of Experience Job Description Summary 1. Contribute to business management by effectively solving business-related problems through data modeling/analysis/management. 2. Establish/support infrastructure that continuously grows to strategically analyze big data. Justification - Internal transfer ...

  • Big Data Developer

    6 months ago


    bangalore, India Impetus Full time

    Looking for #immediatejoiners preferredExperience - 2-6 yearsLocation - Gurgaon /BangaloreJob DescriptionExperience with design and coding across one or more platforms and languages (e.g. Java, Python/Spark/SQL) as appropriateHands-on expertise with application design, software development and automated testing Proficient in Big Data technologies Designs,...

  • Big Data Developer

    4 weeks ago


    bangalore, India Impetus Full time

    Looking for #immediatejoiners preferredExperience - 3-6 yearsLocation - Gurgaon /BangaloreJob DescriptionExperience with design and coding across one or more platforms and languages (e.g. Java, Python/Spark/SQL) as appropriateHands-on expertise with application design, software development and automated testing Proficient in Big Data technologies Designs,...