Big Data Architectural Specialist

6 days ago


Bengaluru, Karnataka, India Recro Full time

We are looking for a skilled Senior Data Engineer to join our team at Recro. The ideal candidate will have a strong background in data engineering, experience with big data technologies, and a passion for building scalable and fault-tolerant systems.

About the Role

This is an exciting opportunity to take ownership of our data infrastructure and contribute to the growth and success of our organization. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems that can handle high volumes of data. You will work closely with cross-functional teams to understand business requirements and develop solutions that meet their needs.

Key Responsibilities
  • Design and develop distributed data processing systems using Apache Spark, HDFS, and other big data technologies
  • Build and maintain quality data pipelines that optimize data quality and resilience to poor quality data sources
  • Develop and refine diverse datasets to simplified models encouraging self-service
  • Own the data mapping, business logic, transformations, and data quality
  • Participate in architecture discussions and influence product roadmap
Requirements

To be successful in this role, you will need:

  • Proficiency in Python and PySpark
  • Deep understanding of Apache Spark, Spark tuning, creating RDDs, and building data frames
  • Experience with big data technologies like HDFS, YARN, Map-Reduce, Hive, Kafka, Spark, Airflow, Presto, etc.
  • 5+ years of professional experience as a data or software engineer
What We Offer

We offer a competitive salary of $140,000 - $160,000 per year, depending on experience. Additionally, we provide a comprehensive benefits package, including health insurance, 401(k) matching, and generous paid time off.



  • Bengaluru, Karnataka, India I Square Soft Full time

    About the Role: We are seeking an experienced Big Data Infrastructure Specialist to join our team at I Square Soft. In this role, you will be responsible for guiding the full lifecycle of a Hadoop solution, including requirements analysis, platform selection, and technical architecture design. Key Responsibilities: Infra design and build, testing, and...


  • Bengaluru, Karnataka, India Nielsen Full time

    Job DescriptionWe are seeking an experienced Senior Big Data Specialist to join our team at Nielsen. As a Senior Big Data Specialist, you will play a key role in analyzing, developing, testing, and supporting big data applications.Key ResponsibilitiesDesign, code, and test iteratively to support complex big data applications deployed on cloud infrastructure...


  • Bengaluru, Karnataka, India DamcoSoft Pvt Ltd Full time

    Job OverviewWe are seeking a highly skilled Data Architecture Specialist to join our team at DamcoSoft Pvt Ltd.About the RoleThe ideal candidate will have 6-11 years of experience in Big Data and be responsible for expanding and optimizing our data and data pipeline architecture.Main Responsibilities:Create and maintain optimal data pipeline architecture to...


  • Bengaluru, Karnataka, India Visionyle Solutions Full time

    Visionyle Solutions is hiring a talented Big Data Applications Specialist to join our team. As a key member of our data engineering team, you will be responsible for designing and developing scalable Big Data applications or solutions on distributed platforms.The estimated salary for this role is ₹1,200,000 - ₹2,000,000 per annum, depending on...


  • Bengaluru, Karnataka, India Powerplay Full time

    **Job Overview**We are seeking a skilled Data Architecture Specialist to join our team at Powerplay.The successful candidate will design, implement, and maintain large-scale data architectures that meet the needs of our business teams and data scientists.Key Responsibilities:Develop secure and compliant data processing pipelines for optimal extraction,...


  • Bengaluru, Karnataka, India HireVeda Full time

    Job SummaryHireVeda's Big Data Architecture Developer role involves designing and implementing scalable and secure data processing pipelines using cloud services such as Azure, Google Cloud, or AWS.As a Big Data Architecture Developer, you will work closely with cross-functional teams to assemble complex data sets that meet functional and non-functional...


  • Bengaluru, Karnataka, India Adobe Full time

    About AdobeWe are a world leader in digital experiences, empowering everyone from emerging artists to global brands. Our mission is to create exceptional employee experiences where everyone is respected and has access to equal opportunity.Job OverviewWe are seeking an experienced Big Data Architecture Lead to join our team. This role will be responsible for...

  • Big Data Leader

    4 weeks ago


    Bengaluru, Karnataka, India Databricks Full time

    About the RoleAs a key member of our team at Databricks, you will have the opportunity to lead a team of specialist solutions architects in the data and AI domain. This role is ideal for someone with experience in big data architecture, scaling and mentoring field and technical teams, and passionate about data-driven decisions, AI, and cloud software models.


  • Bengaluru, Karnataka, India DamcoSoft Pvt Ltd Full time

    **Job Description:**We are seeking a highly skilled Data Architecture Specialist to join our team at DamcoSoft Pvt Ltd in Bangalore. As a key member of our data engineering team, you will be responsible for designing and implementing optimal data pipeline architecture.**Responsibilities:Create and maintain scalable data pipeline architecture.Assemble large...


  • Bengaluru, Karnataka, India BlackLine Full time

    Job SummaryWe are seeking a highly skilled Data Platform Engineer & Platform Architect to join our dynamic team. As a Data Architecture Specialist, you will design, implement, and optimize comprehensive data warehousing solutions on the cloud, maintain robust data systems, and craft and optimize a versatile platform that empowers our organization to operate...


  • Bengaluru, Karnataka, India EXIMIETAS DESIGN PRIVATE LIMITED Full time

    About Eximietas Design Private LimitedWe are a leading design firm seeking a highly skilled Senior Big Data Specialist to join our team.The ideal candidate will have expertise in big data engineering, specifically focused on designing, building, and managing large-scale data systems. Strong development experience with Java and familiarity with scripting...


  • Bengaluru, Karnataka, India big basket Full time

    Job DescriptionAs a Product Analytics Specialist at Big Basket, you will be responsible for analyzing complex data to inform business decisions and drive growth. This is an exciting opportunity to join a fast-paced, data-driven environment and make a meaningful impact on the business.Data Analysis & InsightsAnalyze large datasets to identify emerging...


  • Bengaluru, Karnataka, India Synechron Full time

    About the RoleWe are seeking an experienced Informatica Big Data Management Specialist to join our team in Bangalore, India. This is a fantastic opportunity for individuals with strong technical skills and experience in data management.Job OverviewThe successful candidate will be responsible for designing, building, testing, and implementing security...


  • Bengaluru, Karnataka, India Databricks Full time

    About the Role:We are seeking a highly skilled Big Data Analytics Solutions Specialist to join our team at Databricks. As a key member of our sales engineering group, you will work closely with clients to provide technical and business value through hands-on evaluation and programming.The Impact You Will Have:Establish strong relationships with clients...


  • Bengaluru, Karnataka, India TekPillar Full time

    Job Title: Big Data Transformation SpecialistAbout the RoleWe are seeking a highly skilled Big Data Transformation Specialist to join our team at TekPillar. As a key member of our data engineering team, you will be responsible for designing, developing, and implementing large-scale data pipelines using Hadoop, Hive, Spark, and other big data tools.About...


  • Bengaluru, Karnataka, India Creencia Technologies Pvt Ltd Full time

    Job Title: Senior Big Data SpecialistAbout the Role: We are seeking an experienced Senior Big Data Specialist to join our team at Creencia Technologies Pvt Ltd. The ideal candidate will have a strong background in designing and developing scalable data pipelines using Scala programming, Java, GCP, and Spark.Key Responsibilities: Design, develop, and maintain...


  • Bengaluru, Karnataka, India Recro Full time

    We are seeking a highly skilled Big Data Infrastructure Specialist to join our team at Recro. As a specialist in data engineering, you will be responsible for designing, developing, and implementing robust data architectures that collect and connect data from diverse sources.Key Responsibilities:Lead the design and implementation of scalable data engineering...


  • Bengaluru, Karnataka, India myGwork Full time

    About the RoleAs a WWGS Data & Analytics Big Data Analytics Specialist, you will play a key role in shaping our analytics capabilities. Our team of experts delivers constantly evolving technology and analytic solutions that enable fact-based decision making across WWGS Data & Analytics.### Key Responsibilities- Design and implement next-generation data...


  • Bengaluru, Karnataka, India Synechron Full time

    We are looking for a seasoned Informatica Big Data Management specialist to join our team at Synechron in Bangalore. The ideal candidate should have extensive experience working with SQL and NoSQL databases, as well as Linux OS configuration and use.Key Responsibilities:Design, build, test, and implement security systemsIdentify security design gaps in...


  • Bengaluru, Karnataka, India EduRun Full time

    EduRun is a leading education technology company that is seeking a skilled Big Data Processing Specialist. The successful candidate will have experience with Java programming, big data frameworks, and data analysis tools.The key responsibilities of this role include designing, developing, and maintaining high-performance Java applications, utilizing big data...