Big Data Technology Architect

2 days ago

Hubli, Karnataka, India beBeeDataPlatform Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

About the Job

We are seeking a skilled Data Platform Leader to drive the development of our Enterprise TruRisk Platform. The successful candidate will be responsible for delivering roadmap features, collaborating with engineers and architects, and providing technical leadership on data platform design.

Job Responsibilities:

  • Lead the thought process in data platform and pipeline architecture along with risk evaluation.
  • Provide technical expertise to the engineering organization on data platform design, roll-out, and evolution.
  • Liaise with product teams, professional services, and sales engineers on solution reviews and represent engineering in such conversations.
  • Drive technology explorations and roadmaps.
  • Serve as a technical lead on cross-functional departments.
  • Ensure the quality of system architecture and design.
  • Fully understand system interdependencies and limitations.
  • Possess expert knowledge in performance, scalability, enterprise system architecture, and engineering best practices.

Requirements:

  • Bachelor's degree in computer science or equivalent.
  • 8+ years of total experience.
  • 4+ years of relevant experience in design and architecture of Big Data solutions using Spark.
  • 3+ years of experience working with engineering resources for innovation.
  • 4+ years of experience understanding Big Data events flow pipeline.
  • 3+ years of experience in performance testing for large infrastructure.
  • In-depth experience in various search solutions, solr/elastic.
  • In-depth experience in Kafka.
  • In-depth experience in Data lakes and related ecosystems.
  • In-depth experience in message queues.
  • In-depth experience in giving requirements for scalable architectures in Big Data and Micro-services environments.
  • In-depth understanding of caching components or services.
  • Knowledge in Presto technology.
  • Knowledge in Airflow.
  • Hands-on experience in scripting and automation.
  • In-depth understanding of RDBMS/NoSQL, Oracle, Cassandra, Kafka, Redis, Hadoop, lambda architecture, kappa, kappa++ architectures with Flink data streaming and rule engines.
  • Experience in working with ML models engineering and related deployment.
  • Design and implement secure big data clusters to meet compliance and regulatory requirements.
  • Experience in leading the delivery of large-scale systems focused on managing infrastructure layer of technology stack.
  • Strong experience in performance benchmarking testing for Big data technologies.
  • Strong troubleshooting skills.
  • Experience leading development life cycle process and best practices.
  • Experience in Big Data services administration would be an added value.
  • Experience with Agile Management (SCRUM, RUP, XP), OO Modeling, working on internet, UNIX, Middleware, and database related projects.
  • Experience mentoring/training the engineering community on complex technical issues.
  • Project management experience.

  • Big Data Specialist

    3 days ago

    Hubli, Karnataka, India beBeeData Full time ₹ 18,00,000 - ₹ 25,00,000

    Big Data Engineer - Job OpportunityWe are seeking a highly skilled professional with expertise in Big Data technologies and AWS Cloud Services. The ideal candidate will bring strong hands-on experience in designing, architecting, and implementing scalable data engineering solutions while driving innovation within the team.Design, develop, and optimize Big...

  • Senior Big Data Architect

    6 days ago

    Hubli, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,20,00,000

    Big Data Systems DeveloperWe are seeking a skilled Data Engineer II to join our team. This role is crucial in designing and executing large-scale distributed data systems.The ideal candidate should have 2 to 4 years of experience in big data technologies, such as Apache Hadoop, and relational databases, including MS SQL Server, Oracle, MySQL, and...

  • Senior Big Data Architect

    4 days ago

    Hubli, Karnataka, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Big Data Engineer PositionJob Summary:We are seeking a highly skilled Big Data Engineer to design and implement scalable data transformation pipelines using Snowflake and dbt, following industry-accepted best practices.Key Responsibilities:Data Pipeline Development: Design and implement robust ELT pipelines using dbt on Snowflake, ensuring scalability and...

  • Big Data Developer

    1 day ago

    Hubli, Karnataka, India Tech Consulting Full time

    Position Overview:We are seeking a skilled Big Data Developer to join our growing delivery team, with a dual focus on hands-on project support and mentoring junior engineers.This role is ideal for a developer who not only thrives in a technical, fast-paced environment but is also passionate about coaching and developing the next generation of talent.You will...

  • Cloud Architect

    6 days ago

    Hubli, Karnataka, India beBeeDataScientist Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Description:We are looking for skilled and passionate experts to join our team at Bengaluru. This is a full-time hybrid role offering flexibility for remote work.Key Responsibilities:Design Big Data architecture, cloud adoption strategies, and solutions.Migrate on-premises applications and databases to the cloud.Ensure data governance and applicative...

  • Cloud Data Architect

    3 days ago

    Hubli, Karnataka, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Job Title: Cloud Data ArchitectAbout the Role:As a Cloud Data Architect, you will be responsible for designing and implementing scalable data solutions on cloud platforms.Design and implement data pipelines, warehouses, and data lakes.Work on data modeling, ETL/ELT processes, and performance tuning.Collaborate with business and technical teams to deliver...

  • Big Data Specialist

    6 days ago

    Hubli, Karnataka, India beBeeDataScientist Full time ₹ 60,00,000 - ₹ 1,20,00,000

    Job OverviewThe role involves working with large-scale data sets utilizing Big Data tools and technologies. We are looking for a skilled professional to join our team as a Data Scientist.Key Responsibilities:Develop, tweak queries, and work on performance enhancement using Scala, Spark, Hive, and Hadoop Big Data Eco System Tools.Apply SQL experience to...

  • Big Data Solutions Architect

    2 weeks ago

    Hubli, Karnataka, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    About the RoleA highly skilled Big Data Engineer is required to lead a team of big data engineers. This individual will work closely with clients and team members to understand their requirements and develop architectures that meet their needs.Key Responsibilities:Support the Data Engineering team in setting up the Data Lake on Cloud and implementing...

  • Cloud Data Architect

    1 week ago

    Hubli, Karnataka, India beBeeData Full time ₹ 1,20,00,000 - ₹ 1,50,00,000

    Job Title: Cloud Data ArchitectKey Responsibilities:Design and implement scalable data ingestion, processing, and storage solutions using AWS Glue.Develop serverless architectures to support real-time data transformation and integration.Create metadata-driven integration for rapid onboarding of new systems and data sources.Implement a true DataOps approach...

  • Senior Big Data Engineer

    3 days ago

    Hubli, Karnataka, India beBeeData Full time US$ 1,00,000 - US$ 2,00,000

    Big Data ExpertOur client is seeking an experienced Big Data expert to join their team. The ideal candidate will have extensive knowledge of Big Data technologies and Google Cloud Platform services.Design, develop and optimize data pipelines using GCP BigQuery Dataflow and Apache Airflow to support large-scale data analytics.Utilize the Big Data Hadoop...