Big Data Solutions Architect

1 day ago

Chennai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,50,00,000
Job Description:

LUMI is a large-scale Big Data Platform designed for computationally and data-intensive processing applications.

As a cornerstone platform, it provides a challenging environment for engineers to build world-class products.

We are embarking on a journey to move to public cloud - GCP, and you will be part of a fast-paced Agile team, designing, developing, testing, troubleshooting, and optimizing solutions to simplify access to the Big Data Platform.

Key Responsibilities:

  • Designs, develops, solves problems, debugs, evaluates, modifies, deploys, and documents software and systems that meet the needs of customer-facing applications, business applications, and/or internal end-user contexts.
  • Member of an engineering or delivery and integration team reporting to an engineer manager or Engineering Director.

Technical Requirements:

  1. Implemented enterprise-grade robust data migration solutions using Java and Python, facilitating seamless data transfer from on-premises environments to GCP (including Cloud Storage and Big Query), leveraging Apache Airflow and Google Cloud Composer.
  2. Built secured and optimized data architectures on GCP by integrating services such as Cloud Storage, Pub/Sub, Dataproc.
  3. Implemented automated solutions for data delivery, monitoring, and troubleshooting.
  4. Monitored system performance and proactively optimized data pipelines for efficiency.
  5. Troubleshooted and resolved issues.
  6. Created and maintained comprehensive documentation for tools, architecture, processes, and solutions.

Required Skills & Qualifications:

Minimum Qualifications:

  • 3-5 years of developer experience.
  • Proficiency in Java, Python, and shell scripting.
  • Strong SQL knowledge.
  • Proficiency in Google Cloud Platform services especially Cloud Storage, Big Query, Dataproc, and Pub/Sub.
  • Proficiency in RDBMS like Oracle, Postgres, or MySQL and good exposure in at least one NoSQL DB like Cassandra.
  • Expertise in Git & CICD processes.
  • Experience working in Agile application development environments.

Preferred Qualifications:

  • Hands-on or exposure to DevOps best practices and implementation.
  • Hands-on or exposure to platform engineering including networking and firewall.
,

  • Big Data Solutions Architect

    6 days ago

    Chennai, Tamil Nadu, India beBeeDataEngineering Full time ₹ 9,00,000 - ₹ 12,00,000

    Job Title: Big Data Solutions Architect">About the Role:"We are seeking a highly skilled and experienced Big Data Solutions Architect to join our team. As a key member of our data engineering team, you will be responsible for designing and developing complex data solutions using Azure Data Factory, Azure Databricks, and Cosmos DB."""The ideal candidate...

  • Senior Big Data Solutions Architect

    24 hours ago

    Chennai, Tamil Nadu, India beBeeData Full time ₹ 80,00,000 - ₹ 1,50,00,000

    Big Data Solutions Architect RoleWe are seeking a seasoned Big Data Solutions Architect to join our team. The successful candidate will have a deep understanding of big data technologies and be able to design, develop, and implement scalable solutions.Key Responsibilities:Design and implement data platforms using Databricks Unified Data Analytics...

  • Big Data Architect

    1 day ago

    Chennai, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Data ArchitectWe are seeking a highly skilled Data Architect to lead the design and implementation of our data infrastructure.Key Responsibilities:Design and optimize data pipelines that integrate various data sources to support business intelligence and advanced analytics.Develop data models and data flows that enable personalized customer...

  • Data Architect

    1 day ago

    Chennai, Tamil Nadu, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Role: Data ArchitectWe are seeking an experienced Data Architect to lead the development and maintenance of our data pipelines, ETL workflows, and big data solutions across cloud environments.Design and develop robust ETL/ELT pipelines to process structured and unstructured data.Build and optimize real-time and batch data processing systems using Spark,...

  • Solutions Architect

    1 week ago

    Chennai, Tamil Nadu, India Optimum Solutions Pte Ltd Full time

    15+ years of experience with application developments, 7+ years of experience in solutioning & Architecture7+ Years Having strong knowledge in banking technology domain with at least 5+ years of experience in solutioning banking applications.Expert knowledge of multi cloud Azure, AWS & GoogleExperience of migrating and deploying cloud-based...

  • Highly Experienced Big Data Strategist

    2 days ago

    Chennai, Tamil Nadu, India beBeeBigDataArchitect Full time ₹ 15,00,000 - ₹ 25,00,000

    Senior Big Data ArchitectJob Description:We are seeking a seasoned Senior Big Data Architect to lead the design, development and deployment of industry-leading big data and AI applications. As a key member of our team, you will be responsible for providing architectural guidance that fosters the adoption of Databricks across business-facing functions.Key...

  • Itss-big Data/hadoop/splunk Developer-humjp00032202

    4 weeks ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Req ID 317271NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a ITSS-Big Data Hadoop Splunk Developer-HUMJP00032202 to join our team in chennai Tamil Nxc4x81du IN-TN India IN ...

  • Big Data Solution Architect

    17 hours ago

    Chennai, Tamil Nadu, India Cynosure Corporate Solutions Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Skills & experienceExperience in designing data solutions following Agile practices (SAFe methodology), designing for testability, deployability, and release ability; rapid prototyping, data modeling, and decentralized innovationDataOps mindset: allowing the architecture of a system to evolve continuously over time while simultaneously supporting the needs...

  • Solutions Architect

    5 days ago

    Chennai, Tamil Nadu, India Optimum Solutions Pte Ltd Full time

    15+ years of experience with application developments, 7+ years of experience in solutioning & Architecture7+ Years Having strong knowledge in banking technology domain with at least 5+ years of experience in solutioning banking applications.Expert knowledge of multi cloud Azure, AWS & Google Experience of migrating and deploying cloud-based solutions...

  • Solutions Architect

    4 days ago

    Chennai, Tamil Nadu, India Optimum Solutions Pte Ltd Full time

    15+ years of experience with application developments, 7+ years of experience in solutioning & Architecture 7+ Years Having strong knowledge in banking technology domain with at least 5+ years of experience in solutioning banking applications. Expert knowledge of multi cloud Azure, AWS & Google Experience of migrating and deploying cloud-based solutions...