Big Data Solutions Architect

3 days ago

Chennai, Tamil Nadu, India beBeeSoftware Full time ₹ 15,00,000 - ₹ 25,00,000
Job Title:

We are seeking an expert Data Engineer to lead the development of our Big Data solutions. The ideal candidate will have a strong background in distributed systems, cloud platforms, and big data technologies.

Job Description:

The successful candidate will be responsible for designing and implementing end-to-end Big Data solutions using Apache Spark and Python. They will work closely with cross-functional teams to develop, optimize, and maintain big data pipelines.

Key Responsibilities:

  • Develop and optimize big data pipelines using Apache Spark and Python.
  • Implement distributed computing solutions and large-scale data processing.
  • Build and maintain stream-processing systems using Spark Streaming or Apache Storm.
  • Integrate data from diverse sources including RDBMS (SQL Server, Oracle), ERP systems, and file-based sources.
  • Work with messaging systems like Kafka or RabbitMQ.
  • Develop and optimize SQL queries, stored procedures, and database schemas.
  • Utilize NoSQL databases such as HBase, Cassandra, and MongoDB.
  • Perform performance tuning of Spark jobs and queries.
  • Use cloud-native services (AWS, GCP, or Azure Databricks) for scalable data solutions.
  • Design and implement end-to-end Big Data solutions in agile environments.
  • Provide technical leadership and mentor junior engineers.

Required Skills & Experience:

The ideal candidate will have at least 5 years of experience in Big Data & related technologies, with expertise in Apache Spark, Python programming, and cloud experience with at least one of AWS, Azure Databricks, or GCP.

Preferred Qualifications:

The successful candidate will have strong analytical and problem-solving skills, with ability to lead teams and manage stakeholders.

Tech Stack Expertise:

Technology Experience Required

Python 5+ Years

Apache Spark 5+ Years

AWS / Azure / GCP 3+ Years

PySpark 3+ Years

Apache Kafka 3+ Years

NoSQL (HBase, MongoDB, Cassandra) Relevant Experience

],

  • Senior Big Data Solutions Architect

    1 week ago

    Chennai, Tamil Nadu, India beBeeData Full time ₹ 80,00,000 - ₹ 1,50,00,000

    Big Data Solutions Architect RoleWe are seeking a seasoned Big Data Solutions Architect to join our team. The successful candidate will have a deep understanding of big data technologies and be able to design, develop, and implement scalable solutions.Key Responsibilities:Design and implement data platforms using Databricks Unified Data Analytics...

  • Big Data Architect

    3 days ago

    Chennai, Tamil Nadu, India beBeeData Full time ₹ 1,04,000 - ₹ 1,30,878

    Job Title: Big Data ArchitectDescriptionWe are seeking a skilled Big Data Architect to design and implement scalable data processing systems. The ideal candidate will have a strong background in big data technologies and experience working with large datasets.Key Responsibilities:Liaise with cross-functional teams to understand business requirements and...

  • Data Architect

    5 days ago

    Chennai, Tamil Nadu, India Wavicle Data Solutions Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Job Title: Data Architect – AWS & GCP Experience: 11 Years Location: Remote / Hybrid Job Type: Full-timeAbout the Role:We are seeking an experienced Data Architect with deep expertise in AWS and Google Cloud Platform (GCP). The ideal candidate will have a proven track record in designing and implementing scalable, secure, and high-performance data...

  • Big Data Solutions Architect

    1 week ago

    Chennai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Job Description:LUMI is a large-scale Big Data Platform designed for computationally and data-intensive processing applications.As a cornerstone platform, it provides a challenging environment for engineers to build world-class products.We are embarking on a journey to move to public cloud - GCP, and you will be part of a fast-paced Agile team, designing,...

  • Big Data Governance Solutions Architect

    1 day ago

    Chennai, Tamil Nadu, India beBeeDataGovernance Full time ₹ 8,00,000 - ₹ 12,00,000

    Job Title: Data Governance Expert">Overview">The ideal candidate will design, architect, deploy, and maintain big data-based data governance solutions.">Key Responsibilities:">">Design and implement large cloud-computing infrastructure solutions in Azure/AWS/GCP environments;">Develop and manage data quality, governance, and metadata management solutions,...

  • Big Data Architect

    3 days ago

    Chennai, Tamil Nadu, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Big Data ArchitectData Engineering RoleWe are seeking an experienced professional to fill our Big Data Architecture position. As a key member of our team, you will be responsible for designing and developing cutting-edge data solutions that drive business growth.This role involves the development and implementation of large-scale data...

  • Big Data Architect

    1 week ago

    Chennai, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Data ArchitectWe are seeking a highly skilled Data Architect to lead the design and implementation of our data infrastructure.Key Responsibilities:Design and optimize data pipelines that integrate various data sources to support business intelligence and advanced analytics.Develop data models and data flows that enable personalized customer...

  • Senior Big Data Architect

    4 days ago

    Chennai, Tamil Nadu, India beBeeDeveloper Full time ₹ 15,00,000 - ₹ 28,00,000

    Big Data Developer Job DescriptionAs a Big Data Developer, you will be responsible for building and maintaining complex data systems. Your primary focus will be on designing, developing, and testing big data ecosystem components and solutions.Key Responsibilities:Design and Develop: Create robust and scalable big data frameworks and features for business...

  • Data Solutions Architect

    1 week ago

    Chennai, Tamil Nadu, India beBeeCloud Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Cloud Data Solutions ArchitectWe are seeking a seasoned Cloud Data Solutions Architect to design and deliver scalable, distributed cloud-based enterprise data solutions.This role involves end-to-end implementation of cloud data engineering solutions, including Enterprise Data Lake and Data Hub in AWS. Key responsibilities include:Designing and...

  • Big Data Solutions Leader

    1 week ago

    Chennai, Tamil Nadu, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Big Data Engineer Leader Position">We are looking for an experienced and skilled big data engineer leader to lead the design, development, and deployment of scalable big data solutions. The ideal candidate will work closely with cross-functional teams to deliver high-quality data processing pipelines and analytics platforms.">Job Description">The successful...