
Big Data Architect
14 hours ago
We are seeking a skilled data architect to design and develop large-scale big data pipelines using Scala, Spark, and Python.
The ideal candidate will have experience in designing distributed data systems and cloud-based solutions with expertise in Apache Kafka, NiFi, and Jupyter Notebooks.
Key Responsibilities:
- Design, implement, and optimize big data pipelines using Spark, Scala, and Python.
- Develop streaming solutions using Apache Kafka and orchestration tools like NiFi / Airflow.
- Write efficient queries and perform data analysis using Jupyter Notebooks and SQL.
- Collaborate with cross-functional teams to design scalable cloud-based data architectures.
- Ensure delivery of high-quality code through code reviews, performance tuning, and best practices.
Mandatory Skills:
- Scala – Minimum 3+ years of hands-on experience.
- Strong expertise in Spark (PySpark) and Python programming.
- Hands-on experience with Apache Kafka for real-time data processing.
- Knowledge of NiFi / Airflow for workflow automation.
- Strong experience in Distributed Data Systems (5+ years).
- Proficiency in SQL and query optimization techniques.
- Good understanding of Cloud Architecture principles.
Preferred Skills:
- Familiarity with messaging technologies like Apache Kafka or equivalent.
- Experience in designing intuitive UIs for data analytics visualization.
- Familiarity with monitoring/alerting solutions like Splunk or equivalent.
- Hands-on experience with CI/CD tools like Git and Jenkins.
-
Chief Big Data Architect
2 weeks ago
Mangalore, Karnataka, India beBeeDataEngineering Full time ₹ 1,80,00,000 - ₹ 2,40,00,000Big Data Engineering Leadership OpportunityWe are seeking an experienced and strategic leader with deep expertise in Big Data platforms and cloud-native environments to lead a team of data engineers.Job Summary:About the Role:This role involves leading a team of data engineers working on large-scale distributed data systems, architecting and overseeing the...
-
Big Data Cluster Architect
1 week ago
Mangalore, Karnataka, India beBeeCluster Full time ₹ 18,00,000 - ₹ 25,20,000As a Big Data Cluster Architect, you will be responsible for designing and implementing high-performance computing systems to support large-scale data processing and analysis.Key Responsibilities:Develop and maintain complex data pipelinesMigrate data between systems while ensuring minimal downtimePerform regular performance tuning and optimization...
-
Expert Big Data Architect
2 days ago
Mangalore, Karnataka, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000Job Title: Data EngineerWe are looking for a skilled data engineer to design, develop, and maintain large-scale data systems. The ideal candidate will have hands-on experience with big data tools, data pipelines, and cloud services.ResponsibilitiesCreate and maintain optimal data pipeline architectureCreate and maintain events/streaming based...
-
Enterprise Big Data Architect
14 hours ago
Mangalore, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Big Data Engineer Job DescriptionWe are seeking a highly skilled data engineer to join our team.Key Responsibilities:Design and develop robust big data pipelines using Python, SQL, PySpark, and bash scripts.Develop and maintain cloud-based data warehousing solutions using Redshift, Snowflake, Databricks SQL, or equivalent platforms.Collaborate with...
-
Chief Big Data Architect
1 week ago
Mangalore, Karnataka, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000Job TitleWe are seeking a visionary leader to spearhead the development of our big data platform. This individual will be responsible for creating a highly-scalable and extensible infrastructure that collects, stores, models, and analyzes massive data sets from multiple channels.About the RoleBuild and lead a high-performing team of engineers and data...
-
Big Data Specialist
3 days ago
Mangalore, Karnataka, India beBeeData Full time ₹ 12,00,000 - ₹ 20,10,000Job Title:Azure Data EngineerDescription:We are seeking an expert Data Engineer with proficient knowledge in Spark and SQL to join our dynamic team.The ideal candidate will be responsible for designing, implementing, and optimizing data pipelines on our Data platform. You will work closely with data architects and other stakeholders to ensure data...
-
Big Data Leader Wanted
18 hours ago
Mangalore, Karnataka, India beBeeDataLeader Full time ₹ 20,40,560 - ₹ 32,10,936Big Data Leader WantedRole Overview:As a highly skilled Big Data Engineer, you will be responsible for leading the development and implementation of large-scale data processing systems. Your expertise in design and architecture of Big Data solutions using Spark will be crucial in delivering roadmap features of our Enterprise TruRisk Platform.Working closely...
-
Data Solutions Architect
2 weeks ago
Mangalore, Karnataka, India beBeeBigData Full time ₹ 15,00,000 - ₹ 22,00,000Job DescriptionWe are seeking a skilled Data Solutions Architect to join our team. As a Senior Consultant, you will utilize your technical expertise in designing and implementing solutions involving data models, database planning, and security.Your experience with big data technologies, including Power BI, Databricks, and Spark, is crucial for this role.Main...
-
Innovative Data Architect Role
6 days ago
Mangalore, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Senior Data Architect OpportunityWe are seeking a skilled Senior Data Architect to design and implement innovative solutions involving data models, databases, and big data technologies.Key Responsibilities:Designing robust data models for efficient database performancePlanning databases to meet business requirementsEnsuring data security through...
-
Big Data Professional
2 days ago
Mangalore, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000Job Opportunity: Big Data DeveloperSeeking a skilled data professional to drive strategic growth through innovative big data solutions.Key Responsibilities:Proven expertise in developing and implementing big data applications using Java, Scala, and Apache Spark Frameworks.Proficient in Unix File system and HDFS commands, with experience working with query...