Expert Big Data Architect

23 hours ago

Mangalore, Karnataka, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

Job Title: Data Engineer

We are looking for a skilled data engineer to design, develop, and maintain large-scale data systems. The ideal candidate will have hands-on experience with big data tools, data pipelines, and cloud services.

Responsibilities
  • Create and maintain optimal data pipeline architecture
  • Create and maintain events/streaming based architecture/design
  • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
  • Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS 'big data' technologies.
  • Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.
Requirements
  • Proficiency in either Scalar or Python, expertise in Spark, and experience with performance tuning and optimization. DBT is also Mandatory.
  • Experience with big data tools: HDFS/S3, Spark/Flink,Hive,Hbase, Kafka/Kinesis, etc.
  • Experience with relational SQL and NoSQL databases, including Elasticsearch and Cassandra/Mongodb.
  • Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
  • Experience with AWS /GCP cloud services
  • Experience with stream-processing systems: Spark-Streaming/Flink etc.
  • Experience with object-oriented/object function scripting languages: Java, Scala, etc.
  • Experience building and optimizing 'big data' data pipelines, architectures and data sets.
  • Strong analytic skills related to working with structured/unstructured datasets.
Bonus Points
  • Have a few weekend side projects up on GitHub
  • Have contributed to an open-source project
  • Have worked at a product company
  • Have a working knowledge of a backend programming language

Note: Candidate should be really good in either Scala OR Python (not necessarily both).

  • Chief Big Data Architect

    1 week ago

    Mangalore, Karnataka, India beBeeDataEngineering Full time ₹ 1,80,00,000 - ₹ 2,40,00,000

    Big Data Engineering Leadership OpportunityWe are seeking an experienced and strategic leader with deep expertise in Big Data platforms and cloud-native environments to lead a team of data engineers.Job Summary:About the Role:This role involves leading a team of data engineers working on large-scale distributed data systems, architecting and overseeing the...

  • Big Data Cluster Architect

    7 days ago

    Mangalore, Karnataka, India beBeeCluster Full time ₹ 18,00,000 - ₹ 25,20,000

    As a Big Data Cluster Architect, you will be responsible for designing and implementing high-performance computing systems to support large-scale data processing and analysis.Key Responsibilities:Develop and maintain complex data pipelinesMigrate data between systems while ensuring minimal downtimePerform regular performance tuning and optimization...

  • Big Data Specialist

    2 days ago

    Mangalore, Karnataka, India beBeeData Full time ₹ 12,00,000 - ₹ 20,10,000

    Job Title:Azure Data EngineerDescription:We are seeking an expert Data Engineer with proficient knowledge in Spark and SQL to join our dynamic team.The ideal candidate will be responsible for designing, implementing, and optimizing data pipelines on our Data platform. You will work closely with data architects and other stakeholders to ensure data...

  • Chief Big Data Architect

    1 week ago

    Mangalore, Karnataka, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job TitleWe are seeking a visionary leader to spearhead the development of our big data platform. This individual will be responsible for creating a highly-scalable and extensible infrastructure that collects, stores, models, and analyzes massive data sets from multiple channels.About the RoleBuild and lead a high-performing team of engineers and data...

  • High-Level Data Architect

    1 day ago

    Mangalore, Karnataka, India beBeeData Full time ₹ 18,96,000 - ₹ 25,20,000

    We are seeking an accomplished High-Level Data Architect to spearhead the development and optimization of our enterprise-grade data platforms.This is a challenging role that requires expertise in building and scaling complex data ecosystems.The ideal candidate will have a strong background in ETL, Cloud, Data Warehousing, and Big Data technologies, as well...

  • Data Solutions Architect

    2 weeks ago

    Mangalore, Karnataka, India beBeeBigData Full time ₹ 15,00,000 - ₹ 22,00,000

    Job DescriptionWe are seeking a skilled Data Solutions Architect to join our team. As a Senior Consultant, you will utilize your technical expertise in designing and implementing solutions involving data models, database planning, and security.Your experience with big data technologies, including Power BI, Databricks, and Spark, is crucial for this role.Main...

  • Innovative Data Architect Role

    5 days ago

    Mangalore, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Senior Data Architect OpportunityWe are seeking a skilled Senior Data Architect to design and implement innovative solutions involving data models, databases, and big data technologies.Key Responsibilities:Designing robust data models for efficient database performancePlanning databases to meet business requirementsEnsuring data security through...

  • Big Data Professional

    1 day ago

    Mangalore, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Opportunity: Big Data DeveloperSeeking a skilled data professional to drive strategic growth through innovative big data solutions.Key Responsibilities:Proven expertise in developing and implementing big data applications using Java, Scala, and Apache Spark Frameworks.Proficient in Unix File system and HDFS commands, with experience working with query...

  • Big Data Solutions Specialist

    17 hours ago

    Mangalore, Karnataka, India beBeeDataScientist Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    About our organization:We are a professional software services provider offering high-quality, cost-effective solutions to businesses.Utilizing best-of-breed technologies and flexible engagement models, we have helped meet the IT requirements of companies ranging from those among the Fortune 100 to medium-sized firms.We employ highly talented professionals...

  • Chief Data Architect

    1 day ago

    Mangalore, Karnataka, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 40,00,000

    Job Title: Data Engineering DirectorWe are seeking a skilled professional to lead our data engineering efforts. The ideal candidate will have strong expertise in SQL, big data processing, and modern data platforms.Key Responsibilities:Develop and continuously improve the data practice by driving initiatives and collaborating with stakeholders.Design, build,...