Senior Large Scale Data Architect

1 day ago

Alwar, Rajasthan, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000
Job Title: Data Engineer

We are seeking a skilled professional to occupy the role of Data Engineer and join our organization. The ideal candidate will have 2+ years of experience in designing, developing, and maintaining large-scale data pipelines and architectures.

The successful candidate will be responsible for creating and maintaining optimal data pipeline architecture, building the infrastructure required for extracting, transforming, and loading data from various sources, and collaborating with data scientists to improve data systems.

Required Skills and Qualifications:

  • Proficiency in either Scala or Python, with expertise in Apache Spark.
  • Experience with big data tools such as HDFS/S3, Spark/Flink, Hive, Hbase, Kafka/Kinesis, etc.
  • Experience with relational SQL and NoSQL databases, including Elasticsearch and Cassandra/Mongodb.
  • Experience with data pipeline and workflow management tools such as Azkaban, Luigi, Airflow, etc.
  • Experience with cloud services such as AWS/GCP.
  • Strong hands-on expertise in Apache Spark, with the ability to write Spark jobs and optimize them for better performance.
  • Able to handle large datasets efficiently and optimize Spark jobs (partitions, shuffles, caching, memory usage, etc.).

Additional Requirements:

  • Experience with object-oriented/object function scripting languages such as Java, Scala, etc.
  • Working knowledge of message queuing, stream processing, and highly scalable 'big data' data stores.
  • Experience supporting and working with cross-functional teams in a dynamic environment.
  • Have a few weekend side projects up on GitHub, or have contributed to an open-source project.
  • Have worked at a product company.
  • Have a working knowledge of a backend programming language.

  • Junior Architect

    3 days ago

    Alwar, Rajasthan, India beBeeArchitecture Full time ₹ 8,00,000 - ₹ 12,00,000

    We are seeking a junior architect with 1-2 years of experience to work on large-scale projects.At our studio, we offer a dynamic design team and the opportunity to build a successful architectural career.You will be working on cutting-edge, large-scale architectural and landscape projects that shape dynamic spaces, including corporate campuses and other...

  • Large Scale Data Pipeline Leader

    2 weeks ago

    Alwar, Rajasthan, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    **Job Title:** Senior Data EngineerWe are seeking a highly skilled data engineer to lead the design, development and maintenance of large-scale data pipelines. As a senior data engineer, you will be responsible for developing and maintaining efficient ETL pipelines that meet client needs.**Key Responsibilities:• Develop and Maintain ETL Pipelines: Utilize...

  • Senior Data Engineer

    2 weeks ago

    Alwar, Rajasthan, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Large Scale Data Engineering SolutionsJob Description:The successful candidate will have the opportunity to work with clients to design, develop, and maintain large scale data engineering solutions.Responsibilities:Design, develop, and maintain large scale data engineering solutionsWork closely with client stakeholders to capture requirements, design, and...

  • Optimize Large-Scale Data Systems Specialist

    2 days ago

    Alwar, Rajasthan, India beBeeData Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    Job Title:A Data Systems Specialist is needed to create and maintain large-scale data systems.

  • Large Scale Database Expert

    3 days ago

    Alwar, Rajasthan, India beBeeDatabase Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title:Senior Database AdministratorOverview:As a key member of our team, you will be responsible for designing, implementing, and maintaining large-scale database systems. Your primary goal will be to ensure the efficient operation and scalability of our databases.Responsibilities:Design and implement large-scale database systems using MongoDB,...

  • Senior Data Scientist

    1 week ago

    Alwar, Rajasthan, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Big Data Engineer Job OpportunityWelcome to our job opening for a Big Data Engineer. As a key member of our team, you will be responsible for designing and developing large-scale data processing systems.Key Responsibilities:Design and develop big data architectures using PySpark and HiveWork with good-to-have skills such as Spark, HBase, DQ tools, and Agile...

  • Migration Expert

    4 days ago

    Alwar, Rajasthan, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,55,00,000

    Job TitleAzure Data Engineer OpportunityAbout the RoleWe are seeking an experienced Azure Data Engineer to lead the migration of large-scale SQL workloads from on-premise environments to Azure. The successful candidate will ensure high data integrity, minimal downtime, and performance optimization throughout the process.The ideal candidate will design,...

  • Business Data Architect

    6 days ago

    Alwar, Rajasthan, India beBeeData Full time ₹ 18,00,000 - ₹ 24,00,000

    Job Role: Business Data ArchitectWe're seeking an experienced Business Data Architect to design and implement scalable data solutions that drive business growth. The ideal candidate has a strong background in data engineering, expertise in designing and building production-level data pipelines, and hands-on experience with large-scale data workflows.Key...

  • Senior Data Engineer

    2 days ago

    Alwar, Rajasthan, India beBeeData Full time US$ 1,80,000 - US$ 2,00,000

    Senior Data Architect">We are seeking a highly skilled Senior Data Architect with deep expertise in designing and implementing complex data solutions for large-scale analytics.You will be hands-on in creating, optimizing, and scaling data models, as well as building high-performance data pipelines.Your responsibilities will include architecting efficient...

  • Cloud Data Architect

    5 days ago

    Alwar, Rajasthan, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Job Title: Cloud Data ArchitectWe are seeking an experienced Cloud Data Architect to design, develop and implement scalable data solutions on Google Cloud Platform.This is a senior-level role that requires strong technical skills, business acumen, and excellent communication abilities. The ideal candidate will have a deep understanding of cloud computing,...