Senior Big Data Architect

21 hours ago

Udaipur, Rajasthan, India beBeeDataEngineer Full time ₹ 25,00,000 - ₹ 30,00,000

Job Title: Data Engineer

Key Responsibilities:
  • Create and maintain optimal data pipeline architecture
  • Create and maintain events/streaming based architecture/design
  • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
  • Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS 'big data' technologies.
  • Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.
  • Work with data scientists to strive for greater functionality in our data systems.
Required Skills and Qualifications:
  • Proficiency in either Scalar or Python, expertise in Spark, and experience with performance tuning and optimization. DBT is also Mandatory.
  • We are looking for a candidate with 2+ years of experience in a Data Engineer role.
  • Experience with big data tools: HDFS/S3, Spark/Flink,Hive,Hbase, Kafka/Kinesis, etc.
  • Experience with relational SQL and NoSQL databases, including Elasticsearch and Cassandra/Mongodb.
  • Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
  • Experience with AWS /GCP cloud services
  • Experience with stream-processing systems: Spark-Streaming/Flink etc.
  • Experience with object-oriented/object function scripting languages: Java, Scala, etc.
  • Strong analytic skills related to working with structured/unstructured datasets.
  • Build processes supporting data transformation, data structures, dimensional modeling, metadata, dependency, schema registration/evolution and workload management.
Benefits:
  • Have a few weekend side projects up on GitHub
  • Have contributed to an open-source project
  • Have worked at a product company
  • Have a working knowledge of a backend programming language
Other Requirements:
  • Programming Language (Mandatory) → Candidate should be really good in either Scala OR Python (not necessarily both).
  • Big Data Framework (Mandatory) → Strong hands-on expertise in Apache Spark.
  • Performance Tuning & Optimization (Mandatory) →
  • DBT (Mandatory) →

  • Senior Big Data Architect

    2 weeks ago

    Udaipur, Rajasthan, India beBeeDataEngineer Full time

    Job Summary:We are seeking a highly skilled Big Data Engineer to lead our team in developing and implementing large-scale data architectures. As a senior member of our engineering team, you will be responsible for designing and implementing data pipelines, working closely with clients and stakeholders to understand their requirements and develop solutions...

  • Senior Data Architect Position

    5 days ago

    Udaipur, Rajasthan, India beBeeDataArchitect Full time ₹ 25,00,000 - ₹ 30,00,000

    Senior Data Architect PositionWe are looking for a highly experienced Senior Data Architect to lead our data warehouse team. The ideal candidate will have a strong background in designing and developing large-scale data systems, with expertise in cloud-based technologies such as AWS.Job Description:The Senior Data Architect will be responsible for:Designing...

  • Big Data Solution Architect

    2 days ago

    Udaipur, Rajasthan, India beBeeDataArchitect Full time ₹ 18,00,000 - ₹ 25,00,000

    Job Opportunity:We are seeking a highly skilled Big Data Solution Architect to join our team.About the Role:The ideal candidate will have expertise in designing and implementing large-scale data processing systems using Apache Spark, Hadoop, and related technologies. They will also have experience with stream-processing systems like Apache Storm or...

  • Lead Big Data Solutions Architect

    1 day ago

    Udaipur, Rajasthan, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Data Engineer LeadJob Overview:We are seeking a highly skilled data engineer to spearhead our Data/AI Practice. The ideal candidate will have hands-on experience with unified data platforms and exposure to modern big data frameworks.Key Responsibilities:Drive strategic initiatives to develop and continuously improve the Data/AI Practice.Design, build, and...

  • Big Data Expert

    4 days ago

    Udaipur, Rajasthan, India beBeeData Full time ₹ 12,00,000 - ₹ 15,00,000

    Job Title: Senior Big Data AnalystWe are seeking a highly skilled and experienced Big Data Analyst to join our team.Description:This is an exciting opportunity for a talented data professional to lead the development and implementation of big data solutions using Hadoop and Scala technologies.The ideal candidate will have hands-on experience with Spark,...

  • Chief Big Data Architect

    1 week ago

    Udaipur, Rajasthan, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Big Data Platform Engineer Job DescriptionWe are seeking an experienced Big Data Platform Engineer to join our team. In this role, you will be responsible for designing, developing, and maintaining a highly scalable and extensible big data platform that provides the foundation for collecting, storing, modeling, and analyzing massive data sets from multiple...

  • Cloud Data Architect

    3 days ago

    Udaipur, Rajasthan, India beBeeData Full time ₹ 1,00,00,000 - ₹ 1,50,00,000

    Cloud Data ArchitectWe are seeking a Cloud Data Architect to lead the development of our cloud-based data warehousing and big data solutions.Design and implement scalable and secure data architectures on Google Cloud Platform (GCP).Collaborate with cross-functional teams to develop and deploy cloud-based data solutions.Develop and maintain architecture...

  • Senior Big Data Engineer

    3 days ago

    Udaipur, Rajasthan, India beBeeBigData Full time ₹ 15,00,000 - ₹ 25,00,000

    Big Data Developer Job OverviewWe are seeking a skilled professional to design, develop, and deploy big data solutions using Hadoop, Spark, and related technologies.The ideal candidate will have a strong background in Scala, AWS, and Python or Java, with experience working with cross-functional teams to identify business requirements and design scalable data...

  • Big Data Specialist

    1 week ago

    Udaipur, Rajasthan, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,50,000

    We are seeking a Senior Data Engineer to join our growing team of consultants. In this role, you will be responsible for designing, constructing, and optimizing large-scale data processing systems that enable advanced analytics and business intelligence.You will collaborate closely with data scientists, analysts, and other engineers to ensure the...

  • Big Data Professional

    7 days ago

    Udaipur, Rajasthan, India beBeeBigData Full time ₹ 10,48,000 - ₹ 26,12,000

    Big Data Expert WantedWe are looking for a skilled Big Data expert to join our team. The ideal candidate will have experience in handling large data sets and developing strategies to improve data processing efficiency.The successful candidate will be responsible for designing, implementing, and maintaining big data solutions using various technologies such...