Senior Big Data Architect

2 days ago


Anand, Gujarat, India beBeeDataEngineer Full time ₹ 25,00,000 - ₹ 30,00,000
Job Description

We are seeking a seasoned data professional to join our team as an AWS Senior Data Engineer. In this role, you will be responsible for designing and implementing scalable big data solutions using Spark and AWS services.

The ideal candidate will have 7-9 years of IT experience with a strong background in AWS-related projects, including certifications like Associate and Professional Level AWS Certification. Proficiency in programming languages such as Scala, Python, and Shell Scripts is essential.

  • Key Responsibilities:
  • Develop and implement scalable Spark jobs using Scala for new project requirements.
  • Optimize Spark job performance through stress testing and tuning.
  • Design efficient data pipelines using AWS Lambda or Apache Airflow for developed/enhanced Spark jobs.
  • Analyze data processing, integration, modeling, and reporting requirements to define data loading strategies.
  • Balance cost and performance optimally.
Required Skills and Qualifications
  • 7-9 years of IT experience with 5+ years in AWS-related projects.
  • Associate and Professional Level AWS Certification is a plus.
  • Proficiency in AWS Services: S3, EC2, EMR, Serverless, Athena, AWS Glue, Lambda, Step Functions.
  • Cloud Databases: AWS Aurora, Singlestore, RedShift, Snowflake.
  • Big Data: Hadoop, Hive, Spark, YARN.
  • Programming Languages: Scala, Python, Shell Scripts, PySpark.
  • Operating Systems: Any Linux flavor, Windows.
  • Strong SQL skills are essential.
  • Orchestration Tools: Apache Airflow.
  • Expertise in ETL workflows with complex transformations.
  • Understanding of AWS VPC, Subnets, Security Groups, and Route Tables.
What We Offer

As a member of our team, you will have the opportunity to work on exciting projects, collaborate with experienced professionals, and grow your skills in a fast-paced environment.



  • Anand, Gujarat, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Big Data EngineerAbout the Role:We're seeking a skilled big data engineer to develop and implement cutting-edge solutions using Scala, Python, or Java.Key responsibilities include designing and optimizing data processing pipelines for large-scale data sets.Collaborate with cross-functional teams to integrate big data solutions with existing...


  • Anand, Gujarat, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job OverviewWe are seeking a highly skilled Data Engineer to design and execute large-scale distributed data systems leveraging cutting-edge Machine Learning and AI technologies on Hadoop clusters.The ideal candidate will have expertise in big data technologies, relational databases, and proficiency in programming languages such as Java, Python or Scala.A...


  • Anand, Gujarat, India beBeeData Full time ₹ 10,00,000 - ₹ 15,00,000

    Senior Big Data EngineerDescription:A seasoned senior data engineer with extensive experience in designing, building, and maintaining large-scale data and analytics platforms.Key Responsibilities:Designing, building, and maintaining data warehouses in cloud-based solutions such as Amazon Redshift or similar platforms.Developing complex ETL pipelines using...


  • Anand, Gujarat, India beBeeCloud Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job OverviewWe are seeking a highly skilled Cloud and Big Data Architect to join our team.This is a full-time hybrid role offering flexibility for remote work in a fast-paced environment.Key Responsibilities:Design and implement big data architectures, cloud adoption strategies, and solutions.Ensure data governance and applicative implementation standards on...

  • Big Data Innovator

    2 days ago


    Anand, Gujarat, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 20,10,000

    Job Title:Job Description:We are seeking a skilled Data Engineering professional with 6-12 years of experience in Big Data and related technologies.Key skills required include overall experience in Big Data projects, knowledge of data structures and algorithms, experience in Big Data technologies including PySpark/Scala Spark/Java Spark SQL, and strong...


  • Anand, Gujarat, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Senior Big Data EngineerWe are seeking a seasoned Big Data Hadoop Scala Developer to join our team. As a key member of our data engineering team, you will be responsible for designing and implementing large-scale big data solutions using Hadoop and related technologies.Key Responsibilities:Develop and maintain high-performance big data pipelines...

  • Big Data Innovator

    5 days ago


    Anand, Gujarat, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Professionals seeking to drive innovation and growth in data engineering will find this role appealing.A challenging opportunity has arisen for an experienced big data engineer to design, develop and deploy scalable data processing systems using PySpark and Hive.Key Responsibilities:Collaborate with cross-functional teams to integrate data from various...


  • Anand, Gujarat, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Key ResponsibilitiesDesign, develop, and maintain data pipelines and ETL processes on Databricks.Lead the architecture and implementation of scalable, secure, and high-performance data solutions.Collaborate with business stakeholders, data scientists, and analysts to gather requirements and deliver actionable data insights.Optimize data workflows for...


  • Anand, Gujarat, India beBeeHadoop Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Big Data Cluster EngineerThe ideal candidate will have experience in building and managing complex data clusters, migrating large datasets, and performance tuning. They should also be proficient in Linux commands and have pre/post platform support for application migration.We are seeking a skilled engineer to join our team to work on designing,...


  • Anand, Gujarat, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Job OverviewA data architect with experience in cloud technologies and digital channel activities is required to work on projects involving the integration and processing of channel activity data from multiple sources.Develop robust data pipelines for processing channel activity data, focusing on digital channels and integrating multiple sources of data such...