Senior Big Data Solutions Architect

5 days ago

Bhavnagar, Gujarat, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000
Big Data Architect

We are seeking a skilled Big Data Architect to lead our data-driven initiatives and design scalable data pipelines. This role involves collaborating with data scientists and business stakeholders to deliver high-quality solutions.

Key Responsibilities:
  • Design, build, and optimize data pipelines and ETL workflows using Apache Spark, Python, and SQL.
  • Manage and process large datasets using Spark, PySpark, and SQL.
  • Build and maintain real-time streaming applications with Spark Streaming/Kafka.
  • Collaborate with data scientists and product teams to integrate AI/ML models into production.
  • Ensure data quality, scalability, and performance in all pipelines.
  • Deploy and manage Spark workloads on cloud platforms (AWS, Azure, GCP, Databricks).
  • Automate testing and deployment of Spark jobs via CI/CD pipelines.
Requirements:
  • Bachelor's/Master's degree in Computer Science, Computer Engineering, or related field.
  • Minimum 4 years of professional experience as a Data Engineer.
  • Strong expertise in Python, Spark, PySpark.
  • Hands-on experience with Spark SQL, DataFrames, UDFs, DAG execution.
  • Knowledge of data ingestion tools (Kafka, Flume, Kinesis) and data formats (Parquet, Avro, ORC).
  • Proficiency in Airflow/Prefect for scheduling and orchestration.
  • Familiarity with performance tuning in Spark (partitioning, caching, broadcast joins).
  • Experience deploying on Databricks, AWS EMR, Azure HDInsight, or GCP Dataproc.
  • Exposure to testing and CI/CD for data pipelines (pytest, Jenkins, GitHub Actions).

Our ideal candidate will possess excellent problem-solving skills, be able to communicate complex ideas effectively, and have a passion for staying up-to-date with the latest technologies in big data engineering.

  • Data Engineer for Big Data Solutions

    2 days ago

    Bhavnagar, Gujarat, India beBeeInformatica Full time ₹ 1,00,00,000 - ₹ 1,50,00,000

    Job DescriptionThe ideal candidate will have a proven track record of designing and developing scalable ETL workflows using Informatica BDM/DEI.They will integrate data from structured and unstructured sources, including big data platforms, and apply strong data warehousing concepts to ensure efficient data modeling and transformation.Collaboration with data...

  • Mastering Big Data Solutions

    5 days ago

    Bhavnagar, Gujarat, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    We are seeking a skilled Senior Data Engineer with hands-on expertise in Python and Pyspark to help implement a cutting-edge application for a prominent retailer. Key Responsibilities:Design, develop, and maintain large-scale data systems using Python and Pyspark.Collaborate with cross-functional teams to integrate data streams from various sources.Analyze...

  • Big Data Platform Architect

    3 days ago

    Bhavnagar, Gujarat, India beBeeDataLeader Full time ₹ 25,00,000 - ₹ 35,00,000

    Job DescriptionSigmoid empowers enterprises to make smarter, data-driven decisions by blending advanced data engineering with AI consulting. We collaborate with leading organizations across sectors such as retail, finance, life sciences, and manufacturing to solve complex business challenges. Our global team specializes in cloud data modernization,...

  • Data And Solutions Architect

    3 weeks ago

    Bhavnagar, Gujarat, India CoffeeBeans Full time

    Coffee Beans Consulting is a tech consulting firm focused on making organizations AI-ready by structuring their data efficiently across various sources and enabling AI-driven solutions.We specialize in data architecture, pipelines, governance, MLOps, and Gen AI solutions, helping clients achieve faster go-to-market and cost efficiency.We are looking for a...

  • Data Engineering Solutions Architect

    5 days ago

    Bhavnagar, Gujarat, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Data Engineering Solutions ArchitectOverview:We are seeking an experienced Data Engineering Solutions Architect to join our team. As a key member of our data engineering group, you will design, develop, and maintain scalable, secure, and high-performance data solutions on Databricks.Responsibilities:Lead the architecture and implementation of data...

  • Chief Data Architect – Big Data Platforms

    5 days ago

    Bhavnagar, Gujarat, India beBeeBigDataLeader Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Lead Big Data Engineering TeamWe are seeking an experienced Lead to spearhead a team of data engineers working on large-scale distributed data systems. The ideal candidate will have deep expertise in Big Data platforms and cloud technologies.Key Responsibilities:Grow and lead a team of data engineers to design, develop, and deliver scalable data pipelines...

  • Senior Data Architect

    5 days ago

    Bhavnagar, Gujarat, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Big Data ArchitectWe are seeking a skilled Big Data Architect to design, build, and optimize scalable data architectures using Snowflake, AWS, and DBT. The ideal candidate will enable seamless data integration, transformation, and analytics to support business intelligence and advanced analytics initiatives.Design, build, and maintain ETL/ELT pipelines using...

  • Cloud Data Solutions Architect

    2 days ago

    Bhavnagar, Gujarat, India beBeeDataGovernance Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Data Governance ManagerWe are seeking a highly skilled professional with 6–8 years of experience in designing, developing, and managing enterprise data solutions on cloud platforms. The ideal candidate will have a strong background in cloud data architecture, data warehousing, big data processing, and data integration, with proven expertise in delivering...

  • Senior Data Platform Architect

    5 days ago

    Bhavnagar, Gujarat, India beBeeDataEngineering Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Imagine building large-scale data platforms on Google Cloud. We're seeking a senior data engineer to create enterprise-grade data solutions using modern tools and practices.Job DescriptionOur ideal candidate will design and build robust data pipelines for ingestion, transformation, and analytics. They'll work with Big Data tools like Hadoop, Spark, Kafka,...

  • Enterprise Data Architect Specialist

    5 days ago

    Bhavnagar, Gujarat, India beBeeData Full time ₹ 19,50,000 - ₹ 24,12,000

    Data Architect OpportunityWe are seeking an experienced Data Architect to design, develop and govern our data architecture and pipelines. Ideally someone who has worked on multiple projects with GCP-Big Query, Data Proc technologies.