Big Data Solutions Architect

19 hours ago

Hyderabad, Telangana, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

Job Title:

Big Data Solutions Architect

About the Role:

We are seeking a highly skilled and experienced Big Data Solutions Architect to join our organization. As a key member of our data engineering team, you will be responsible for designing, developing, and deploying scalable big data solutions using Scala, Apache Spark, and cloud-based platforms.

Key Responsibilities:

  • Lead the design, development, and deployment of scalable big data pipelines and ETL processes.
  • Develop and maintain data processing workflows using PySpark and Python.
  • Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver robust data solutions.
  • Architect and implement big data ingestion, transformation, and integration solutions for structured and unstructured data.
  • Optimize Spark jobs for performance and cost efficiency on cloud platforms.
  • Lead, mentor, and guide a team of data engineers, ensuring best practices in coding, testing, and deployment.
  • Establish and enforce big data engineering standards, code reviews, and documentation.
  • Troubleshoot and resolve complex big data pipeline issues.
  • Stay current with emerging technologies and recommend improvements to existing data infrastructure.
  • Work closely with DevOps and cloud teams to ensure smooth deployment and monitoring of big data pipelines.

Required Qualifications:

  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
  • 10+ years of professional experience in big data engineering.
  • Strong hands-on programming experience in Scala, with a deep understanding of functional programming concepts.
  • Extensive experience with Apache Spark, including Spark SQL, Spark Streaming, and optimization techniques.
  • Proficiency in Python and PySpark for data processing tasks.
  • Experience working with Databricks or similar cloud-based Spark platforms.
  • Solid understanding of distributed computing, big data architectures, and data modeling.
  • Experience with cloud platforms such as AWS, Azure, or GCP.
  • Familiarity with data storage technologies like HDFS, S3, Delta Lake, and relational/non-relational databases.
  • Strong leadership skills with experience leading and mentoring engineering teams.
  • Excellent problem-solving, communication, and collaboration skills.

  • Big Data Solutions Architect

    4 days ago

    Hyderabad, Telangana, India beBeeEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Data Engineering Leadership OpportunityOverview of the Role:We are seeking a highly skilled and experienced Data Engineering Manager/Architect to lead our team in delivering high-quality big data solutions on GCP/Azure Cloud. As a key member of our organization, you will be responsible for architecting, implementing, and managing large-scale data engineering...

  • Big Data Solutions Architect

    14 hours ago

    Hyderabad, Telangana, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Senior Big Data EngineerWe are seeking a seasoned Senior Big Data Engineer to spearhead the design, development, and implementation of cutting-edge Big Data analytics platforms.About the Role:Design, develop, deploy and maintain scalable Big Data pipelines using technologies such as Spark, Kafka, Glue, EMR, Hudi, Schema Registry, and Data Lineage.Leverage...

  • Big Data Solutions Architect

    2 days ago

    Hyderabad, Telangana, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Data ArchitectAbout the Role:Our organization is seeking a highly skilled and experienced Data Engineer II to join our team in Hyderabad, India.The successful candidate will be responsible for designing, executing, and managing large and complex distributed data systems, monitoring performance, and optimizing existing projects. Additionally, they...

  • Big Data Solutions Architect

    2 days ago

    Hyderabad, Telangana, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 28,00,000

    Job Summary">We are seeking a seasoned Big Data Solutions Architect to join our team. As a key member of our organization, you will be responsible for designing and implementing large-scale data engineering solutions.">Responsibilities">">Lead the design and implementation of distributed data engineering systems, including HDFS, Apache Spark, and...

  • Big Data Architect

    1 week ago

    Hyderabad, Telangana, India beBeeDataScientist Full time ₹ 12,00,000 - ₹ 20,00,000

    Job Title: Big Data ArchitectWe are seeking a highly skilled professional to lead the design and implementation of our big data infrastructure.Responsibilities:Develop and maintain high-performance big data applications using Python, PySpark, and Spark Dataframes.Design and implement scalable data architectures to process huge volumes of data.Collaborate...

  • Big Data Architect

    2 days ago

    Hyderabad, Telangana, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Data Engineer - Big Data ArchitectAbout the Role: We are seeking a seasoned Data Engineer to design, develop, and maintain scalable big data systems and data processing frameworks.The ideal candidate will have hands-on experience with Hadoop, Apache Spark, and Hive, as well as expertise in writing efficient SQL and working with data warehousing...

  • Big Data Architect

    5 days ago

    Hyderabad, Telangana, India beBeeDataArchitect Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Big Data ArchitectCompany Description: We're looking for a skilled professional to lead the design, development, and optimization of our large-scale data processing systems. Job Summary: As a seasoned big data architect, you will be responsible for designing scalable architectures and pipelines using Apache Spark and Python to process massive...

  • Big Data Engineer

    4 weeks ago

    Hyderabad, Telangana, India TECHOAKS IT SOLUTIONS PRIVATE LIMITED Full time

    Full-time with Info ServicesClient: Disney (Offshore)Job Description :Java with Big DataMust have skills :- 8+ years of total work experience is expected.- Java, Big Data, Spring, Kafka, AWS, Scala, and Spark: All these are needed to be strong.Roles & Responsibilities :- Design and Development: Architect, design, and develop high-performance, scalable, and...

  • Senior Data Architect

    2 weeks ago

    Hyderabad, Telangana, India beBeeData Full time ₹ 9,00,000 - ₹ 13,20,000

    Big Data Engineering OpportunitiesWe are seeking a skilled Senior Data Engineer to develop and manage our company's Big Data solutions. As a key member of our team, you will be responsible for designing and implementing Big Data tools and frameworks, ELT processes, and cloud platforms. You will also collaborate with development teams and maintain production...

  • Big Data Architect

    4 days ago

    Hyderabad, Telangana, India Persistent Full time US$ 1,50,000 - US$ 2,00,000 per year

    About PersistentWe are a trusted Digital Engineering and Enterprise Modernization partner, combining deep technical expertise and industry experience to help our clients anticipate what's next. Our offerings and proven solutions create a unique competitive advantage for our clients by giving them the power to see beyond and rise above. We work with many...