Principal Big Data Architect

1 week ago

Palakkad, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000
Senior Data EngineerAbout the Role

This is a key position in our organization, responsible for designing, developing and optimizing data pipelines using various technologies.

  • We are looking for a highly skilled data engineer with experience in cloud computing data development to join our team. The ideal candidate will have at least 6 years of experience in data engineering or cloud computing data development.
  • The successful candidate will design, develop and optimize ETL/ELT data pipelines using Apache Spark (PySpark or Scala), AWS Glue, and Azure Data Factory.
  • They will work with structured and unstructured data to build scalable ingestion and transformation workflows across cloud platforms.
  • The selected candidate will also build data lake and data warehouse solutions using AWS S3, Azure Data Lake, and AWS Glue.
  • Collaboration with data scientists, analysts, and application developers is required to support advanced analytics, reporting, and ML workflows.
  • The role involves implementing job orchestration, monitoring, and error handling for reliable pipeline execution.
  • Maintenance and support of data pipelines, including data load monitoring, data validation and quality checks.
  • The candidate must be able to identify and optimize ingestion pipelines in consultation with customers.
  • Data level 2/3 support is also required, along with investigation of glue job failures and restarts.
  • Fixing minor transformation logic or input data issues, as well as resolving dependency failures in glue workflows.
  • Tuning job configurations and conducting impact analysis and root cause analysis.
Qualifications
  • Bachelor's degree in Computer Science, Information Technology or related field.
  • AWS Glue, ADF, ADB certifications.

  • Principal Big Data Architect

    5 days ago

    Palakkad, Kerala, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Data EngineerWe are seeking a skilled professional to design, build, and maintain robust data pipelines for processing channel activity data. The ideal candidate will have experience in digital channel activities, data engineering, and cloud technologies.Key Responsibilities:Design and develop scalable data architectures using AWS cloud infrastructure and...

  • Big Data Visionary

    5 days ago

    Palakkad, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job DescriptionWe are seeking a seasoned Big Data professional to lead our data engineering efforts. As a Senior Big Data Engineer, you will be responsible for designing and implementing large-scale data processing systems that drive business growth.Team Leadership: Proven experience in leading high-performing data engineering teams across multiple...

  • Big Data Engineer

    2 days ago

    Palakkad, Kerala, India beBeeDatabaseengineering Full time ₹ 12,00,000 - ₹ 20,00,000

    Job Title: Data ArchitectWe are seeking a highly skilled data architect to join our team. As a data architect, you will be responsible for designing and implementing data pipelines that support business growth.Key Responsibilities:Create optimal data pipeline architectureDevelop events/streaming based architecture/designIdentify, design, and implement...

  • Big Data Architect

    5 days ago

    Palakkad, Kerala, India beBeeDataEngineer Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    Role OverviewThe Data Engineer II will design, execute, and manage large-scale distributed data systems to drive business insights and growth.Key Responsibilities:Design and execute complex distributed data systems.Monitor and optimize existing projects for performance.Research and integrate new big data tools and frameworks as required.Implement scalable...

  • Principal Big Data Engineer

    1 week ago

    Palakkad, Kerala, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Data Engineer- Apache DruidThis role is a great opportunity to utilize your technical skills and experience in big data technologies. We are seeking a skilled engineer to join our team.Apache Druid Experience:We are looking for someone with strong hands-on experience working with Apache Druid in production environments.Required Skills and...

  • Big Data Solutions Architect

    3 days ago

    Palakkad, Kerala, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Position OverviewOur organization is seeking a seasoned Data Engineer to spearhead the development of scalable data solutions.The ideal candidate will possess a deep understanding of big data technologies, including HDFS, Hive, and Spark architecture. Proficiency in working with Python and PySpark programming languages is also essential.Key...

  • Principal Data Architect

    1 week ago

    Palakkad, Kerala, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job SummaryWe are seeking a skilled and experienced Data Engineer to design, build, and maintain large-scale data pipelines, data warehousing, and big data processing systems.The ideal candidate will have a strong background in data engineering, data architecture, and data integration. Proficiency in programming languages like SQL, Python, R, or Scala is...

  • Big Data Technical Lead

    1 week ago

    Palakkad, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Description">Technical ArchitectWe are seeking a seasoned technical architect to lead our team in building a scalable and extensible big data platform. The ideal candidate will have a strong track record of delivering complex engineering projects and experience working with large, complex data sets.This position reports to an Engineering Manager and...

  • Big Data Specialist

    1 week ago

    Palakkad, Kerala, India beBeeData Full time ₹ 12,00,000 - ₹ 20,00,000

    We are seeking a Big Data professional to join our team.Key Responsibilities:Analyzing large datasets using PySpark and Hive.Desirable Skills:Proficiency in Spark and HBase for efficient data processing.Data Quality tools expertise for data accuracy and reliability.Awareness of Agile methodologies for effective collaboration.Familiarity with data ingestion...

  • Big Data Engineer

    5 days ago

    Palakkad, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job OverviewAs a skilled professional in Big Data engineering, you will be responsible for developing and implementing scalable data processing solutions using cutting-edge technologies.With 2+ years of experience in the field, you will have a solid understanding of Big Data concepts, Scala programming language, AWS cloud platform, and either Python or...