Experienced Big Data Solutions Architect

2 days ago

Kannur, Kerala, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,20,00,000

Our client seeks a highly skilled Senior Data Engineer to join their team. In this role, you will be responsible for designing, constructing, and optimizing large-scale data processing systems that enable advanced analytics and business intelligence.

You will collaborate closely with data scientists, analysts, and other engineers to ensure the availability, reliability, and efficiency of our client's Databricks solution.

Key Responsibilities
  • Design, develop, and maintain scalable and robust data pipelines that collect, process, and store large volumes of structured and unstructured data.
  • Architect and implement data warehouses, data lakes, and other storage solutions that support analytics and reporting needs.
  • Optimize data architectures and workflows for performance, scalability, and cost-efficiency.
  • Collaborate with data scientists and analysts to understand data requirements and ensure that data systems meet their needs.
  • Ensure data quality, integrity, and security by implementing best practices in data governance and management.
  • Develop and maintain documentation for data systems, including data models, flow diagrams, and operational procedures.
  • Mentor and guide junior data engineers, providing technical leadership and support.

Qualifications

  • Bachelor's or Master's degree in Computer Science, Information Systems, Engineering, or a related field.
  • 5+ years of experience in data engineering or related fields, with a focus on large-scale data systems.
  • 3+ years of experience with Databricks.
  • Proficiency in SQL and experience with databases such as MySQL, PostgreSQL, or NoSQL databases.
  • Strong programming skills in languages such as Python, Java, or Scala.
  • Experience with ETL tools and frameworks and data pipeline orchestration.
  • Familiarity with big data technologies (e.g., Hadoop, Spark, Kafka) and cloud platforms (AWS, GCP, Azure).
  • Strong understanding of data warehousing concepts, data modeling, and schema design.
  • Excellent problem-solving skills and attention to detail.
  • Strong communication skills and ability to work effectively in a team-oriented environment.

About Our Client

Our client is an Equal Opportunity Employer that recruits and hires qualified candidates without regard to race, religion, sex, sexual orientation, gender identity, age, national origin, ancestry, citizenship, disability, or veteran status.

  • Big Data Architect

    10 hours ago

    Kannur, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Opportunity: Big Data ArchitectThe Senior Data Engineer position involves designing, building, and maintaining large-scale data architectures. This includes data lakes, lakehouses, and warehouses.Key Responsibilities:Create scalable real-time and batch processing workflows using PySpark and Apache Spark.Cleanse, transform, deduplicate, normalize, encode,...

  • Big Data Engineer

    2 weeks ago

    Kannur, Kerala, India Nice Software Solutions Pvt. Ltd. Full time

    Big Data Engineer (PySpark)Location: Pune/Nagpur (WFO)Experience: 8 - 12 YearsEmployment Type: Full-timeJob OverviewWe are looking for an experienced Big Data Engineer with strong expertise in PySpark and Big Data ecosystems. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines while ensuring high...

  • Data Architect

    10 hours ago

    Kannur, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Big Data Architect RoleEffective data processing is a critical aspect of any organization. As such, we seek an experienced professional to fill the role of Big Data Architect.Key Responsibilities:Design and implement scalable data architectures using Apache Spark and related tools.Configure and maintain data pipelines for seamless data flow.Develop and...

  • Data Architect

    2 weeks ago

    Kannur, Kerala, India InvokHR Solutions Full time

    About the client A boutique AI and data engineering firm, founded in 2018 and headquartered in Gurgaon, India, that empowers Fortune 1000 companies through AI-powered decision intelligence—especially in finance and supply chain transformation—delivering over US $2 billion in financial benefits while fostering a highly developed people-first cultureKey...

  • Data Solutions Architect

    10 hours ago

    Kannur, Kerala, India beBeeIntegration Full time ₹ 18,00,000 - ₹ 24,00,000

    Job Title: O9 Integration ConsultantAs a seasoned O9 Integration Consultant, you will be responsible for delivering high-quality data integration solutions that meet the evolving needs of our clients.The ideal candidate will possess a strong background in ETL (Extract/Transform/Load) processes and proficiency in databases (SQL Server, MySQL). Additionally,...

  • Strategic Data Infrastructure Specialist

    2 days ago

    Kannur, Kerala, India beBeeEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Big Data Engineering Lead PositionWe are seeking a highly skilled and strategic leader with expertise in Big Data platforms, Microsoft Azure, and Databricks to spearhead the development of end-to-end data solutions.Key Responsibilities:Lead a team of experienced data engineers working on large-scale distributed data systems.Architect and oversee the design,...

  • Senior Data Solutions Architect

    2 days ago

    Kannur, Kerala, India beBeeData Full time ₹ 20,00,000 - ₹ 30,00,000

    Job DescriptionWe seek a skilled professional to design and develop our data architecture and pipelines. The ideal candidate has experience working with Google Cloud Platform - Big Query and Data Proc technologies.This role is for an individual who is passionate about making a difference through healthcare and has a strong passion for continuous learning and...

  • Senior Data Solutions Architect

    12 hours ago

    Kannur, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Data EngineerAs a seasoned data engineer, you will play a pivotal role in designing, developing, and maintaining large-scale data pipelines. Your expertise in architecting scalable data solutions will drive business growth and inform strategic decision-making.Key Responsibilities:Develop and maintain ETL/ELT data pipelines to ingest data from various sources...

  • Data Architect

    1 day ago

    Kannur, Kerala, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 30,00,000

    Job RoleWe are seeking an experienced professional to design and build large-scale data infrastructures.The ideal candidate will have expertise in real-time data processing using technologies like Apache Kafka, Apache Flink, and Apache Spark. They will work closely with cross-functional teams to ensure seamless integration with existing systems and develop...

  • Senior Data Architect

    9 hours ago

    Kannur, Kerala, India beBeeData Full time ₹ 10,00,000 - ₹ 15,00,000

    We are seeking a skilled Data Architect to design and implement data solutions using Palantir Foundry, Workshop, PySpark, and Typescript.Key Responsibilities:Develop and execute advanced data architectures for multi-year project initiatives.Collaborate with cross-functional teams to conceptualize and deliver data-driven projects.Pioneer the development of...