Data Solutions Architect

2 weeks ago

Madurai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 30,00,000 - ₹ 40,00,000
Job Description

We are seeking a highly skilled and experienced data engineer to lead our team. As a key member, you will be responsible for designing, developing, and deploying scalable data pipelines and ETL processes using Scala and Apache Spark (Databricks).

You will design and develop data processing workflows using PySpark and Python, collaborate with data scientists, analysts, and business stakeholders to understand data requirements, and deliver robust data solutions.

You will architect and implement data ingestion, transformation, and integration solutions for structured and unstructured data, optimize Spark jobs for performance and cost efficiency on cloud platforms, and lead, mentor, and guide a team of data engineers.

You will establish and enforce data engineering standards, code reviews, and documentation, troubleshoot and resolve complex data pipeline issues, and stay current with emerging technologies and recommend improvements to existing data infrastructure.

Required Skills and Qualifications
  • Education: Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
  • Experience: 10+ years of professional experience in data engineering.
  • Programming Skills: Strong hands-on programming experience in Scala, with a deep understanding of functional programming concepts.
  • Apache Spark Experience: Extensive experience with Apache Spark, including Spark SQL, Spark Streaming, and optimization techniques.
  • Python and PySpark Experience: Proficiency in Python and PySpark for data processing tasks.
  • Databricks Experience: Experience working with Databricks or similar cloud-based Spark platforms.
  • Distributed Computing Knowledge: Solid understanding of distributed computing, big data architectures, and data modeling.
  • Cloud Platform Experience: Experience with cloud platforms such as AWS, Azure, or GCP.
  • Data Storage Technologies: Familiarity with data storage technologies like HDFS, S3, Delta Lake, and relational/non-relational databases.
  • Leadership Skills: Strong leadership skills with experience leading and mentoring engineering teams.
  • Skill Set: Excellent problem-solving, communication, and collaboration skills.
Benefits

This is an opportunity to work with a talented team of data engineers, collaborate with experts in the field, and contribute to the development of innovative data solutions.

The ideal candidate will have a passion for data engineering, excellent technical skills, and strong leadership abilities.

Others

Please note that this is not a remote job.

  • Data Solutions Architect

    2 weeks ago

    Madurai, Tamil Nadu, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Data ArchitectWe are seeking a highly skilled Data Architect to join our team in the Asset Management / Security Servicing space. As a key member of our team, you will play a crucial role in building and managing data models (conceptual, logical, physical) and ensuring trusted, high-quality, business-aligned data solutions on Snowflake and Azure...

  • Cloud Data Solutions Architect

    2 weeks ago

    Madurai, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Cloud Data Solutions Architect Role Overview:We seek a skilled Cloud Data Solutions Architect to join our team. As a key member of our organization, you will design and develop robust data pipelines using GCP services such as BigQuery, Cloud Storage, and Cloud Pub/Sub. Main Responsibilities:Develop real-time analytics solutions working with...

  • Chief Data Solution Architect

    2 weeks ago

    Madurai, Tamil Nadu, India beBeeDataGovernance Full time ₹ 2,50,00,000 - ₹ 3,50,00,000

    Job OverviewWe are seeking a skilled Senior Architect to join our team. As a Senior Architect, you will be responsible for designing, architecting, deploying, and maintaining big data-based data governance solutions.Our ideal candidate will have a strong background in data governance and experience working with data catalog, business glossary, business...

  • High Performance Data Solutions Architect

    2 weeks ago

    Madurai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    High-Performance Data Solutions ArchitectWe are seeking an experienced data architect to lead the design and implementation of scalable, high-performance data solutions across various departments.Key Responsibilities:Design and Optimize Complex Data PipelinesLead Development of Scalable Data SolutionsDefine and Enforce Data Quality StandardsMaintain...

  • Senior Data Solutions Architect

    2 weeks ago

    Madurai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Are you ready to propel our next-generation platform forward as a Lead Big Data Engineer?Key ResponsibilitiesDrive the development of our Enterprise TruRisk Platform, enhancing customer experience through data-driven insights.Collaborate with a cross-functional team to design, prototype, and implement scalable data pipelines.Provide technical leadership on...

  • Foundational Data Architect

    2 weeks ago

    Madurai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 40,00,000 - ₹ 50,00,000

    Job Title:AWS Data Engineer/ArchitectJob Description:As a seasoned data engineer/architect, you will lead the development of foundational components for a Lakehouse architecture on AWS. Your primary focus will be to drive the migration of existing data processing workflows to the new Lakehouse solution.Key Responsibilities:Lead complex projects autonomously,...

  • Senior Cloud Data Solutions Architect

    2 weeks ago

    Madurai, Tamil Nadu, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Role Overview:The Senior Data Engineer will collaborate with data scientists and architects to develop scalable data solutions. This role requires the ability to design and build robust data pipelines, as well as operationalize data on cloud platforms.Key Responsibilities Include:Designing and building high-quality data pipelines that support analytics and...

  • Expert Data Architect

    2 weeks ago

    Madurai, Tamil Nadu, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Role: Data ArchitectWe are seeking a highly skilled and experienced professional to lead our team in designing and implementing innovative data engineering solutions.As a Data Engineer, you will be responsible for developing robust data architecture frameworks using cloud-based services such as Big Query, Bigtable, Cloud SQL, Data Proc, Data Flow, and Data...

  • Senior Data Architect

    2 weeks ago

    Madurai, Tamil Nadu, India beBeeData Full time ₹ 25,00,000 - ₹ 30,00,000

    Lead Cloud Data ArchitectWe are seeking a seasoned expert to lead our data architecture team in developing and implementing cutting-edge cloud solutions. The ideal candidate will have 12+ years of experience in platform engineering, data architect, data engineering, or solution architecture.Job Description:Platform & Data Solution ArchitectureDevelop and...

  • Senior Cloud Data Solutions Architect

    1 week ago

    Madurai, Tamil Nadu, India beBeeCloud Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Senior Cloud Data Solutions ArchitectWe are seeking a seasoned and visionary Cloud Tech Lead with extensive experience in Java and Apache Spark to drive the design, development, and deployment of scalable data solutions.About the Role:Lead the architecture, development, and deployment of cloud-native data processing systems using Java and Apache...