Chief Data Processing Architect

13 hours ago

Erode, Tamil Nadu, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000
Senior Data Engineer Job Description

As a senior data engineer, you will play a key role in designing and developing large-scale data processing systems. Your primary responsibility will be to design, develop, and maintain cloud-based data architectures using Azure Databricks, PySpark, and Apache Spark.

Key Responsibilities Include:

  • Designing and deploying scalable real-time and batch processing workflows using Azure Databricks, PySpark, and Apache Spark.
  • Performing data pre-processing tasks such as cleaning, transformation, deduplication, normalization, encoding, and scaling to ensure high-quality input for downstream analytics.
  • Maintaining cloud-based data architectures including data lakes, lakehouses, and warehouses following Medallion Architecture principles.
  • Deploying and optimizing data solutions on Azure (preferred), AWS, or GCP with a focus on performance, security, and scalability.
  • Developing and optimizing ETL/ELT pipelines for structured and unstructured data from IoT, MES, SCADA, LIMS, and ERP systems.
  • Automating data workflows using CI/CD and DevOps best practices to ensure security and compliance with industry standards.
  • Monitoring, troubleshooting, and enhancing data pipelines for high availability and reliability.
Requirements
  • 4+ years of experience in data engineering.
  • Strong knowledge of Azure Databricks, PySpark, Apache Spark, and SQL.
  • Experience with cloud-based data architectures including data lakes, lakehouses, and warehouses.
  • Familiarity with ETL/ELT pipelines and data workflows.
  • Good understanding of DevOps principles and CI/CD pipelines.
Benefits
  • A challenging and rewarding role in a dynamic team environment.
  • Opportunities for growth and professional development through training and mentorship programs.
  • A competitive salary and benefits package that reflects your skills and experience.

  • Shopify Executive

    2 weeks ago

    Erode, Tamil Nadu, India Nap Chief Full time

    Join the Nap Chief Crew If Shopify is your playground and you love blending creativity with e-commerce, this is your chance We're on the hunt for a Shopify Executive who can make our online store as delightful as our kidswear. Location: Andheri East, Mumbai (On-site) Experience: 2–3 YearsAbout Nap ChiefNap Chief is a premium kidswear brand for the coolest...

  • Chief Data Platform Architect

    10 hours ago

    Erode, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Senior Data ArchitectWe are seeking a highly skilled Senior Data Architect with deep expertise in Microsoft Azure to design, build and optimize scalable data architectures and Lakehouse solutions.This role involves working closely with cross-functional teams to provide thought leadership and deliver robust secure and high-performance data solutions that...

  • Chief Data Architect

    1 day ago

    Erode, Tamil Nadu, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job DescriptionA Data Engineer is responsible for designing, developing, and maintaining robust data pipelines and ETL processes using data platforms for the organization's centralized data warehouse.Key responsibilities include conceptualizing and owning the build out of problem-solving data marts for consumption by data science and BI teams, evaluating...

  • Senior Databricks Data Architect

    13 hours ago

    Erode, Tamil Nadu, India beBeeDatabricks Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Senior Databricks Data ArchitectWe are seeking a highly skilled and experienced Senior Databricks Data Architect to join our dynamic data engineering team. The ideal candidate will be well-versed in designing, developing, and maintaining scalable and high-performance data pipelines using Databricks and PySpark.Lead the development of innovative...

  • Chief Data Architect

    10 hours ago

    Erode, Tamil Nadu, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer with expertise in designing and implementing scalable data pipelines.Create event-driven data pipelines to process clinical encounter data, retrieve associated medical documents, and deliver validated information to machine learning systems for inference.Collaborate closely...

  • Chief Data Officer

    2 days ago

    Erode, Tamil Nadu, India beBeeDataScientist Full time ₹ 15,00,000 - ₹ 25,00,000

    Key Roles and Responsibilities">We are seeking a skilled Data Architect to lead the design, development, and maintenance of data systems. This role requires proactive collaboration with cross-functional teams to ensure high standards of data quality and performance.The successful candidate will be responsible for:

  • Chief Data Architect

    13 hours ago

    Erode, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,06,44,000 - ₹ 2,52,10,000

    About the Position:We are seeking a skilled Data Engineer to join our team.The ideal candidate will have a passion for learning and adapting to emerging technologies, particularly AI-powered financial solutions. The successful candidate will work on developing and deploying innovative technology that combines Large Language Models (LLMs), Agents, Knowledge...

  • Azure Data Engineer

    2 days ago

    Erode, Tamil Nadu, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 26,00,000

    Job TitleAzure Data Engineer (Data Architect)We are seeking a seasoned Data Engineer to join our team. This is an exciting opportunity for a professional with expertise in Azure DataBricks and Pyspark to drive data-driven decision making.

  • Chief Data Engineering Officer

    1 day ago

    Erode, Tamil Nadu, India beBeeDataArchitect Full time ₹ 30,00,000 - ₹ 40,00,000

    Job Title: Senior Data ArchitectAbout the Role:We are seeking a highly skilled Senior Data Architect with expertise in cloud-native data engineering and familiarity with various cloud platforms. The ideal candidate will have deep knowledge of building scalable data pipelines, implementing enterprise-grade data governance, security, and AI-powered engineering...

  • Chief Data Architect

    2 days ago

    Erode, Tamil Nadu, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Marketing Platform Data EngineerWe're seeking a highly skilled and data-driven individual to join our team as a Marketing Platform Data Engineer. This role requires someone who can extract valuable insights from marketing platforms, uncover hidden patterns, and craft high-resolution datasets.The MissionYour focus is on extracting every drop of value from...