Senior Data Architect

2 days ago

Chennai, Tamil Nadu, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000
Senior Data Engineer Position

Our organization is seeking a highly skilled Senior Data Engineer to play a key role in designing, building, and maintaining scalable, efficient, and reliable data pipelines and solutions.

This position involves the development of scalable ETL/ELT data pipelines for batch and near real-time processing using tools such as Talend, AWS Glue, Lambda, and SQS. The successful candidate will design, develop, and maintain efficient, reusable, and scalable ETL scripts primarily using Python, PySpark, and SQL. Utilization of AWS SDK for Python (Boto3) for automation and integration with AWS services is essential.

  • Design and develop scalable ETL/ELT data pipelines for batch and near real-time processing using tools such as Talend, AWS Glue, Lambda, and SQS.
  • Develop and optimize SQL queries and perform data modeling, cleansing, transformation, and validation to ensure data quality and accuracy.
  • Write efficient, reusable, and scalable ETL scripts primarily using Python, PySpark, and SQL. Utilize AWS SDK for Python (Boto3) for automation and integration with AWS services.
  • Collaborate with data analysts, data scientists, and business stakeholders to understand data requirements and deliver actionable insights.
  • Build and orchestrate workflows using Talend and AWS Step Functions to automate complex data processes.
  • Monitor and troubleshoot data pipelines and infrastructure using AWS CloudWatch and other monitoring tools to ensure optimal performance and availability.
  • Implement best practices for data security, access control (using AWS IAM), and compliance in cloud environments.
  • Participate in the design and architecture of data storage solutions using AWS services such as S3, Redshift, DynamoDB, and EC2.
  • Stay current with emerging technologies and industry trends, recommending and implementing improvements to our data engineering practices.
  • Mentor junior data engineers and contribute to team knowledge sharing.
Required Skills & QualificationsCloud Platforms & Services:
  • AWS expertise with hands-on experience in:
    • Data processing and querying: Athena, AWS Glue, Lambda
    • Storage and databases: S3, Redshift, DynamoDB, EBS
  • Compute and networking:
    • EC2, VPC
  • Messaging and orchestration:
    • SQS, SNS, Step Functions, API Gateway
  • Security and monitoring:
    • IAM
    • QuickSight
Programming & Scripting:
  • Python (including AWS SDK - Boto3)
  • PySpark
  • Java (preferred but not mandatory)
  • SQL (advanced query optimization and tuning)
ETL & Workflow Orchestration:
  • Talend or similar ETL tools
  • Apache Airflow or other orchestration tools for workflow
Requirements:
  • Bachelors or Masters degree in Computer Science, Engineering, Information Technology, or a related field.
  • Minimum 7+ years of professional experience in data engineering or related roles.
  • Proven experience designing and building complex data pipelines and data warehousing solutions on AWS.
  • Strong proficiency in SQL and database technologies.
  • Experience with big data processing frameworks and distributed systems.
  • Excellent problem-solving skills and ability to work with large datasets.
  • Strong communication skills and ability to work collaboratively in cross-functional teams

  • Senior Data Architect

    2 days ago

    Chennai, Tamil Nadu, India beBeeDataArchitect Full time ₹ 15,00,000 - ₹ 25,00,000

    We are looking for a skilled Senior Data Architect to lead the design, development and management of scalable data platforms.Key Responsibilities:Design, develop and maintain end-to-end data pipelines and infrastructureTranslate business requirements into technical solutionsBuild and manage data flows across structured and unstructured data sourcesEnsure...

  • Enterprise Data Solutions Architect

    2 days ago

    Chennai, Tamil Nadu, India beBeeDataArchitect Full time ₹ 1,80,00,000 - ₹ 2,25,00,000

    Senior Data Architect PositionWe are seeking a seasoned Senior Data Architect to lead the design, development and maintenance of our enterprise data & analytics platform.This role involves designing and implementing scalable data solutions while providing strategic direction and leadership to cross-functional teams.Lead the architecture, implementation and...

  • Salesforce Technical Architect

    1 day ago

    Chennai, Tamil Nadu, India NTT DATA Full time US$ 1,50,000 - US$ 2,00,000 per year

    NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Salesforce Technical Architect to join our team in Noida\Bengaluru\Chennai\Hyderabad, Karnataka, India. Job Summary: We are seeking...

  • Senior Data Architect

    4 days ago

    Chennai, Tamil Nadu, India Axtria - Ingenious Insights Full time

    Job Title:- Senior Data Architect Location:- NCR/(Bangalore preferably) Experience:- 10+ Years JOB OBJECTIVE: To leverage expertise in data architecture and management to design, implement, andOptimise a robust data warehousing platform for the pharmaceutical industry. The goal is toensure seamless integration of diverse data sources, maintain high standards...

  • Data Architect and Engineering Manager

    5 days ago

    Chennai, Tamil Nadu, India beBeeDataArchitecture Full time ₹ 1,80,00,000 - ₹ 2,20,00,000

    Data Architect and Engineering ManagerWe are seeking an accomplished Data Architect and Engineering Manager to lead our data engineering initiatives. This senior role will oversee the design, development, and implementation of large-scale data processing systems.Key Responsibilities:Develop and implement scalable data architecture designs using Python, AWS,...

  • Expert Data Architect

    2 days ago

    Chennai, Tamil Nadu, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    About This OpportunityWe are seeking a highly skilled and experienced Senior Consultant/Architect specializing in SAP Datasphere solutions.Key Responsibilities:Design and architect scalable, high-performing, and secure data integration and analytics solutions using SAP Datasphere and associated technologies.Provide technical leadership in integrating SAP...

  • Chief Data Solutions Architect

    5 days ago

    Chennai, Tamil Nadu, India beBeeDataStrategist Full time ₹ 3,11,53,900 - ₹ 4,61,20,600

    Senior Data StrategistWe are seeking an experienced Senior Data Strategist to join our team.Develop and implement data-driven strategies to drive business growth and improve decision-making capabilities.Collaborate with cross-functional teams to design, develop, and deploy scalable data solutions that meet business requirements.Architect and design...

  • Data Architect

    1 day ago

    Chennai, Tamil Nadu, India Ignitho Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Job Summary: The Senior Data Architect will lead the design and implementation of scalable, high performance data architectures across both on-premises and cloud environments. This role involves advanced data modelling, SQL development, and ETL design, with a strong focus on data quality, integrity, and strategy. The architect will collaborate closely with...

  • Data Architect

    24 hours ago

    Chennai, Tamil Nadu, India Ignitho Inc. Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Job Summary:The Senior Data Architect will lead the design and implementation of scalable, high performance data architectures across both on-premises and cloud environments. This role involves advanced data modelling, SQL development, and ETL design, with a strong focus on data quality, integrity, and strategy. The architect will collaborate closely with...

  • Chief Data Architect

    5 days ago

    Chennai, Tamil Nadu, India beBeeDataModeling Full time ₹ 1,04,000 - ₹ 1,30,878

    Senior Data Modeler Job Description We are seeking a highly skilled Senior Data Modeler to join our team. The ideal candidate will have extensive experience in data modeling, SQL, metadata management, and data governance. The successful candidate will have expertise in relational, dimensional, and analytic data modeling with hands-on experience in databases...