Senior Data Architect/Engineer Position Available

2 days ago

Chennai, Tamil Nadu, India beBeeDataDeveloper Full time ₹ 15,00,000 - ₹ 25,00,000
ETL Developer Job Summary

Seeking a highly skilled ETL developer to design and develop efficient data pipelines.

Key Responsibilities:
  • 1. Data Pipeline Development: Develop scalable, modular data pipelines that extract, transform, and load data between systems.
  • Translate business requirements into technical solutions using data flow and control flow logic.
  • Develop reusable components that support configuration-driven architecture.
  • 2. Data Integration and Transformation: Integrate data from multiple heterogeneous sources such as SQL Server, flat files, APIs, Excel, etc.
  • Implement business rules and data transformations including cleansing, standardization, enrichment, and deduplication.
  • Manage incremental loads, full loads, and slowly changing dimensions (SCD) as required.
  • 3. SQL and Database Development: Write complex queries, stored procedures, and functions to support data transformations and staging logic.
  • Perform joins, unions, aggregations, filtering, and windowing operations effectively for data preparation.
  • Ensure referential integrity and proper indexing for performance.
  • 4. Performance Tuning: Optimize data pipelines by tuning buffer sizes, using parallelism, and minimizing unnecessary transformations.
  • Tune SQL queries and monitor execution plans for efficient data movement and transformation.
  • Implement efficient data loads for high-volume environments.
  • 5. Error Handling and Logging: Develop error-handling mechanisms and event logging in SSIS using Event Handlers and custom logging frameworks.
  • Implement restartability, checkpoints, and failure notifications in workflows.
  • 6. Testing and Quality Assurance: Conduct unit and integration testing of ETL pipelines.
  • Validate data outputs against source and business rules.
  • Support QA teams in user acceptance testing (UAT) and defect resolution.
  • 7. Deployment and Scheduling: Package, deploy, and version SSIS solutions across development, test, and production environments.
  • Schedule ETL jobs using SQL Server Agent or enterprise job schedulers.
  • Monitor and troubleshoot job failures and performance issues.
  • 8. Documentation and Maintenance: Maintain documentation for ETL designs, data flow diagrams, transformation logic, and job schedules.
  • Update job dependencies and maintain audit trails for data pipelines.
  • 9. Collaboration and Communication: Collaborate with data architects, business analysts, and reporting teams to understand data needs.
  • Provide technical support and feedback during requirements analysis and post-deployment support.
  • Participate in sprint planning, status reporting, and technical reviews.
  • 10. Compliance and Best Practices: Ensure ETL processes comply with data governance, security, and privacy regulations.
  • Follow team coding standards, naming conventions, and deployment protocols.

  • Senior Data Architect Position Available

    5 days ago

    Chennai, Tamil Nadu, India beBeeData Full time US$ 1,04,000 - US$ 1,30,878

    Unlock Your Potential as a Data ArchitectWe are seeking an experienced Data Architect to join our team. As a key member of our organization, you will be responsible for designing and developing scalable data pipelines using AWS services.Design and develop efficient data architectures that meet business requirements.Collaborate with cross-functional teams to...

  • Senior Data Engineer

    3 days ago

    Chennai, Tamil Nadu, India Eucloid Data Solutions Full time US$ 1,50,000 - US$ 2,00,000 per year

    About The Role:Eucloid is looking for a senior Data Engineer with hands-on expertise in Databricks to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which may include starting from up- stream and down-stream...

  • Enterprise Data Solutions Architect

    6 days ago

    Chennai, Tamil Nadu, India beBeeDataArchitect Full time ₹ 1,80,00,000 - ₹ 2,25,00,000

    Senior Data Architect PositionWe are seeking a seasoned Senior Data Architect to lead the design, development and maintenance of our enterprise data & analytics platform.This role involves designing and implementing scalable data solutions while providing strategic direction and leadership to cross-functional teams.Lead the architecture, implementation and...

  • Senior Data Architect Position

    1 week ago

    Chennai, Tamil Nadu, India beBeeDataArchitect Full time US$ 1,07,360 - US$ 1,37,200

    Job DescriptionWe are seeking an experienced Data Architect to lead our global data engineering team in a greenfield multi-year project initiative.The ideal candidate will bring expertise in designing and implementing large-scale datasets, scalable data pipelines, and efficient data processing code.This role offers opportunities for growth and development...

  • Senior Data Architect

    1 hour ago

    Chennai, Tamil Nadu, India beBeeDataArchitect Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Senior Data ArchitectThe position of Senior Data Architect is a challenging opportunity to take on a leadership role in the development and implementation of cutting-edge data solutions.As a seasoned professional with extensive experience in designing and implementing large-scale data architectures, you will play a key part in driving our...

  • Data Architect and Engineering Manager

    1 week ago

    Chennai, Tamil Nadu, India beBeeDataArchitecture Full time ₹ 1,80,00,000 - ₹ 2,20,00,000

    Data Architect and Engineering ManagerWe are seeking an accomplished Data Architect and Engineering Manager to lead our data engineering initiatives. This senior role will oversee the design, development, and implementation of large-scale data processing systems.Key Responsibilities:Develop and implement scalable data architecture designs using Python, AWS,...

  • Data Architect

    3 hours ago

    Chennai, Tamil Nadu, India Wavicle Data Solutions Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Job Title: Data Architect – AWS & GCP Experience: 11 Years Location: Remote / Hybrid Job Type: Full-timeAbout the Role:We are seeking an experienced Data Architect with deep expertise in AWS and Google Cloud Platform (GCP). The ideal candidate will have a proven track record in designing and implementing scalable, secure, and high-performance data...

  • Vehicle ADAS Engineer Position Available

    1 week ago

    Chennai, Tamil Nadu, India beBeeadas Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job TitleVehicle ADAS Engineer Position Available

  • Data Architect Position

    7 days ago

    Chennai, Tamil Nadu, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Data Architect PositionAbout the RoleWe are seeking a highly skilled data professional to oversee end-to-end data pipeline development and management for our financial datasets.Design, develop, and manage large-scale data pipelines for stocks, crypto, and other financial data sources.Integrate third-party APIs and data feeds into our internal systems.Create...

  • Senior Data Engineer

    2 days ago

    Chennai, Tamil Nadu, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    A senior data engineering position is available to lead the design and implementation of large-scale data processing systems using Spark, Scala, and PySpark.Key responsibilities include requirement analysis, coding using Spark and Scala based on given requirements, unit testing and deployment of changes in higher environments, fixing bugs or errors, and...