Data Engineering Automation Specialist

1 day ago

Noida, Uttar Pradesh, India beBeeData Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

As a data automation expert, you will play a critical role in ensuring that our data solutions are of the highest quality. You will work closely with data engineers and analysts to develop, implement, and maintain automated testing frameworks for data validation, ETL processes, data quality, and integration. Your work will ensure that data is accurate, consistent, and performs optimally across our data warehouse systems.

Responsibilities

  • Data Validation Automation: Design, build, and maintain scalable test automation frameworks tailored for data warehousing environments.
  • Test Strategy and Execution: Define and execute automated test strategies for ETL processes, data pipelines, and database integration across a variety of data sources.
  • Data Transformation Logic: Implement automated tests to validate data consistency, accuracy, completeness, and transformation logic.
  • Performance Optimization: Ensure that the data warehouse systems meet performance benchmarks through automation tools and load testing strategies.
  • Collaboration and Communication: Work closely with data engineers, software developers, and data analysts to understand business requirements and design tests accordingly.
  • Continuous Integration and Deployment: Integrate automated tests into the CI/CD pipelines, ensuring that testing is part of the deployment process.
  • Defect Tracking and Reporting: Use defect-tracking tools (e.g., JIRA) to log and track issues found during automated testing, ensuring that defects are resolved in a timely manner.
  • Test Data Management: Develop strategies for handling large volumes of test data while maintaining data security and privacy.
  • Tool and Technology Evaluation: Stay current with emerging trends in automation testing for data warehousing and recommend tools, frameworks, and best practices.

Requirements and Skills

Experience and Knowledge

We require at least 4+ years of experience in building and maintaining automation frameworks using tools like Python, Java, or similar, with a focus on database and ETL testing. Strong knowledge of SQL is necessary for writing complex queries to validate data, test data pipelines, and check transformations. Experience with ETL tools (e.g., Matillion, Qlik Replicate) and their testing processes is also required.

Key Skills and Qualifications

  • SQL and Database Testing
  • ETL Tools and Technologies
  • Automation Frameworks and Tools
  • Version Control Systems
  • Performance Testing and Optimization
  • Strong Analytical and Problem-Solving Skills
  • Excellent Communication and Collaboration Skills
  • Attention to Detail and Passion for Quality

Desired Skills and Technologies

  • QLIK Replicate
  • Matillion ETL
  • Snowflake
  • Data Vault Warehouse Design
  • Power BI
  • Azure Cloud – Including Logic App, Azure Functions, ADF

  • Data Engineer

    1 day ago

    Noida, Uttar Pradesh, India NTT DATA Full time

    Req ID 303115NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Data Engineer to join our team in Noida Uttar Pradesh IN-UP India IN Job Duties As a data engineer you will have a...

  • Data Engineering Specialist

    1 day ago

    Noida, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Data Engineering SpecialistAre you passionate about designing, building and maintaining scalable data pipelines? Do you have a strong background in data engineering, ETL development and backend data systems?Key Responsibilities:Design & Build Scalable Data Pipelines:Collaborate with Cross-Functional Teams:Optimize Data Systems:Data Quality...

  • Systems Engineering Specialist

    2 weeks ago

    Noida, Uttar Pradesh, India NTT Data Full time

    Job DescriptionNTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Systems Engineering Specialist to join our team.At NTT DATA, we know that with the right people on board, anything is...

  • Automation and Analytics Specialist

    2 days ago

    Noida, Uttar Pradesh, India EXL Full time

    Introduction: We are seeking a talented individual to join our team as an Automation and Analytics Specialist. This role will focus on developing automated processes and using data analytics / data science to improve business operations. You will be responsible for collecting, analyzing, and visualizing data, as well as developing and maintaining automated...

  • Senior Data Warehousing Automation Specialist

    1 day ago

    Noida, Uttar Pradesh, India beBeeDataWarehousing Full time ₹ 18,00,000 - ₹ 25,00,000

    Data Warehousing Test Engineer JobWe are seeking an experienced data warehousing test engineer to join our team. In this role, you will be responsible for designing, building, and maintaining scalable test automation frameworks tailored for data warehousing environments.

  • Devsecops Engineer

    4 weeks ago

    Noida, Uttar Pradesh, India NTT DATA Full time

    Req ID 312238NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a DevSecOps Engineer to join our team in Noida Uttar Pradesh IN-UP India IN Application Security AppSec Role1 ...

  • Cisco - Network Engineering Senior Specialist

    4 weeks ago

    Noida, Uttar Pradesh, India NTT DATA Full time

    Req ID 305465 NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Cisco - Network Engineering Senior Specialist to join our team in Noida Uttar Pradesh IN-UP India IN JOB...

  • ETL Automation Engineer

    2 days ago

    Noida, Uttar Pradesh, India Strategic Talent Partner Full time

    As a QA Automation Engineer specializing in Data Warehousing, you will play a critical role in ensuring that our data solutions are of the highest quality. You will work closely with data engineers and analysts to develop, implement, and maintain automated testing frameworks for data validation, ETL processes, data quality, and integration. Your work will...

  • Systems Engineering Senior Specialist

    1 day ago

    Noida, Uttar Pradesh, India NTT Data Full time

    Job DescriptionReq ID:312858NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Systems Engineering Senior Specialist - SCCM to join our team in Noida, Uttar Pradesh (IN-UP), India...

  • Building Automation Specialist

    2 days ago

    Noida, Uttar Pradesh, India beBeeBuilding Full time ₹ 8,00,000 - ₹ 12,00,000

    Technical Support Specialist for BuildingsWe are seeking a highly skilled Technical Support Specialist to join our team. This role will be part of our digital transformation initiative in buildings.The successful candidate will provide technical support for building automation systems, including Building Management Systems (BMS), IoT sensors, and energy...