Data Analyst with ETL Expert

2 weeks ago

Noida, Uttar Pradesh, India Eice Technology Full time ₹ 9,00,000 - ₹ 12,00,000 per year

Responsibilities

Design, Develop, and Maintain ETL Pipelines: Create, optimize, and manage Extract, Transform, Load (ETL) processes using Python scripts and Pentaho Data Integration (Kettle) to move and transform data from various sources into target systems (e.g., data warehouses, data lakes).

Data Quality Assurance: Implement rigorous data validation, cleansing, and reconciliation procedures to ensure the accuracy, completeness, and consistency of data.

Data Sourcing and Integration: Work with diverse data sources, including relational databases (SQL Server, MySQL, PostgreSQL), flat files (CSV, Excel), APIs, and cloud platforms.

Performance Optimization: Identify and implement improvements for existing ETL processes to enhance data load times, efficiency, and scalability.

Troubleshooting and Support: Diagnose and resolve data-related issues, ensuring data integrity and timely availability for reporting and analysis.

Documentation: Create and maintain comprehensive documentation for all ETL processes, data flows, and data dictionaries.

Collaboration: Work closely with data engineers, data scientists, business analysts, and other stakeholders to understand data requirements and deliver robust data solutions.

Ad-hoc Analysis: Perform ad-hoc data analysis and provide insights to support business decisions as needed.

About the Role:

We are looking for a skilled and passionateData Engineerwith 3 to 4 years of experience in building robust ETL pipelines using both visual ETL tools (preferably Kettle/Pentaho) and Python-based frameworks. You will be responsible for designing, developing, and maintaining high-quality data workflows that support our data platforms and reporting environments.

Key Responsibilities:

Design, develop, and maintain ETL pipelines using Kettle (Pentaho) or similar tools.

Build data ingestion workflows using Python (Pandas, SQLAlchemy, psycopg2).

Extract data from relational and non-relational sources (APIs, CSV, databases).

Perform complex transformations and ensure high data quality.

Load processed data into target systems such as PostgreSQL, Snowflake, or Redshift.

Implement monitoring, error handling, and logging for all ETL jobs.

Maintain job orchestration via shell scripts, cron, or workflow tools (e.g., Airflow).

Work with stakeholders to understand data needs and deliver accurate, timely data.

Maintain documentation for pipelines, data dictionaries, and metadata.

Requirements:

3 to 4 years of experience in Data Engineering or ETL development.

Hands-on experience withKettle (Pentaho Data Integration) or similar ETL tools.

Strong proficiency in Python (including pandas, requests, datetime, etc.).

Strong SQL knowledge and experience with relational databases (PostgreSQL, SQL Server, etc.).

Experience with source control (Git), scripting (Shell/Bash), and config-driven ETL pipelines.

Good understanding of data warehousing concepts, performance optimization, and incremental loads.

Familiarity with REST APIs, JSON, XML, and flat file processing.

Good to Have:

Experience with job scheduling tools (e.g., Airflow, Jenkins).

Familiarity with cloud platforms (AWS, Azure, or GCP).

Knowledge of Data Lakes, Big Data, or real-time streaming tools is a plus.

Experience working in Agile/Scrum environments.

Soft Skills:

Strong analytical and problem-solving skills.

Self-motivated and able to work independently and in a team.

Good communication skills with technical and non-technical stakeholders.

Industry

Software Development

Employment Type

Full-time

  • Technical Analyst with ETL, GCP using Pyspark

    3 days ago

    Noida, Uttar Pradesh, India NTT DATA Global Delivery Services Ltd Full time ₹ 1,00,00,000 - ₹ 2,00,00,000 per year

    Business Consulting-Technical analyst with ETL,GCP using Pyspark Req ID: 335235 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Business Consulting-Technical analyst with...

  • Business Consulting-Technical analyst with ETL,GCP using Pyspark

    3 days ago

    Noida, Uttar Pradesh, India NTT DATA North America Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Business Consulting-Technical analyst with ETL,GCP using Pyspark to join our team in Noida, Uttar Pradesh (IN-UP), India...

  • ETL Data Engineer

    1 week ago

    Noida, Uttar Pradesh, India Lumiq Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Who we are:LUMIQ is the leading Data and Analytics company in the Financial Services and Insurance (FSI) industry. We are trusted by the world's largest FSIs, including insurers, banks, AMCs, and NBFCs, to address their data challenges. Our clients include 40+ enterprises with over $10B in deposits/AUM, collectively representing about 1B customers globally....

  • Data Analyst

    1 week ago

    Noida, Uttar Pradesh, India NTT DATA Global Delivery Services Ltd Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    Data Analyst Req ID: 338365 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Analyst to join our team in Noida, Uttar Pradesh (IN-UP), India (IN).Work with Data...

  • ETL QA

    1 week ago

    Noida, Uttar Pradesh, India Iris Software Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Key Responsibilities: Data Testing Strategy & Execution: Design, develop, and execute comprehensive test plans and test cases for data-centric applications, ETL processes, data warehouses, data lakes, and reporting solutions. SQL-Driven Validation: Utilize advanced SQL queries to perform complex data validation, data reconciliation, data integrity checks,...

  • ETL QA

    1 week ago

    Noida, Uttar Pradesh, India Iris Software Full time ₹ 6,00,000 - ₹ 12,00,000 per year

    Key Responsibilities: Data Testing Strategy & Execution: Design, develop, and execute comprehensive test plans and test cases for data-centric applications, ETL processes, data warehouses, data lakes, and reporting solutions. SQL-Driven Validation: Utilize advanced SQL queries to perform complex data validation, data reconciliation, data integrity checks,...

  • Data Analyst

    13 hours ago

    Noida, Uttar Pradesh, India TTFA Academy Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Company DescriptionTTFA Academy offers an expert-led Data Analyst Course designed to transform individuals into job-ready Data Analysts. The course combines hands-on expertise with industry-relevant experience through real-world scenarios. Students will master essential analytics tools such as Tableau, Alteryx, Power BI, SQL, and Python. The curriculum is...

  • O365 Expert

    6 days ago

    Noida, Uttar Pradesh, India Awign Expert Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Position: O365 ExpertWorking Hours: 24x7 Rotational (WFO)Work Location: NSEZ Phase 2, NoidaExperience: 10+yrsNotice Period: 0-15daysNote: Must have excellent communication skills.This role requires a deep understanding of various O365 services, security best practices, and migration procedures. The resource should demonstrate proficiency in the following...

  • Lumiq - ETL Data Engineer - Python/Numpy

    1 week ago

    Noida, Uttar Pradesh, India LUMIQ Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job PurposeWe are seeking a highly skilled ETL Data Engineer to re-engineer our existing data pipelines to extract data from a new data source (PostgreSQL / CURA system) instead of the current Microsoft SQL Server (CRM persistence store), while preserving the existing load patterns to Elasticsearch and MongoDB. The engineer will ensure this migration has...

  • ETL Tester

    15 hours ago

    Noida, Uttar Pradesh, India Iris Software Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Data Testing Strategy & Execution: Design, develop, and execute comprehensive test plans and test cases for data-centric applications, ETL processes, data warehouses, data lakes, and reporting solutions. SQL-Driven Validation: Utilize advanced SQL queries to perform complex data validation, data reconciliation, data integrity checks, and data quality...