Data Analyst with ETL Expert

2 weeks ago

Noida, Uttar Pradesh, India Eice Technology Full time ₹ 9,00,000 - ₹ 12,00,000 per year

Responsibilities

Design, Develop, and Maintain ETL Pipelines: Create, optimize, and manage Extract, Transform, Load (ETL) processes using Python scripts and Pentaho Data Integration (Kettle) to move and transform data from various sources into target systems (e.g., data warehouses, data lakes).

Data Quality Assurance: Implement rigorous data validation, cleansing, and reconciliation procedures to ensure the accuracy, completeness, and consistency of data.

Data Sourcing and Integration: Work with diverse data sources, including relational databases (SQL Server, MySQL, PostgreSQL), flat files (CSV, Excel), APIs, and cloud platforms.

Performance Optimization: Identify and implement improvements for existing ETL processes to enhance data load times, efficiency, and scalability.

Troubleshooting and Support: Diagnose and resolve data-related issues, ensuring data integrity and timely availability for reporting and analysis.

Documentation: Create and maintain comprehensive documentation for all ETL processes, data flows, and data dictionaries.

Collaboration: Work closely with data engineers, data scientists, business analysts, and other stakeholders to understand data requirements and deliver robust data solutions.

Ad-hoc Analysis: Perform ad-hoc data analysis and provide insights to support business decisions as needed.

About the Role:

We are looking for a skilled and passionateData Engineerwith 3 to 4 years of experience in building robust ETL pipelines using both visual ETL tools (preferably Kettle/Pentaho) and Python-based frameworks. You will be responsible for designing, developing, and maintaining high-quality data workflows that support our data platforms and reporting environments.

Key Responsibilities:

Design, develop, and maintain ETL pipelines using Kettle (Pentaho) or similar tools.

Build data ingestion workflows using Python (Pandas, SQLAlchemy, psycopg2).

Extract data from relational and non-relational sources (APIs, CSV, databases).

Perform complex transformations and ensure high data quality.

Load processed data into target systems such as PostgreSQL, Snowflake, or Redshift.

Implement monitoring, error handling, and logging for all ETL jobs.

Maintain job orchestration via shell scripts, cron, or workflow tools (e.g., Airflow).

Work with stakeholders to understand data needs and deliver accurate, timely data.

Maintain documentation for pipelines, data dictionaries, and metadata.

Requirements:

3 to 4 years of experience in Data Engineering or ETL development.

Hands-on experience withKettle (Pentaho Data Integration) or similar ETL tools.

Strong proficiency in Python (including pandas, requests, datetime, etc.).

Strong SQL knowledge and experience with relational databases (PostgreSQL, SQL Server, etc.).

Experience with source control (Git), scripting (Shell/Bash), and config-driven ETL pipelines.

Good understanding of data warehousing concepts, performance optimization, and incremental loads.

Familiarity with REST APIs, JSON, XML, and flat file processing.

Good to Have:

Experience with job scheduling tools (e.g., Airflow, Jenkins).

Familiarity with cloud platforms (AWS, Azure, or GCP).

Knowledge of Data Lakes, Big Data, or real-time streaming tools is a plus.

Experience working in Agile/Scrum environments.

Soft Skills:

Strong analytical and problem-solving skills.

Self-motivated and able to work independently and in a team.

Good communication skills with technical and non-technical stakeholders.

Industry

Software Development

Employment Type

Full-time

  • Business Consulting-Technical analyst with ETL,GCP using Pyspark

    4 days ago

    Noida, Uttar Pradesh, India NTT DATA North America Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Business Consulting-Technical analyst with ETL,GCP using Pyspark to join our team in Noida, Uttar Pradesh (IN-UP), India...

  • ETL Data Engineer

    2 weeks ago

    Noida, Uttar Pradesh, India Lumiq Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Who we are:LUMIQ is the leading Data and Analytics company in the Financial Services and Insurance (FSI) industry. We are trusted by the world's largest FSIs, including insurers, banks, AMCs, and NBFCs, to address their data challenges. Our clients include 40+ enterprises with over $10B in deposits/AUM, collectively representing about 1B customers globally....

  • Data Analyst

    1 week ago

    Noida, Uttar Pradesh, India NTT DATA Global Delivery Services Ltd Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    Data Analyst Req ID: 338365 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Analyst to join our team in Noida, Uttar Pradesh (IN-UP), India (IN).Work with Data...

  • ETL QA

    1 week ago

    Noida, Uttar Pradesh, India Iris Software Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Key Responsibilities: Data Testing Strategy & Execution: Design, develop, and execute comprehensive test plans and test cases for data-centric applications, ETL processes, data warehouses, data lakes, and reporting solutions. SQL-Driven Validation: Utilize advanced SQL queries to perform complex data validation, data reconciliation, data integrity checks,...

  • Data Analyst

    2 days ago

    Noida, Uttar Pradesh, India TTFA Academy Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Company DescriptionTTFA Academy offers an expert-led Data Analyst Course designed to transform individuals into job-ready Data Analysts. The course combines hands-on expertise with industry-relevant experience through real-world scenarios. Students will master essential analytics tools such as Tableau, Alteryx, Power BI, SQL, and Python. The curriculum is...

  • Lumiq - ETL Data Engineer - Python/Numpy

    2 weeks ago

    Noida, Uttar Pradesh, India LUMIQ Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job PurposeWe are seeking a highly skilled ETL Data Engineer to re-engineer our existing data pipelines to extract data from a new data source (PostgreSQL / CURA system) instead of the current Microsoft SQL Server (CRM persistence store), while preserving the existing load patterns to Elasticsearch and MongoDB. The engineer will ensure this migration has...

  • O365 Expert

    1 week ago

    Noida, Uttar Pradesh, India Awign Expert Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Position: O365 ExpertWorking Hours: 24x7 Rotational (WFO)Work Location: NSEZ Phase 2, NoidaExperience: 10+yrsNotice Period: 0-15daysNote: Must have excellent communication skills.This role requires a deep understanding of various O365 services, security best practices, and migration procedures. The resource should demonstrate proficiency in the following...

  • ETL Tester

    2 days ago

    Noida, Uttar Pradesh, India Iris Software Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Data Testing Strategy & Execution: Design, develop, and execute comprehensive test plans and test cases for data-centric applications, ETL processes, data warehouses, data lakes, and reporting solutions. SQL-Driven Validation: Utilize advanced SQL queries to perform complex data validation, data reconciliation, data integrity checks, and data quality...

  • Sr Data Analyst

    9 hours ago

    Noida, Uttar Pradesh, India GBS Full time ₹ 2,00,000 - ₹ 6,00,000 per year

    Role Overview: As a Power BI Developer/Analyst, your primary responsibility will be to design, develop, and deploy business intelligence reports using Microsoft's Power BI. You will collaborate closely with stakeholders to gather requirements, create data models, and present insights through reports and dashboards. Key Responsibilities: - Develop and...

  • Data Analyst

    6 days ago

    Noida, Uttar Pradesh, India Iris Software Inc. Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    Why Join Iris?Are you ready to do the best work of your career at one ofIndia's Top 25 Best Workplaces in IT industry? Do you want to grow in an award-winning culture thattruly values your talent and ambitions?Join Iris Software — one of thefastest-growing IT services companies— whereyou own and shape your success story.About UsAt Iris Software, our...