ETL Engineer

4 weeks ago

Hyderabad, Telangana, India Welspun Transformation Services Limited Full time
Job Description

As an ETL Engineer, you will be a part of our dynamic Information Technology team. You will be responsible for designing, developing, and supporting ETL solutions using Python, Pyspark, SQL, and Azure. You will be working closely with various stakeholders to gather and define data requirements, and will be instrumental in the design and implementation of data extraction, transformation, and load (ETL) processes.

Responsibilities of ETL Engineer

- Design, develop, and maintain ETL processes using Python, Pyspark, SQL, and Azure.
- Collaborate with various stakeholders to understand and define data requirements.
- Develop and implement ETL procedures for data migration and integration.
- Ensure the accuracy and integrity of data through the design and implementation of appropriate error handling processes.
- Perform data quality checks, validation, and performance tuning.
- Collaborate with data architects and modelers to design and implement data models.
- Develop and maintain technical documentation related to ETL processes.
- Troubleshoot and resolve any issues related to ETL processes.
- Stay updated with the latest ETL and data warehousing trends and technologies.
- Special emphasis on working with cloud platforms like AWS, GCP.
- The ideal candidate should have strong analytical thinking skills, excellent communication management abilities, and a positive attitude. Experience with AWS and GCP will be highly valued.

Functional Competencies

- ETL: The candidate should have a strong understanding of ETL (Extract, Transform, Load) processes and be able to design and implement complex data pipelines. This includes the ability to extract data from various sources, transform it to fit business needs, and load it into the end system.
- Python: Proficiency in Python is required as it is one of the most commonly used programming languages in data engineering. The candidate should be able to write efficient, reusable, and reliable Python code.
- PySpark: The candidate should have experience with PySpark, the Python library for Apache Spark. This includes the ability to use PySpark for big data processing and analytics.
- SQL: The candidate should have a strong understanding of SQL (Structured Query Language) and be able to write complex queries to manipulate and analyze data.
- Azure: Experience with Azure, Microsoft's cloud computing service, is required. The candidate should be familiar with its data storage and processing services.

Behavioral Competencies

- Analytical Thinking: The candidate should have strong analytical skills, including the ability to analyze complex data sets and derive insights from them.
- Communication Management: The candidate should have excellent communication skills, including the ability to clearly explain complex technical concepts to nontechnical stakeholders.
- Positive Attitude: The candidate should have a positive attitude and be able to maintain a positive work environment, even in challenging situations.

Good to have skills

- AWS: The candidate should have experience with AWS (Amazon Web Services), Amazon's cloud computing service. This includes familiarity with its data storage and processing services.
- GCP: The candidate should have experience with GCP (Google Cloud Platform), Google's cloud computing service. This includes familiarity with its data storage and processing services.

Employee type: FullTime

Work Location: Hyderabad

  • ETL Engineer

    2 weeks ago

    Hyderabad, Telangana, India Welspun Transformation Services Limited Full time

    Job Description As an ETL Engineer, you will be a part of our dynamic Information Technology team. You will be responsible for designing, developing, and supporting ETL solutions using Python, Pyspark, SQL, and Azure. You will be working closely with various stakeholders to gather and define data requirements, and will be instrumental in the design and...

  • ETL Testing

    4 weeks ago

    Hyderabad, Telangana, India ValueMomentum Full time

    About the jobPrimary skills: ETL Testing with Python\PySparkExperience: 5 -7 YearsAbout the CompanyAt ValueMomentum's Engineering Center, we are a team of passionate engineers who thrive on tackling complex business challenges with innovative solutions while transforming the P&C insurance value chain. We achieve this through strong engineering foundation and...

  • ETL Testing

    2 weeks ago

    Hyderabad, Telangana, India ValueMomentum Full time

    About the job Primary skills: ETL Testing with Python\PySpark Experience: 5 -7 Years About the Company At ValueMomentum's Engineering Center, we are a team of passionate engineers who thrive on tackling complex business challenges with innovative solutions while transforming the P&C insurance value chain. We achieve this through strong engineering...

  • ETL Tester

    3 weeks ago

    Hyderabad, Telangana, India ValueMomentum Full time

    Job Title: ETL Test EngineerPrimary skills: #Informatica Tester #ETL Tester #Automation TestingLocation: Hyderabad/Pune/CoimbatoreMode of work: Work from OfficeExperience: 3 to 7 yearsAbout the job:We are seeking a highly skilled Senior ETL Test Engineer to join our data team. The ideal candidate will bring expertise in working with large datasets,...

  • ETL Tester

    2 weeks ago

    Hyderabad, Telangana, India Spruce IT Pvt. Ltd. Full time

    Responsibilities : - Analyze business requirements, technical specifications, and ETL mappings to design test plans and test cases.- Perform ETL testing including data validation, data transformation, and reconciliation.- Validate data flows between source systems, staging, and data warehouse/data marts.- Write and execute complex SQL queries to verify data...

  • Principal Consultant – Etl And Engineering Specialist

    3 weeks ago

    Hyderabad, Telangana, India GENPACT Full time

    Genpact NYSE G is a global professional services and solutions firm delivering outcomes that shape the future Our 125 000 people across 30 countries are driven by our innate curiosity entrepreneurial agility and desire to create lasting value for clients Powered by our purpose the relentless pursuit of a world that works better for people we serve...

  • ETL Tester

    3 weeks ago

    Hyderabad, Telangana, India Sonata Software Full time

    Job DescriptionETL TesterKey Responsibilities:- Develop, execute, and maintain ETL test plans and test cases based on project requirements and specifications.- Validate data extraction, transformation, and loading processes across multiple sources and target systems such as data warehouses and data lakes.- Identify, document, and report defects within the...

  • ETL Developer

    4 weeks ago

    Hyderabad, Telangana, India Sonata Software Full time

    Job DescriptionProfile Summary:Experienced Data Engineer with a strong focus on real-time data ingestion and streaming solutions. Skilled in designing and implementing robust, scalable pipelines for high-velocity data using Apache Kafka, AWS Cloud streaming tools, and ETL frameworks. Proven expertise in handling semi-structured data formats such as JSON and...

  • ETL Testing Role

    2 days ago

    Hyderabad, Telangana, India Talent Worx Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Position: ETL Testing RoleWe are excited to announce an opening for an ETL Testing Role at Talent Worx. The successful candidate will focus on validating ETL processes to ensure high data quality and integrity throughout our data pipelines. You will collaborate with data teams to ensure that data is accurately extracted, transformed, and loaded from a...

  • ETL Tester

    3 weeks ago

    Hyderabad, Telangana, India Tata Consultancy Services Full time

    Greeting from TCSTCS has been a great pioneer in feeding the fire of young Techies like you. We are a global leader in the technology arena and there's nothing that can stop us from growing together.Your role is of key importance, as it lays down the foundation for the entire project.Make sure you have a valid EP number before interview. To create an EP...