ETL Data Engineer

2 months ago

Bangalore, India Cerebra IT Services Private Limited Full time

Job Description :


We are seeking a highly skilled ETL Data Engineer to join our team in Bangalore. The ideal candidate will have a strong background in ETL processes, along with proficiency in Python, PySpark, and SnowSQL. This role requires a hands-on professional with a proven ability to troubleshoot and optimize ETL jobs while collaborating in a cross-functional and global environment.


Key Responsibilities :


1. ETL Development & Management :


- Develop, monitor, and troubleshoot ETL jobs with a focus on performance tuning, reject handling, and ad-hoc reloads.


- Optimize ETL processes to ensure efficient data movement, transformation, and loading.


- Utilize SQL fundamentals to pull data, apply business rules, and stock target data efficiently.


2. Programming & Data Transformation :


- Write and maintain Python scripts for data transformation tasks.


- Use PySpark for complex data processing tasks (minimum of 1+ year of experience required).


3. Database & Tools Management :


- Work with SnowSQL and other database tools to manage and manipulate data.


- Provide basic AWS technical support, including job status monitoring and log analysis.


- Manage job schedules and monitoring using Control-M.


4. Documentation & Communication :


- Create clear, concise documentation for ETL processes, including operational run books and troubleshooting guides.


- Communicate effectively with cross-functional teams to resolve issues and ensure seamless operation.


5. Incident Management :


- Proactively identify and address incidents and problems, minimizing service interruptions.


- Coordinate across teams to diagnose issues and provide timely resolutions.


Qualifications :


- Experience : 6-9 years of hands-on experience in ETL processes. Certifications with less experience will also be considered.


Technical Skills :


- Proficiency in PySpark, Python, and SnowSQL.


- Strong knowledge of SQL fundamentals and the ability to write complex queries.


- Basic AWS technical skills, including job monitoring and log analysis.


- Experience with Control-M or similar job scheduling tools.


Soft Skills :


- Ability to work independently as well as in a team environment.


- Excellent communication skills with a strong ability to manage multiple tasks concurrently.


- Strong problem-solving skills with a focus on service reliability and performance optimization.


Preferred Qualifications :


- Certification in relevant ETL or data engineering technologies.


- Experience in a cloud-based data environment, particularly AWS.

(ref:hirist.tech)

  • Data Engineer

    1 month ago

    Bangalore, Karnataka, India JoulestoWatts Business Solutions Pvt Ltd Full time

    Company Description : JoulestoWatts Business Solutions is a global IT services and consulting enterprise headquartered in Texas, USA. With over 4,000 professionals serving 200+ clients across 5 countries, we are recognized as a certified Great Place to Work (GPTW). Our focus is on delivering state-of-the-art solutions across diverse domains. Role Description...

  • Data Engineer

    4 weeks ago

    Bangalore, India BlueByte Technologies Full time

    Data Engineering Role at BlueByte TechnologiesWe are seeking a highly skilled Data Engineer to join our team at BlueByte Technologies. As a key member of our data engineering team, you will be responsible for designing and developing ETL pipelines, data warehousing solutions, and complex SQL queries.Key Responsibilities:Design and Develop ETL...

  • Data Engineer

    4 weeks ago

    Bangalore, Karnataka, India DIATOZ Solutions Pvt ltd., Full time

    Role Description :This is a full-time hybrid role for a Data Engineer at DIATOZ. The Data Engineer will be responsible for tasks such as data engineering, data modeling, ETL processes, data warehousing, and data analytics. The role is primarily located in Bengaluru with flexibility for remote work.Experience : 2.5 to 5 yearsKey Responsibilities : Data...

  • Senior Data Engineer

    2 months ago

    Bangalore, Karnataka, India ScaleOrange Technologies Pvt Ltd Full time

    Company Description : ScaleOrange Technologies Pvt Ltd. Role Description : This is a full-time on-site role for a Senior Data Engineer with 5+ years of experience at ScaleOrange Technologies Pvt Ltd in Hyderabad. The Senior Data Engineer will be responsible for data engineering, data modeling, ETL processes, data warehousing, and data analytics on a...

  • Data Engineer

    4 weeks ago

    Bangalore/Chennai, India MNR Solutions Full time

    We are seeking a skilled Data Engineer with 3+ years of experience to join our team in Bangalore or Chennai. The ideal candidate will have a strong background in working with Google Cloud Platform (GCP) and experience in building and managing data pipelines, processing large datasets, and optimizing ETL processes. This role requires proficiency in...

  • Data Engineer

    1 month ago

    Bangalore, Karnataka, India TalentXO Full time

    Role & Responsibilities :- Design, develop, and maintain scalable data pipelines to extract, transform, and load (ETL) data from various sources into our data warehouse- Optimize and tune SQL queries for improved performance and efficiency- Collaborate with data scientists, analysts, and product managers to understand data requirements and deliver...

  • Data Engineer

    1 month ago

    Bangalore, Karnataka, India Recruit Elite Full time

    Role & Responsibilities : - Design, develop, and maintain scalable data pipelines to extract, transform, and load (ETL) data from various sources into our data warehouse- Optimize and tune SQL queries for improved performance and efficiency- Collaborate with data scientists, analysts, and product managers to understand data requirements and deliver...

  • Data Engineer

    2 months ago

    Bangalore, Karnataka, India Liftu Full time

    Key roles and responsibilities : - Design and development of scalable data pipelines and ETL processes to process and transform large volumes of data efficiently. - Define and implement data integration solutions to consolidate data from multiple sources into a unified view, ensuring data consistency and accuracy. - Optimize data delivery and performance by...

  • Data Engineer

    4 weeks ago

    Bangalore/Gurgaon/Gurugram, IN InstaTalent Recruit LLP Full time

    Data Engineer (Snowflake). Required : Insta Talent Reruit LLP, a leading company in the None industry, is seeking a skilled Data Engineer to join our dynamic team. In this role, you will be responsible for building and running the data pipelines and services that are required to support business functions, reports, and dashboards. We heavily rely on...

  • Brillio - Data Engineer - ETL/SQL

    4 weeks ago

    Bangalore/Pune, India Brillio Technologies Pvt. Ltd Full time

    Job Title: Data EngineerLocation : Bangalore / Pune (Hybrid Mode)Employment Type : Full-Time (Direct Payroll with Brillio)Notice Period : 15-20 Days / Immediate Joiners PreferredJob Summary :Brillio is seeking a talented and experienced Data Engineer to join our dynamic team. The ideal candidate will have strong expertise in PySpark, Advanced SQL, and ETL...

  • Data Engineer

    2 months ago

    Bangalore, Karnataka, India Coders Brain Technology Private Limited Full time

    Position Name : Data EngineerExperience Required : 4-10 YearsNotice Period : Immediate Joiner Work Mode : HybridLocation : BangaloreMust Have : Data engineer with Knowledge of Graph, SQL, No SQL, Python or ScalaGood to have: AI/ Overview :We are seeking a highly skilled and experienced Senior Data Engineer to enhance our data processing capabilities and...

  • Data Engineer

    2 months ago

    Bangalore, Karnataka, India ALCHEMY TECHSOL INDIA PRIVATE LIMITED Full time

    Role : Data Engineer ( ETL) Experience : Minimum 5 years of relevant experience.Shift : GeneralModel : Hybrid - Base location will be Client office in Bagmane Teck Park - CV Raman Nagar, BangaloreNotice Period : Immediate - 15 days.About the Role :Job Summary :- 5 - 6 years of experience in Data management & engineering projects using Informatica products -...

  • AWS Data Engineer

    1 month ago

    Bangalore/Noida, IN Firstcareercentre Full time

    Job Summary :We are seeking a highly skilled and experienced AWS Data Engineer to join our data team. The AWS Data Engineer will be responsible for designing, developing, and optimizing data pipelines, integrating various data sources, and implementing AWS cloud solutions. The ideal candidate should have a strong background in data engineering, cloud...

  • ETL Lead

    1 month ago

    Bangalore, Karnataka, India ResourceTree Global Services Full time

    Role : Senior Software Engineer / Tech Lead - ETL (Application & : ETL tools like Talend/Pentaho/Informatica/Datastage, Strong with Data Ware House (DWH) Concept s, SQL ,BI : 5-10 : Bangalore (Hybrid)Job Description :- Responsible for End-to-end System/Technical Design & Architecture (Application & Infrastructure) experience. - Designing, developing and...

  • Senior ETL Developer

    4 weeks ago

    Bangalore, India Lancesoft India Pvt Ltd Full time

    We are seeking an exceptional Senior ETL Developer to play a crucial role in designing, developing, and optimizing ETL processes at Lancesoft India Pvt Ltd.The ideal candidate will have a strong foundation in T-SQL, ETL tools, and RDBMS concepts, along with a passion for data engineering and a commitment to delivering high-quality solutions.Key...

  • Data Engineer II

    4 weeks ago

    Bangalore, India Arting Digital Full time

    SALARY : 15LPA - 20LPA Posting title : Data Engineer II Experience : 6+ Years Location : Bangalore Work mode : Hybrid Primary skills : ETL, Data Warehousing, Reporting, SQL, Azure services such as Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure Storage, etc.Qualification : Any Engineering/ Computers degreeRoles & Responsibilities : -...

  • Senior Data Engineer

    1 month ago

    Bangalore, India PureSoftware Pvt Ltd. Full time

    Job Title: Senior Data Engineer - ETL/PySpark SpecialistJob Summary:We are seeking a highly skilled Senior Data Engineer to join our team at PureSoftware Pvt Ltd. As a Senior Data Engineer, you will be responsible for designing, developing, and delivering complex data pipelines using Azure Databricks and Azure Data Factory.Key Responsibilities:Design and...

  • Data Engineering Manager

    1 month ago

    Bangalore, Karnataka, India Wenger & Watson Inc. Full time

    Industry : General Insurance. Role : Data Engineering Manager. Years of Experience : 12-15 Years. Location : Banglore(koramangala). Work mode : WFO(1st and last saturday working half day). Other location : candidate willing to relocate. Purpose : This role will own the data ingestion, storage, and engineering processes and functions on the data platform. The...

  • ETL Production Support Engineer

    2 months ago

    Bangalore, India TecQubes Technologies Full time

    Role and Responsibilities : - Provide expert support for ETL processes built on Azure Data Factory (ADF) and Azure Databricks (ADB).- Diagnose and resolve complex ETL issues, ensuring the smooth execution of data pipelines. - Leverage strong SQL skills to query, manipulate, and analyze data. - Demonstrate a deep understanding of the Azure platform, including...

  • Brillio Data Engineer ETL/SQL Professional

    4 weeks ago

    Bangalore/Pune, India Brillio Technologies Pvt. Ltd Full time

    Job Title: Data EngineerBrillio is seeking a talented Data Engineer to join our dynamic team. The ideal candidate will have strong expertise in PySpark, Advanced SQL, and ETL testing, with hands-on experience using Databricks for pipeline creation or migration.Candidates with a background in either Azure or AWS will be given preference. This role offers a...