ETL Data Engineer

3 weeks ago


Bangalore, Karnataka, India Cerebra IT Services Private Limited Full time

Job Description :


We are seeking a highly skilled ETL Data Engineer to join our team in Bangalore. The ideal candidate will have a strong background in ETL processes, along with proficiency in Python, PySpark, and SnowSQL. This role requires a hands-on professional with a proven ability to troubleshoot and optimize ETL jobs while collaborating in a cross-functional and global environment.


Key Responsibilities :


1. ETL Development & Management :


- Develop, monitor, and troubleshoot ETL jobs with a focus on performance tuning, reject handling, and ad-hoc reloads.


- Optimize ETL processes to ensure efficient data movement, transformation, and loading.


- Utilize SQL fundamentals to pull data, apply business rules, and stock target data efficiently.


2. Programming & Data Transformation :


- Write and maintain Python scripts for data transformation tasks.


- Use PySpark for complex data processing tasks (minimum of 1+ year of experience required).


3. Database & Tools Management :


- Work with SnowSQL and other database tools to manage and manipulate data.


- Provide basic AWS technical support, including job status monitoring and log analysis.


- Manage job schedules and monitoring using Control-M.


4. Documentation & Communication :


- Create clear, concise documentation for ETL processes, including operational run books and troubleshooting guides.


- Communicate effectively with cross-functional teams to resolve issues and ensure seamless operation.


5. Incident Management :


- Proactively identify and address incidents and problems, minimizing service interruptions.


- Coordinate across teams to diagnose issues and provide timely resolutions.


Qualifications :


- Experience : 6-9 years of hands-on experience in ETL processes. Certifications with less experience will also be considered.


Technical Skills :


- Proficiency in PySpark, Python, and SnowSQL.


- Strong knowledge of SQL fundamentals and the ability to write complex queries.


- Basic AWS technical skills, including job monitoring and log analysis.


- Experience with Control-M or similar job scheduling tools.


Soft Skills :


- Ability to work independently as well as in a team environment.


- Excellent communication skills with a strong ability to manage multiple tasks concurrently.


- Strong problem-solving skills with a focus on service reliability and performance optimization.


Preferred Qualifications :


- Certification in relevant ETL or data engineering technologies.


- Experience in a cloud-based data environment, particularly AWS.

(ref:hirist.tech)
  • Data Engineer

    4 days ago


    Bangalore, Karnataka, India JoulestoWatts Business Solutions Pvt Ltd Full time

    Company Description : JoulestoWatts Business Solutions is a global IT services and consulting enterprise headquartered in Texas, USA. With over 4,000 professionals serving 200+ clients across 5 countries, we are recognized as a certified Great Place to Work (GPTW). Our focus is on delivering state-of-the-art solutions across diverse domains. Role Description...

  • Senior Data Engineer

    3 weeks ago


    Bangalore, Karnataka, India ScaleOrange Technologies Pvt Ltd Full time

    Company Description : ScaleOrange Technologies Pvt Ltd. Role Description : This is a full-time on-site role for a Senior Data Engineer with 5+ years of experience at ScaleOrange Technologies Pvt Ltd in Hyderabad. The Senior Data Engineer will be responsible for data engineering, data modeling, ETL processes, data warehousing, and data analytics on a...

  • Data Engineer

    3 days ago


    Bangalore, Karnataka, India TalentXO Full time

    Role & Responsibilities :- Design, develop, and maintain scalable data pipelines to extract, transform, and load (ETL) data from various sources into our data warehouse- Optimize and tune SQL queries for improved performance and efficiency- Collaborate with data scientists, analysts, and product managers to understand data requirements and deliver...

  • Data Engineer

    3 days ago


    Bangalore, Karnataka, India Recruit Elite Full time

    Role & Responsibilities : - Design, develop, and maintain scalable data pipelines to extract, transform, and load (ETL) data from various sources into our data warehouse- Optimize and tune SQL queries for improved performance and efficiency- Collaborate with data scientists, analysts, and product managers to understand data requirements and deliver...

  • Data Engineer

    3 weeks ago


    Bangalore, Karnataka, India Liftu Full time

    Key roles and responsibilities : - Design and development of scalable data pipelines and ETL processes to process and transform large volumes of data efficiently. - Define and implement data integration solutions to consolidate data from multiple sources into a unified view, ensuring data consistency and accuracy. - Optimize data delivery and performance by...

  • ETL Developer

    1 week ago


    Bangalore, Karnataka, India Zenotis Group Full time

    Job Requirement :- Develop and Maintain ETL Pipelines : Design, develop, and implement scalable ETL workflows using PySpark, Python, and AWS Glue, Databricks.- Data Transformation and Integration : Extract, transform, and load data from various sources to AWS S3 and Redshift.- Performance Optimization : Identify and resolve performance bottlenecks in ETL...

  • Data Engineer

    3 weeks ago


    Bangalore, Karnataka, India Coders Brain Technology Private Limited Full time

    Position Name : Data EngineerExperience Required : 4-10 YearsNotice Period : Immediate Joiner Work Mode : HybridLocation : BangaloreMust Have : Data engineer with Knowledge of Graph, SQL, No SQL, Python or ScalaGood to have: AI/ Overview :We are seeking a highly skilled and experienced Senior Data Engineer to enhance our data processing capabilities and...

  • Data Engineer

    3 weeks ago


    Bangalore, Karnataka, India ALCHEMY TECHSOL INDIA PRIVATE LIMITED Full time

    Role : Data Engineer ( ETL) Experience : Minimum 5 years of relevant experience.Shift : GeneralModel : Hybrid - Base location will be Client office in Bagmane Teck Park - CV Raman Nagar, BangaloreNotice Period : Immediate - 15 days.About the Role :Job Summary :- 5 - 6 years of experience in Data management & engineering projects using Informatica products -...

  • ETL Lead

    3 days ago


    Bangalore, Karnataka, India ResourceTree Global Services Full time

    Role : Senior Software Engineer / Tech Lead - ETL (Application & : ETL tools like Talend/Pentaho/Informatica/Datastage, Strong with Data Ware House (DWH) Concept s, SQL ,BI : 5-10 : Bangalore (Hybrid)Job Description :- Responsible for End-to-end System/Technical Design & Architecture (Application & Infrastructure) experience. - Designing, developing and...

  • Data Engineer II

    3 weeks ago


    Bangalore, Karnataka, India Arting Digital Full time

    SALARY : 15LPA - 20LPAPosting title : Data Engineer II Experience : 6+ Years Location : Bangalore Work mode : Hybrid Primary skills : ETL, Data Warehousing, Reporting, SQL, Azure services such as Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure Storage, etc.Qualification : Any Engineering/ Computers degreeRoles & Responsibilities : -...


  • Bangalore, Karnataka, India Wenger & Watson Inc. Full time

    Industry : General Insurance. Role : Data Engineering Manager. Years of Experience : 12-15 Years. Location : Banglore(koramangala). Work mode : WFO(1st and last saturday working half day). Other location : candidate willing to relocate. Purpose : This role will own the data ingestion, storage, and engineering processes and functions on the data platform. The...


  • Bangalore, Karnataka, India TecQubes Technologies Full time

    Role and Responsibilities : - Provide expert support for ETL processes built on Azure Data Factory (ADF) and Azure Databricks (ADB).- Diagnose and resolve complex ETL issues, ensuring the smooth execution of data pipelines. - Leverage strong SQL skills to query, manipulate, and analyze data. - Demonstrate a deep understanding of the Azure platform, including...

  • Data Engineer

    3 weeks ago


    Bangalore, Karnataka, India Ample Success Hr Solutions Full time

    Qualifications : Minimum Qualifications:- Bachelor's Degree in Engineering, Computer Science, CIS, or related field (or equivalent work experience in a related field).- 5 years of experience in Data Engineering, Data Lake, Data Mesh, Data Warehousing/ETL.- 5 years of experience working on project(s) involving the implementation of solutions applying...

  • Data Engineer

    3 weeks ago


    Bangalore, Karnataka, India Apps Business IT Solutions Pvt. Ltd. Full time

    Company Description :Apps Business IT Solutions Private Limited (ABITS) is a leading IT consulting and Enterprise Software services company located in the Greater Bengaluru Area. ABITS has over 150+ associates with a combined global IT & domain experience of more than 1000 person years. The company's transparent communication and state-of-the-art...

  • Data Engineer

    2 weeks ago


    Bangalore, Karnataka, India Element Infomatics Pvt. Ltd. Full time

    Position : Data Engineer Job Description :- Develop and maintain data pipelines using ADF for data extraction, transformation, and loading (ETL).- Manage data warehousing solutions on Azure, optimizing storage and performance.- Utilize Azure services like Azure Data Factory and Azure Databricks or snowflake for data processing.- Create and maintain data...


  • Bangalore, Karnataka, India Lancesoft India Pvt Ltd Full time

    We are seeking a highly skilled Senior ETL Developer to join our team and play a crucial role in designing, developing, and optimizing ETL processes. The ideal candidate will have a strong foundation in T-SQL, ETL tools, and RDBMS concepts, along with a passion for data engineering and a commitment to delivering high-quality solutions. Key Responsibilities :...

  • Tricog Health

    3 weeks ago


    Bangalore, Karnataka, India Tricog Health India Private Limited Full time

    Key Responsibilities:- Design, develop, and optimize complex SQL queries to transform and extract insights from large datasets.- Build and maintain scalable ETL pipelines using Python to ingest, process, and load data from various sources into our data lake and data warehouse.- Implement best practices for data governance, data quality, and data security.-...

  • ETL Developer

    3 weeks ago


    Bangalore, Karnataka, India ProPMO Services Private Limited Full time

    Position : ETL DeveloperLocation : BangaloreExperience Required : 5+ yearsMust-Have Skills : AWS Glue, Athena, S3, Redshift, Data Pipeline, Lambda, MySQL, SQL ServerPosition Overview :We are seeking an experienced ETL Developer with over 5 years of expertise to join our team in Bangalore. The ideal candidate will have a strong background in AWS services and...

  • AWS Data Engineer

    3 weeks ago


    Bangalore, Karnataka, India Getinz Full time

    Role : AWS Data EngineerMode : WFOExperience : 3 to 5 yearsLocation : BangaloreSkills : AWS services, SQL, Python or Java, Data modelling, Web Protocols, Rest API.Notice period : 1 month/ Immediate / Currently serving - Design data pipelines to curate sourced data into the Redshift data warehouse - Build and maintenance of data pipelines and data platforms...


  • Bangalore, Karnataka, India PureSoftware Pvt Ltd. Full time

    Role and Responsibilities :- Design, develop and deliver the building of ADF pipelines across various integration points for the Accounting & Reporting Stream.- Create and maintain scalable data pipelines using PySpark and ETL workflows using Azure Databricks and Azure Data Factory- Data Modelling and Architecture : Build and optimize data models and...