ETL/Data Engineering Manager

1 week ago

bangalore, India SemperFi Solutions Full time

Shift timings : 12pm to 9 PM

Total experience required : 15-20 years.

Job Description :

- Lead and mentor a team of data engineers in designing, developing, and maintaining efficient and reliable ETL pipelines.

- Develop advanced scripts using Python for data extraction, transformation, and loading (ETL) processes.

- Architect robust ETL solutions to support diverse data integration needs and complex business logic.

- Translate business requirements into technical designs, ensuring solutions meet functional and performance expectations.

- Set up and oversee monitoring systems to provide production support for Data Warehouse issues, such as data load problems and transformation/translation problems.

- Thoroughly understand data transformation and translation requirements and determine the most effective tools for the job.

- Design and automate modern data pipelines using a mix of cloud-based and on-premises technologies.

- Effectively communicate complex results and technical designs to both technical and non-technical audiences, including business functional owners and stakeholders.

- Promote continuous improvement in all aspects of the team's operations.

- Perform additional duties and responsibilities as assigned to support the team's objectives.

Skills needed:

- Bachelor's Degree in Computer Science or a related field with relevant experience.

- Experience in developing SQL code in MS SQL/Oracle or other databases.

- Experience in Python scripting for data processing and ETL tasks.

- Over 10 years of experience with ETL tools such as SSIS, ODI, SAP Data Services, Informatica or similar.

- Extensive exposure and working experience in Azure Synapse, Azure Data Factory (ADF), or similar technologies.

- Exposure to modern integration tools like Bhoomi, Celigo, Talend or similar

- Proven experience working with APIs, lambda functions, and designing complex ETLs extracting data from various sources like RDBMS, Flat files, XML, and JSON.

- Ability to analyze and optimize poorly performing queries/ETL mappings, with a strong understanding of performance tuning.

- Extensive experience with cloud services like AWS EMR, EC2, IAM, S3, and CloudFormation, as well as databases like DB2, Oracle, and Hive.

- Deep knowledge of data warehouse architectures and data modelling principles.

- Demonstrated ability to work independently and as a team leader, with a strong belief in automated testing and version control.

- Exceptional analytical, problem-solving, and communication skills, with client-facing experience.

- Proven ability to architect ETL solutions, translate business requirements into technical design, and effectively communicate with business functional owners and stakeholders

(ref:hirist.tech)

  • Data Engineer

    1 month ago

    Bangalore, Karnataka, India Mobile Programming LLC Full time

    Job Description :Please note : This position is focused on development rather than migration. We are seeking an experienced Data Engineer to join our team. As a Data Engineer, you will play a crucial role in developing and maintaining our data infrastructure and ensuring the smooth operation of our data platforms. The ideal candidate should have a strong...

  • Data Engineer

    1 month ago

    Bangalore, India Mobile Programming LLC Full time

    Job Description : Please note : This position is focused on development rather than migration. We are seeking an experienced Data Engineer to join our team. As a Data Engineer, you will play a crucial role in developing and maintaining our data infrastructure and ensuring the smooth operation of our data platforms. The ideal candidate should have a strong...

  • QA Engineer

    1 week ago

    bangalore, India Antal International Full time

    Job Description Job Title: QA Engineer - Data/ETL Experience Range: 7 - 12 years Locations: Bangalore Np: Immediate to 30 days Industry: IT service management company What you Will do • Validates data and ETL pipelines to bring new data into a datawarehouse• Collaborate with cross-functional teams (Product/Data...

  • Data Engineer

    1 month ago

    Bangalore, Karnataka, India CYBERSAPIENT TECHNOLOGIES PRIVATE LIMITED Full time

    Company Description : CST Cyber Sapient is a company dedicated to helping clients achieve advocacy through exceptional product and service experiences. We work closely with our clients to drive change within their organization and provide support in areas such as strategic vision, product innovation, user experience, talent support, and technical delivery....

  • Data Engineer

    1 month ago

    Bangalore, India CYBERSAPIENT TECHNOLOGIES PRIVATE LIMITED Full time

    Company Description : CST Cyber Sapient is a company dedicated to helping clients achieve advocacy through exceptional product and service experiences. We work closely with our clients to drive change within their organization and provide support in areas such as strategic vision, product innovation, user experience, talent support, and technical delivery....

  • Azure Data Engineer

    2 months ago

    Bangalore, India Connectio IT Pvt Ltd Full time

    Role Description :This is a full-time Azure Data Engineer role at Connect io IT Pvt Ltd located in Bengaluru. As an Azure Data Engineer, you will be responsible for tasks such as data engineering, data modeling, Extract Transform Load (ETL), data warehousing, and data analytics. You will work on-site in Bengaluru.Qualifications :- Data Engineering, Data...

  • Data Engineer

    1 month ago

    bangalore, India Axtria - Ingenious Insights Full time

    Job Title: Data Engineer / ETL DeveloperJob Description:We are seeking an experienced ETL Developer / Data Engineer to join our team. The ideal candidate will have a strong background in Azure Data Factory (ADF), SQL, Pyspark/DatabricksResponsibilities:Design, develop, and implement ETL processes using Azure Data Factory (ADF), Matillion, Snowflake, Or...

  • Assistant Manager, Pharma-Data Engineering-Data Analyst

    1 month ago

    bangalore, India Genpact Full time

    Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people –...

  • ETL Data Engineer

    3 weeks ago

    Bangalore, India Codersbrain technology pvt ltd Full time

    Job Description: ETL - Data Design, Develop and maintain ETL pipelines using Pyspark in Azure Databricks using delta tables. Create build from Github and release pipeline for Ingestion and Databricks using Azure Devops / Harness Monitor Performance of ETL Jobs, resolve any issue that arose and improve the performance metrics as needed. Diagnose system...

  • Data Engineer

    1 week ago

    bangalore, India Hunarstreet Technologies Pvt Ltd Full time

    Job Description :- We are seeking a highly skilled Trainer with extensive experience in Data Engineering to join our team.- The ideal candidate will possess a robust background in developing data pipelines, ETL processes, and data warehousing solutions.- As a Trainer, you will be responsible for delivering comprehensive training sessions on data engineering...

  • Data Engineer

    2 weeks ago

    Bangalore, Karnataka, India Hunarstreet Technologies Pvt Ltd Full time

    Job Description :- We are seeking a highly skilled Trainer with extensive experience in Data Engineering to join our team.- The ideal candidate will possess a robust background in developing data pipelines, ETL processes, and data warehousing solutions.- As a Trainer, you will be responsible for delivering comprehensive training sessions on data engineering...

  • Senior ETL/Data Engineer

    3 weeks ago

    Bangalore, India Overture Rede Private Limited. Full time

    About the Role :We are seeking a highly skilled and experienced Sr. ETL/Data Engineer to join our team and play a critical role in our data warehousing and data management processes.In this role, you will be responsible for designing, developing, implementing, and maintaining ETL (Extract, Transform, Load) pipelines to deliver high-quality data to our data...

  • Data Engineer

    1 month ago

    Bangalore, India SKEP IT SYSTEMS Full time

    Role : Data EngineerMobilution IT Systems is a pioneering organization at the forefront of technological innovation, specializing in cutting-edge Tech solutions. With a strong commitment to leveraging advanced technologies for scientific advancements, Mobilution IT Systems is dedicated to revolutionizing the way data is analysed and utilized across...

  • Data Engineer

    2 weeks ago

    bangalore, India ANKYAH INFINITY PRIVATE LIMITED Full time

    Job Description : - Design, develop, and implement ETL processes to extract, transform, and load data into data lakes or warehouses.- Ensure the accuracy, completeness, and timeliness of data transformations and integrations.- Collaborate with stakeholders to understand and translate business requirements into technical solutions.- Optimize ETL workflows...

  • Data Engineer

    2 weeks ago

    Bangalore, Karnataka, India ANKYAH INFINITY PRIVATE LIMITED Full time

    Job Description :- Design, develop, and implement ETL processes to extract, transform, and load data into data lakes or warehouses.- Ensure the accuracy, completeness, and timeliness of data transformations and integrations.- Collaborate with stakeholders to understand and translate business requirements into technical solutions.- Optimize ETL workflows for...

  • Data Engineer

    1 week ago

    bangalore, India Careerzgraph Full time

    Total experience required : 15-20 years.Notice Period - Not More then 15 Days / Only Immediate Joiners For Location - Bengaluru (KA)/Electronic City Phase 1. - Work from Office Job Description :- Lead and mentor a team of data engineers in designing, developing, and maintaining efficient and reliable ETL pipelines.- Develop advanced scripts using Python...

  • Data Engineer

    1 month ago

    Anywhere in India/Multiple Locations/Bangalore, IN Mobile Programming LLC Full time

    Job Description :Position : Data EngineerExperience : 6+ yearsWork Mode : Work from OfficeLocation : BangaloreExperience in Nifi or Tibco is mandatory.Mandatory Skills : ETL, DevOps platform, Nifi or TibcoPlease note : This position is focused on development rather than migration. We are seeking an experienced Data Engineer to join our team. As a Data...

  • Data Engineer

    1 month ago

    Anywhere in India/Multiple Locations/Bangalore Mobile Programming LLC Full time

    Job Description : Position : Data EngineerExperience : 6+ yearsWork Mode : Work from OfficeLocation : BangaloreExperience in Nifi or Tibco is mandatory.Mandatory Skills : ETL, DevOps platform, Nifi or TibcoPlease note : This position is focused on development rather than migration. We are seeking an experienced Data Engineer to join our team. As a Data...

  • PhysicsWallah - Data Engineer - ETL

    1 month ago

    Bangalore, Karnataka, India PhysicsWallah Full time

    Working Experience :- Minimum 1 year of work experience.- Startup experience preferred, Streaming Platform, Edtech work experience bonus. Roles & Responsibilities :- Develop ETL (Extract, Transform, Load) processes to move and transform data between systems.- Integrate data from various sources, ensuring consistency and accuracy.- Monitor system performance...

  • PhysicsWallah - Data Engineer - ETL

    1 month ago

    Bangalore, India PhysicsWallah Full time

    Working Experience :- Minimum 1 year of work experience.- Startup experience preferred, Streaming Platform, Edtech work experience bonus. Roles & Responsibilities :- Develop ETL (Extract, Transform, Load) processes to move and transform data between systems.- Integrate data from various sources, ensuring consistency and accuracy.- Monitor system performance...