ETL/Data Engineering Manager

1 month ago

Bangalore, Karnataka, India SemperFi Solutions Full time

Shift timings : 12pm to 9 PM

Total experience required : 15-20 years.

Job Description :

- Lead and mentor a team of data engineers in designing, developing, and maintaining efficient and reliable ETL pipelines.

- Develop advanced scripts using Python for data extraction, transformation, and loading (ETL) processes.

- Architect robust ETL solutions to support diverse data integration needs and complex business logic.

- Translate business requirements into technical designs, ensuring solutions meet functional and performance expectations.

- Set up and oversee monitoring systems to provide production support for Data Warehouse issues, such as data load problems and transformation/translation problems.

- Thoroughly understand data transformation and translation requirements and determine the most effective tools for the job.

- Design and automate modern data pipelines using a mix of cloud-based and on-premises technologies.

- Effectively communicate complex results and technical designs to both technical and non-technical audiences, including business functional owners and stakeholders.

- Promote continuous improvement in all aspects of the team's operations.

- Perform additional duties and responsibilities as assigned to support the team's objectives.

Skills needed:

- Bachelor's Degree in Computer Science or a related field with relevant experience.

- Experience in developing SQL code in MS SQL/Oracle or other databases.

- Experience in Python scripting for data processing and ETL tasks.

- Over 10 years of experience with ETL tools such as SSIS, ODI, SAP Data Services, Informatica or similar.

- Extensive exposure and working experience in Azure Synapse, Azure Data Factory (ADF), or similar technologies.

- Exposure to modern integration tools like Bhoomi, Celigo, Talend or similar

- Proven experience working with APIs, lambda functions, and designing complex ETLs extracting data from various sources like RDBMS, Flat files, XML, and JSON.

- Ability to analyze and optimize poorly performing queries/ETL mappings, with a strong understanding of performance tuning.

- Extensive experience with cloud services like AWS EMR, EC2, IAM, S3, and CloudFormation, as well as databases like DB2, Oracle, and Hive.

- Deep knowledge of data warehouse architectures and data modelling principles.

- Demonstrated ability to work independently and as a team leader, with a strong belief in automated testing and version control.

- Exceptional analytical, problem-solving, and communication skills, with client-facing experience.

- Proven ability to architect ETL solutions, translate business requirements into technical design, and effectively communicate with business functional owners and stakeholders

(ref:hirist.tech)

  • Data Engineer

    2 months ago

    Bangalore, Karnataka, India Mobile Programming LLC Full time

    Job Description :Please note : This position is focused on development rather than migration. We are seeking an experienced Data Engineer to join our team. As a Data Engineer, you will play a crucial role in developing and maintaining our data infrastructure and ensuring the smooth operation of our data platforms. The ideal candidate should have a strong...

  • Data Engineer

    2 weeks ago

    Bangalore, Karnataka, India Mobile Programming LLC Full time

    Job Description :Please note : This position is focused on development rather than migration. We are seeking an experienced Data Engineer to join our team. As a Data Engineer, you will play a crucial role in developing and maintaining our data infrastructure and ensuring the smooth operation of our data platforms. The ideal candidate should have a strong...

  • Data Engineer

    2 weeks ago

    Bangalore, Karnataka, India CYBERSAPIENT TECHNOLOGIES PRIVATE LIMITED Full time

    Company Description : CST Cyber Sapient is a company dedicated to helping clients achieve advocacy through exceptional product and service experiences. We work closely with our clients to drive change within their organization and provide support in areas such as strategic vision, product innovation, user experience, talent support, and technical delivery....

  • Data Engineer

    2 months ago

    Bangalore, Karnataka, India CYBERSAPIENT TECHNOLOGIES PRIVATE LIMITED Full time

    Company Description : CST Cyber Sapient is a company dedicated to helping clients achieve advocacy through exceptional product and service experiences. We work closely with our clients to drive change within their organization and provide support in areas such as strategic vision, product innovation, user experience, talent support, and technical delivery....

  • Data Engineer

    5 minutes ago

    Bangalore, Karnataka, India ANKYAH INFINITY PRIVATE LIMITED Full time

    Job Description :- Design, develop, and implement ETL processes to extract, transform, and load data into data lakes or warehouses.- Ensure the accuracy, completeness, and timeliness of data transformations and integrations.- Collaborate with stakeholders to understand and translate business requirements into technical solutions.- Optimize ETL workflows for...

  • PhysicsWallah - Data Engineer - ETL

    3 weeks ago

    Bangalore, Karnataka, India PhysicsWallah Full time

    Working Experience :- Minimum 1 year of work experience.- Startup experience preferred, Streaming Platform, Edtech work experience bonus. Roles & Responsibilities :- Develop ETL (Extract, Transform, Load) processes to move and transform data between systems.- Integrate data from various sources, ensuring consistency and accuracy.- Monitor system performance...

  • PhysicsWallah - Data Engineer - ETL

    2 weeks ago

    Bangalore, Karnataka, India PhysicsWallah Full time

    Working Experience :- Minimum 1 year of work experience.- Startup experience preferred, Streaming Platform, Edtech work experience bonus. Roles & Responsibilities :- Develop ETL (Extract, Transform, Load) processes to move and transform data between systems.- Integrate data from various sources, ensuring consistency and accuracy.- Monitor system performance...

  • Data Engineer

    1 month ago

    Bangalore, Karnataka, India Careerzgraph Full time

    Total experience required : 15-20 years.Notice Period - Not More then 15 Days / Only Immediate Joiners For Location - Bengaluru (KA)/Electronic City Phase 1. - Work from Office Job Description :- Lead and mentor a team of data engineers in designing, developing, and maintaining efficient and reliable ETL pipelines.- Develop advanced scripts using Python for...

  • Data Engineer

    2 weeks ago

    Bangalore, Karnataka, India Careerzgraph Full time

    Total experience required : 15-20 years.Notice Period - Not More then 15 Days / Only Immediate Joiners For Location - Bengaluru (KA)/Electronic City Phase 1. - Work from Office Job Description :- Lead and mentor a team of data engineers in designing, developing, and maintaining efficient and reliable ETL pipelines.- Develop advanced scripts using Python for...

  • Senior ETL/Data Engineer

    2 weeks ago

    Bangalore, Karnataka, India Overture Rede Private Limited. Full time

    About the Role :We are seeking a highly skilled and experienced Sr. ETL/Data Engineer to join our team and play a critical role in our data warehousing and data management processes.In this role, you will be responsible for designing, developing, implementing, and maintaining ETL (Extract, Transform, Load) pipelines to deliver high-quality data to our data...

  • Senior Data Engineer

    2 months ago

    Bangalore, Karnataka, India Amicon Hub Full time

    Data Engineer role.Location : BangaloreNeed only Immediate Joiners and candidates from Product based/Start up Companies.Responsibilities :- Analyze and organize raw data - Build data systems and pipelines- Evaluate business needs and objectives- Interpret trends and patterns- Conduct complex data analysis and report on results - Prepare data for prescriptive...

  • Senior Data Engineer

    2 weeks ago

    Bangalore, Karnataka, India Amicon Hub Full time

    Data Engineer role.Location : BangaloreNeed only Immediate Joiners and candidates from Product based/Start up Companies.Responsibilities :- Analyze and organize raw data - Build data systems and pipelines- Evaluate business needs and objectives- Interpret trends and patterns- Conduct complex data analysis and report on results - Prepare data for prescriptive...

  • ETL/Data Engineering Manager

    2 weeks ago

    Bangalore, Karnataka, India SemperFi Solutions Full time

    Shift timings : 12pm to 9 PMTotal experience required : 15-20 years.Job Description :- Lead and mentor a team of data engineers in designing, developing, and maintaining efficient and reliable ETL pipelines.- Develop advanced scripts using Python for data extraction, transformation, and loading (ETL) processes.- Architect robust ETL solutions to support...

  • Senior Data Engineer

    2 months ago

    Bangalore, Karnataka, India LOGIC PLANET IT SERVICES Full time

    About the job :Project Role : Data EngineerMust have skills : Google BigQueryMinimum 5 year(s) of experience is requiredAs a Data Engineer, you will be responsible for designing, developing, and maintaining data solutions for data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and...

  • Senior Data Engineer

    2 weeks ago

    Bangalore, Karnataka, India LOGIC PLANET IT SERVICES Full time

    About the job :Project Role : Data EngineerMust have skills : Google BigQueryMinimum 5 year(s) of experience is requiredAs a Data Engineer, you will be responsible for designing, developing, and maintaining data solutions for data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and...

  • Data Engineer

    2 weeks ago

    Bangalore, Karnataka, India CareerNet Consulting Full time

    WHAT YOU'LL DO : - Help build robust and scalable data pipelines and ETL services for processing data from internal and external Data sources.- Help automating business processes requiring data manipulation, aggregation, and sharing- Work in collaboration with other members of the group located in California.- Optimize and monitor proactively existing...

  • Data Engineer

    2 months ago

    Bangalore, Karnataka, India CareerNet Consulting Full time

    WHAT YOU'LL DO : - Help build robust and scalable data pipelines and ETL services for processing data from internal and external Data sources.- Help automating business processes requiring data manipulation, aggregation, and sharing- Work in collaboration with other members of the group located in California.- Optimize and monitor proactively existing...

  • Senior Data Engineer

    2 weeks ago

    Bangalore, Karnataka, India D Square Consulting Services Pvt Ltd Full time

    Role : Sr. Data Engineer (DOMO)This is a full-time position with D Square Consulting Services Pvt LtdExperience - 5+ YearsLocation - BangaloreCandidates who can join within 30 days, may only applyWorking Mode: Work From OfficeJob Highlights:Must-Have skills :- 5+ years' experience in ELT systems (Snowflake and DOMO)- Must have experience in digital...

  • Senior Data Engineer

    2 weeks ago

    Bangalore, Karnataka, India D Square Consulting Services Pvt Ltd Full time

    Role : Sr. Data Engineer (DOMO)This is a full-time position with D Square Consulting Services Pvt LtdExperience - 5+ YearsLocation - BangaloreCandidates who can join within 30 days, may only applyWorking Mode: Work From OfficeJob Highlights:Must-Have skills :- 5+ years' experience in ELT systems (Snowflake and DOMO)- Must have experience in digital...

  • Data Engineer

    3 weeks ago

    Bangalore, Karnataka, India TD Newton Full time

    As Data Engineer, you will :- Support in designing and rolling out the data architecture and infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources- Identify data source, design and implement data schema/models and integrate data that meet the requirements of the business stakeholders- Play an...