Current jobs related to ETL/Data Engineering Manager - Bengaluru, Karnataka - SemperFi Solutions

  • Lead Engineer

    3 months ago

    Bengaluru, Karnataka, India Kenvue Full time

    The CPD Data Engineering Architect is responsible for analyzing and designing technology solutions to meet business needs.Key Responsibilities:Design and implement scalable and efficient data pipelines to support business needsCollaborate with cross-functional teams to identify and solve complex data-related problemsDevelop and maintain data architecture and...

  • Staff Data Engineer

    2 months ago

    Bengaluru, Karnataka, India Leading-Biotechnology-Company Full time

    We are seeking a highly experienced Staff Data Engineer with 10+ years of experience to join our talented team in Bangalore. This position will lead our data engineering efforts in Bangalore. In this strategic role, you will be responsible for designing, implementing, and optimizing complex data solutions using Python, Spark, SQL, Snowflake, dbt, machine...

  • Staff Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India Leading-Biotechnology-Company Full time

    JOB DUTIES:Translate business requirements into data requirements, data warehouse design and sustaining data management strategies on enterprise data platforms like Snowflake.Work with project leads, stakeholders, and business SMEs to define technical specifications to develop data modeling requirements and maintain data infrastructure to provide business...

  • Informatica ETL Developer

    4 weeks ago

    Bengaluru, Karnataka, India MUFG Global Service Full time

    Job Requirements:Bachelors Degree (or foreign equivalent degree) in Information Technology, Information Systems, Computer Science, Software Engineering, or a related field. Experience in the financial services or banking industry is preferred.5-10 years of experience on Linux OS, preferably Red Hat Linux, exposure to Oracle DBs.Informatica ETL development...

  • Finance Data Engineer

    1 month ago

    Bengaluru, Karnataka, India 3M Technology Center of Excellence Full time

    Finance Data EngineerFinance Data Engineer will be responsible for implementing data intelligence solutions around Snowflake Data Warehouse for global finance organization.Responsibilities:Analyzes, designs, develops, tests, and supports data analytical solutions withinSnowflake Cloud Data WarehouseDeveloping ETL pipelines in and out of data warehouse using...

  • Engineer II

    2 months ago

    Bengaluru, Karnataka, India lululemon India Tech Hub Full time

    About lululemon:lululemon is an innovative performance apparel company for yoga, running, training, and other athletic pursuits. Setting the bar in technical fabrics and functional design, we create transformational products and experiences that support people in moving, growing, connecting, and being well. We owe our success to our innovative products,...

  • Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India globalinsurance Full time

    Technology at Brit:Brit has a leadership position at Lloyds, the most well-known insurance market in the world. At Brit, we believe that the uncertainty of the future should never stand in the way of progress. Thats why we exist. To help people and businesses face the future and thrive.We are change-makers enabled by a global workforce who collaborate to...

  • Lead Data Engineer

    3 months ago

    Bengaluru, Karnataka, India Delta Air Lines Full time

    Key Responsibilities:Create, construct, and manage data pipelines with AWS services including S3, Glue, EMR, and Redshift.Use Kinesis, Stream, and Firehose to implement batch and stream data loading.For infrastructure as code, use AWS CDK to ensure scalability and dependability.Improve the effectiveness and performance of SQL queries.Write Python and other...

  • Engineer II

    1 month ago

    Bengaluru, Karnataka, India lululemon India Tech Hub Full time

    About lululemon:lululemon is an innovative performance apparel company for yoga, running, training, and other athletic pursuits. Setting the bar in technical fabrics and functional design, we create transformational products and experiences that support people in moving, growing, connecting, and being well. We owe our success to our innovative products,...

  • Data Engineer

    4 months ago

    Bengaluru, Karnataka, India arko Full time

    Job Description:We are seeking a skilled Data Engineer with 5-8 years of experience to join our team. The ideal candidate will have expertise in Power BI data modelling, master data management, data warehousing, and Azure data platform technologies. If you have a passion for transforming data into actionable insights and driving business decisions, we want...

  • Data Engineer

    2 months ago

    Bengaluru, Karnataka, India Talent500 Tech Full time

    We are Talent500:We help companies hire, build and manage global teams. We are trusted by the worlds leading companies - from Fortune 500s and larger enterprises (Walmart, Target, Nike, Pepsi etc) to industry leaders (Airbnb, Twitter, Uber) and some of the worlds fastest-growing start-ups from the portfolios of investors such as Accel, Sequoia and...

  • Developer - Data Engineering

    1 month ago

    Bengaluru, Karnataka, India 3M Technology Center of Excellence Full time

    Developer - Data Engineering is a part of the Data & Analytics function to work on designing, developing, testing, and supporting Digital Data Core pipelines and complex data models development in Amazon Web Services (AWS) and deliver insights to the business.Primary Responsibilitiesinclude but are not limited to the following:Designs, develops, and...

  • Sr Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India Leading-Biotechnology-Company Full time

    Senior Data EngineerJOB DUTIES:Design and architect data lake solutions on AWS S3 and Snowflake, considering scalability, automation, security, and performance requirements.Responsible for architecting, building, and optimizing data lake to store, process and analyze large volumes of structure and unstructured data.Requirements gathering and analysis,...

  • Sr Engineer

    3 months ago

    Bengaluru, Karnataka, India Kenvue Full time

    The Data Integration Senior Software Engineer is responsible for leading IICS, SAP Data Services Datasphere & ADF related build & Support projects.Key Responsibilities:Lead the design, implementation, and optimization of automated build, deployment, and release processes for data integration solutions across IICS, SAP Data Services, Datasphere and ADF.Ensure...

  • Engineering Manager

    2 months ago

    Bengaluru, Karnataka, India globalinsurance Full time

    Job Description:Engineering ManagerDepartment: Technology & Data:Brit has a leadership position at Lloyds, the most well-known insurance market in the world. At Brit, we believe that the uncertainty of the future should never stand in the way of progress. Thats why we exist. To help people and businesses face the future and thrive.We are change-makers...

  • Lead Engineer

    3 months ago

    Bengaluru, Karnataka, India Kenvue Full time

    The Data Platform Administratoris responsible for leading software design, service architecture, and software development/solution engineering. You will manage junior engineers, lead design and code reviews within the service, and investigate emerging technologies to drive continuous improvement of the service:Key Responsibilities:Administer, configure, and...

  • Senior Software Engineer

    2 weeks ago

    Bengaluru, Karnataka, India BBY India Full time

    Key ResponsibilitiesLead the delivery of complex solutions, coding larger features from start to finishActively participate in planning, and performing code and architecture reviews of their teams productHelp ensure the quality and integrity of the SDLC for their team and identify opportunities for improvement in how the team works, through usage of...

  • Lead Data Engineer

    1 month ago

    Bengaluru, Karnataka, India Delta Air Lines Full time

    About Delta Tech Hub:Delta Air Lines (NYSE: DAL) is the U.S. global airline leader in safety, innovation, reliability and customer experience. Powered by our employees around the world, Delta has for a decade led the airline industry in operational excellence while maintaining our reputation for award-winning customer service. With our mission of connecting...

  • Staff Engineer

    4 weeks ago

    Bengaluru, Karnataka, Karnataka, India GE Aviation Full time

    Job Description SummaryThe Staff Engineer demonstrates leadership for functional, business, and broad company objectives. In this role you will provide strategic, technical and project leadership in a cross functional team developing analytic products for aircraft engine components. You will have exposure to large datasets, big data pattern recognition,...

  • Engineer I

    3 weeks ago

    Bengaluru, Karnataka, India lululemon India Tech Hub Full time

    Engineer I (Java) Retail Technology Job DescriptionWho we are:lululemon is a yoga-inspired technical apparel company up to big things. The practice and philosophy of yoga informs our overall purpose to elevate the world through the power of practice. We are proud to be a growing global company with locations all around the world, from Vancouver to Shanghai,...

ETL/Data Engineering Manager

3 months ago

Bengaluru, Karnataka, India SemperFi Solutions Full time
Shift timings : 12pm to 9 PM

Total experience required : 15-20 years.

Job Description :

  • Lead and mentor a team of data engineers in designing, developing, and maintaining efficient and reliable ETL pipelines.
  • Develop advanced scripts using Python for data extraction, transformation, and loading (ETL) processes.
  • Architect robust ETL solutions to support diverse data integration needs and complex business logic.
  • Translate business requirements into technical designs, ensuring solutions meet functional and performance expectations.
  • Set up and oversee monitoring systems to provide production support for Data Warehouse issues, such as data load problems and transformation/translation problems.
  • Thoroughly understand data transformation and translation requirements and determine the most effective tools for the job.
  • Design and automate modern data pipelines using a mix of cloudbased and onpremises technologies.
  • Effectively communicate complex results and technical designs to both technical and nontechnical audiences, including business functional owners and stakeholders.
  • Promote continuous improvement in all aspects of the team's operations.
  • Perform additional duties and responsibilities as assigned to support the team's objectives.

Skills needed:

  • Bachelor's Degree in Computer Science or a related field with relevant experience.
  • Experience in developing SQL code in MS SQL/Oracle or other databases.
  • Experience in Python scripting for data processing and ETL tasks.
  • Over 10 years of experience with ETL tools such as SSIS, ODI, SAP Data Services, Informatica or similar.
  • Extensive exposure and working experience in Azure Synapse, Azure Data Factory (ADF), or similar technologies.
  • Exposure to modern integration tools like Bhoomi, Celigo, Talend or similar
  • Proven experience working with APIs, lambda functions, and designing complex ETLs extracting data from various sources like RDBMS, Flat files, XML, and JSON.
  • Ability to analyze and optimize poorly performing queries/ETL mappings, with a strong understanding of performance tuning.
  • Extensive experience with cloud services like AWS EMR, EC2, IAM, S3, and CloudFormation, as well as databases like DB2, Oracle, and Hive.
  • Deep knowledge of data warehouse architectures and data modelling principles.
  • Demonstrated ability to work independently and as a team leader, with a strong belief in automated testing and version control.
  • Exceptional analytical, problemsolving, and communication skills, with clientfacing experience.
  • Proven ability to architect ETL solutions, translate business requirements into technical design, and effectively communicate with business functional owners and stakeholders
)