Data Engineering Manager

2 weeks ago

Mangalore, India Intelliserve Konsulting Pvt Ltd Full time

Organization Leading Insurance company (Client of Intelliserve)

Role : Data Engineer Manager

Location: Chennai

Experience 11+ Years

Industry: General Insurance

Working Mode Work from the office


Purpose:

This role will own the data ingestion, storage, and engineering processes and functions on the data platform. The Data Engineering Manager will ensure the timely delivery, integrity, and security of data for modeling, reporting, and analysis. This role is crucial in leading a team of data engineers, managing the data infrastructure, and supporting the establishment of a new Data Ops model aligned with organization’s Data Strategy roadmap.

Key Responsibilities:

Responsibilities will include, but are not limited to:

1. Data Ingestion & Engineering:

o Create, maintain, and optimize all data ingestion pipelines from selected source systems to the data platform.

o Design, build, and maintain batch or real-time data pipelines in production.

o Develop ETL/ELT data pipeline processes to extract, transform, and load data from multiple sources.

o Automate data workflows such as data ingestion, aggregation, and ETL processing using various techniques and tools.

o Ensure data accuracy, integrity, privacy, security, and compliance through quality control procedures.

2. Team Leadership:

o Lead a data engineering team responsible for both day-to-day data management (BAU) activities and change projects.

o Define and orchestrate tasks and deliverables in support of the Project Manager, acting as Scrum Master as appropriate.

o Take ownership of the team’s development, hold members accountable for their commitments, remove roadblocks, and mentor and develop team members.

3. Controls & Standards:

o Collaborate with Data Engineers and Architects as a senior contributor to the design, build, and management of the Data Platform.

o Take direct ownership of controls and standards to ensure all new data requirements are met using the most appropriate engineering practices.

4. Business Stakeholder Engagement:

o Set up governance forums with program stakeholders (both business and IT) to define and execute against a platform technology roadmap, business change, and data product build plan.

o Engage with multiple stakeholders, including business users, developers, database architects, data analysts, and data scientists to ensure optimal data delivery.

5. Technical Oversight:

o Maintain and optimize the data infrastructure required for accurate extraction, transformation, and loading of data from a wide variety of data sources.

o Monitor data systems performance and implement optimization strategies.

o Oversee data controls to maintain data privacy, security, compliance, and quality.

Technical and Qualitative Requirements:

1. Experience:

o Extensive experience in AWS-based data engineering, including orchestrating and governing data pipelines, integration, data modeling, and release management.

o Proven experience in leading DevOps sprint teams using Scrum, translating business requirements into deliverable user stories, and coordinating development activity.

o Hands-on experience with AWS tools and services (e.g., S3, EC2, Athena, Redshift, Glue, EMR, Lambda, RDS, Kinesis, DynamoDB, QuickSight).

o Strong experience in workflow management and orchestration tools (e.g., Airflow).

o Experience in building and deploying solutions to AWS Cloud.

2. Technical Skills:

o Proficiency in Python, SQL, PySpark, Scala, and Shell Scripting.

o Solid experience with Big Data ecosystems (e.g., Cloudera/Hortonworks, AWS EMR) and data warehousing solutions (e.g., Snowflake).

o Experience with streaming technologies (e.g., Kinesis, Kafka, Spark Streaming) and distributed computing (e.g., Hive, Hadoop, Presto).

o Familiarity with CI/CD technologies (e.g., Git, Jenkins, Spinnaker, Ansible).

o Good understanding of NoSQL databases (e.g., DynamoDB, Redis, Cassandra, MongoDB, Neo4j).

3. Soft Skills:

o Strong people management skills, including mentoring, coaching, collaboration, and team building.

o Excellent analytical, planning, and organizational skills, with an ability to manage competing demands.

o Excellent oral and written communication skills, with experience interacting with business and IT individuals at all levels, including executive leadership.

4. Good to Have:

o Experience in the Insurance domain.

o Working knowledge of data visualization tools like Tableau, Amazon QuickSight, Power BI, or QlikView.

  • Azure Data Engineer

    2 weeks ago

    Mangalore, India SourceBae Full time

    Job Title: Data EngineerLocation: RemoteExperience Required: 5+ YearsAbout the Role: We are seeking a highly skilled Data Engineer with a strong background in Azure data technologies and Python. The ideal candidate will have over 5 years of experience in designing, implementing, and maintaining data solutions in a dynamic environment.Key...

  • GCP Data Engineer

    2 weeks ago

    Mangalore, India Manuh Technologies Full time

    Primary Responsibilities: Implement and manage GCP tools and environment.Using Python, build and maintain multiple source data connections to API's, SQL databases, GCS.Migrate data from AWS S3 to Google cloud storage.Manage IT platform and GCS environment.Ensure data consistency, accuracy and reliability as data and business requirements change. Required...

  • Azure Data Engineer

    2 weeks ago

    Mangalore, India 2COMS Consulting Pvt. Ltd. Full time

    As a Big Data Engineer (Azure), you will build and learn about a variety of analytics solutions & platforms, data lakes, modern data platforms, data fabric solutions, etc. using different Open Source, Big Data, and Cloud technologies on Microsoft Azure.On a typical day, you might● Design and build scalable & metadata-driven data ingestion pipelines (For...

  • Big Data Developer

    3 weeks ago

    Mangalore, India Solytics Partners Full time

    Job Description:We are seeking a skilled Big Data Engineer to join our dynamic team. The ideal candidate will have extensive experience in Big Data Analytics, Hadoop, and Data Lake technologies. You will be responsible for designing, implementing, and maintaining large-scale data processing systems, ensuring the efficient flow and storage of data within our...

  • Engineering Manager

    3 days ago

    mangalore, India Idexcel Full time

    Required Qualifications: Engineering Manager-ROR Experience: 10 to 15 years 8+ years of software engineering experience, with at least 3+ years managing engineering teams. Strong hands-on experience with Ruby on Rails (RoR) , Angular , and/or Node.js . Experience with AWS services and cloud infrastructure management. Technical Skills: Proficiency in...

  • Machine Learning Engineer

    3 days ago

    mangalore, India Maestro Technologies, Inc. Full time

    We are seeking a talented and experienced Machine Learning Engineer to design, develop, and deploy machine learning models and systems. The ideal candidate will have a strong background in machine learning, expertise in Google Cloud Platform (GCP), Databricks, and proficiency in SQL. As a Machine Learning Engineer, you will work closely with data scientists,...

  • Electrical Project Engineer

    3 weeks ago

    Mangalore, India Seaker Oy Full time

    Job Title: Project Engineer – Ship Automation and Data Collection Job Description:We are seeking a skilled and motivated Project Engineer to join our team, specializing in ship automation and data collection from onboard equipment. The successful candidate will be responsible for the planning, execution, and management of automation projects on vessels,...

  • Cloud Data and Analytics Senior Manager

    3 weeks ago

    Mangalore, India Astrosoft Technologies Full time

    Bachelor’s degree in computer science, Information Technology, Data Science, or a related field. A Master’s degree is preferred.8+ years of experience in data integration and management, analytics, or a related field, with 3+ years in a managerial role.Strong experience with cloud data technologies and platforms. AWS experience is required.Strong...

  • Drug Safety Associate

    3 months ago

    Mangalore, India Refined Reports Data Full time

    Identify out of scope activities in conjunction with the MSS Functional Lead Determining the category of information received whether it is a Medical Inquiry, Product Quality Complaint (PQC), an adverse event (AE) associated with a PQC, or an AE alone, and handling it accordingly per the relevant SOPs and guidelines Reconciliation activities with all data...

  • Director of Product Management

    3 months ago

    mangalore, India Axtria - Ingenious Insights Full time

    Pharma/Life Sciences exp is MANDATORY any other industry resumes will be rejected Noida / Gurugram As an experienced Product Management, collaborate with senior leadership, client success team, architects, user experience designers, engineers, testers, and project owners to deliver solutions. JOB OBJECTIVE: The role of Director, Product Management is...

  • Machine Learning Engineer

    7 days ago

    mangalore, India Velocity FinCrime Solutions Suite Full time

    As a Machine Learning Engineer, your primary responsibility will be to design, develop, and implement machine learning models and algorithms to address complex business problems and enhance our products and services. You will work closely with data scientists, software engineers, and product managers to deploy machine learning solutions into production...

  • Senior Manager

    2 days ago

    Mangalore, India Piaggio Vehicles Pvt. Ltd. Full time

    Our Company and the Department’s objective…We are one of the key market leaders in AUTOMOBILE manufacturing and its Sales across the Indian and International markets. We offer a creative and progressive culture with all the exciting challenges and rewards of working for a dynamic, international company. You will be working in our 2W - Research &...

  • Full Stack Engineer

    5 days ago

    Mangalore, India Kodelint Full time

    We are seeking a talented and passionate Full Stack Engineer with 4+ years of experience to join our growing team. As a Full Stack Engineer, you will be integral in designing and implementing high-performance applications with a focus on user experience, robustness, and scalability. You will work closely with our product, design, and development teams to...

  • Platform Support Engineer

    3 days ago

    mangalore, India ManpowerGroup India Full time

    Responsibilities: Lead and monitor internal dashboard reporting, visualizations, and alerting mechanisms for all production applications and supporting environments. Implement end to end monitoring of different platforms to reduce system downtime. Create and manage metrics for all Platforms (eCommerce, Admin Portal & Menu Management) and Brands. Build and...

  • Product Manager

    3 days ago

    mangalore, India Monotech Systems Limited® Full time

    We are seeking an experienced and dynamic Product Manager to lead the development and management of our Digital Inkjet Printing Products. This role involves overseeing the product lifecycle from conception to launch and beyond, working closely with cross-functional teams to ensure the successful delivery of innovative, high-quality printing solutions that...

  • Machine Learning Engineer

    3 days ago

    Mangalore, India Tavant Full time

    With 24+ years of experience building innovative digital products and solutions, Tavant provides impactful results to its customers. It has been the frontrunner in driving digital innovation and tech-enabled transformation across a wide range of industries such as Consumer Lending, Manufacturing, Agtech, Media & Entertainment, and Retail in North America,...

  • Senior Manager, SEO

    3 days ago

    mangalore, India ETML Full time

    Overview: As a Senior SEO Manager, you will be responsible for leading and executing advanced SEO strategies to drive organic traffic, increase rankings, and improve overall online visibility for our clients. You will work closely with the performance marketing team, including PPC, content, and social media experts, to develop integrated strategies that...

  • Application Engineer

    1 month ago

    Mangalore, Karnataka, India BASF SE Full time

    Objectives of the PositionApplication Engineer for application center has a responsibility of managing shift operation of application activities. His or her activities are closely connected to QC and CL application activities to proceed efficient and safer way. He or she is responsible for securing EHS in all of application activities. He or she is expected...

  • Deputy Manager-Insurance

    3 weeks ago

    Mangalore, India MS Agarwal Foundries Pvt Ltd Full time

    Roles & Responsibilitieslooking for 10+ Yrs experience in corporate insurancebuilding relationship with all insurance companies & Brokers. Understanding the insurance requirements and gathering information and consulting with the best possible solutions as per requirements. `Responsible for managing day to day insurance requirements with proper data...

  • Manager

    3 weeks ago

    Mangalore, India Tech Mahindra Full time

    Greeting of the Day!!!We have urgent opening for SAP Syniti Data manager.Location : Bangalore / Hyderabad / Vizag / Bhubaneshwar / ChandigarhPlease find below JD:• 8+ years in SAP Syniti+Data managerImplements and develops customer deliverables independently using Syniti methodology and tools that meet or exceed customer requirements ¿ Develop and test...