Data Engineer

4 weeks ago

India WiseAnalytics.io Full time

Job Overview

Wise Analytics is seeking a highly skilled and experienced Senior Data Engineer to lead the design and architecture of data engineering solutions for our global clients in the retail and finance domains. The ideal candidate will be an independent contributor capable of managing a technical team, handling stakeholders, and ensuring timely delivery of complex projects. Expertise in technologies such as GCP, Airflow, Databricks, Kafka, and experience with creating data lakes, data warehouses, or lakehouses is essential.

Key Responsibilities

Design and Architecture

  • Lead the design and architecture of scalable and efficient data engineering solutions on GCP, leveraging technologies such as PySpark, Databricks and Kafka.
  • Develop data models and ETL/ELT pipelines to support data lakes, data warehouses, and lakehouses for advanced analytics and reporting.

Team Leadership

  • Manage and mentor a team of data engineers, providing technical guidance and ensuring best practices are followed.
  • Foster a collaborative and innovative team environment, encouraging continuous learning and improvement.

Project Management

  • Oversee project timelines, budgets, and resources, ensuring successful delivery of complex data engineering projects.
  • Collaborate with cross-functional teams to align project goals with business objectives and stakeholder requirements.

Stakeholder Management

  • Engage with senior stakeholders to understand business needs and translate them into technical requirements.
  • Present project updates, technical solutions, and data insights to stakeholders in a clear and concise manner.

Technical Expertise

  • Implement and optimize data processing workflows using Airflow, ensuring reliability and efficiency.
  • Develop and maintain real-time data streaming solutions with Kafka to support high-velocity data ingestion and processing.
  • Ensure data quality, security, and governance across all data engineering processes and solutions.

Qualifications

Education

  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field.

Experience

  • 15+ years of experience in data engineering, with a strong background in designing and implementing data solutions.
  • Proven experience in a leadership role, managing technical teams and handling complex projects.

Technical Skills

  • Expertise in cloud platforms, particularly GCP.
  • Proficiency with PySpark and Databricks for data processing and analytics.
  • Strong experience with Apache Airflow for orchestrating data workflows.
  • Extensive knowledge of Apache Kafka for real-time data streaming.
  • Familiarity with data modeling, ETL/ELT processes, and building data lakes/warehouses/lakehouses.

Soft Skills

  • Excellent communication and presentation skills, with the ability to articulate technical concepts to non-technical stakeholders.
  • Strong problem-solving skills and a proactive approach to identifying and addressing challenges.
  • Ability to manage multiple priorities and deliver high-quality results under tight deadlines.

Preferred Qualifications

  • Experience in the retail and finance domains.
  • Certification in GCP or related technologies.
  • Knowledge of additional data engineering tools and frameworks.

  • Data engineer

    2 weeks ago

    India Pacific Data Integrators Full time

    Job Overview We are seeking a skilled Data Engineer to join our team. In this role, you will be responsible for managing and optimizing data pipelines, ensuring the seamless movement of data across systems, and supporting data initiatives through strong technical expertise. The ideal candidate will be proficient in SQL and Python, with hands-on...

  • Data Engineer

    2 weeks ago

    India Pacific Data Integrators Full time

    Job OverviewWe are seeking a skilled Data Engineer to join our team. In this role, you will be responsible for managing and optimizing data pipelines, ensuring the seamless movement of data across systems, and supporting data initiatives through strong technical expertise. The ideal candidate will be proficient in SQL and Python, with hands-on experience in...

  • Data Engineer

    2 weeks ago

    India Pacific Data Integrators Full time

    Job Overview We are seeking a skilled Data Engineer to join our team. In this role, you will be responsible for managing and optimizing data pipelines, ensuring the seamless movement of data across systems, and supporting data initiatives through strong technical expertise. The ideal candidate will be proficient in SQL and Python, with hands-on experience...

  • Data Engineer

    2 weeks ago

    India Pacific Data Integrators Full time

    Job Overview We are seeking a skilled Data Engineer to join our team. In this role, you will be responsible for managing and optimizing data pipelines, ensuring the seamless movement of data across systems, and supporting data initiatives through strong technical expertise. The ideal candidate will be proficient in SQL and Python, with hands-on...

  • Pyspark data engineer

    2 weeks ago

    India ITI Data Full time

    Location : India Type : Full-time Experience : 10 – 13 years Functions : Consulting, Finance, Information Technology, Big Data Engineering Industries : Capital Markets, Investment Banking, Alternative Investments, Financial Services, Management Consulting, Information Technology and Services, Healthcare Job Description We are...

  • Cloud Data Engineering Lead

    4 weeks ago

    India ITI Data Full time

    ITI Data is seeking a highly skilled Cloud Data Engineering Lead to spearhead the design and development of scalable data pipelines on AWS. With a strong background in PySpark, Python, and AWS services, you will be responsible for building robust data integration solutions that enable data-driven insights across various internal and external sources.This is...

  • ITI Data | PySpark Data Engineer

    3 weeks ago

    india ITI Data Full time

    Location : India Type : Full-time Experience : 10 – 13 years Functions : Consulting, Finance, Information Technology, Big Data Engineering Industries : Capital Markets, Investment Banking, Alternative Investments, Financial Services, Management Consulting, Information Technology and Services, Healthcare Job Description We are looking for a PySpark...

  • ITI Data | PySpark Data Engineer

    3 weeks ago

    india ITI Data Full time

    Location : IndiaType : Full-timeExperience : 10 – 13 years Functions : Consulting, Finance, Information Technology, Big Data Engineering Industries : Capital Markets, Investment Banking, Alternative Investments, Financial Services, Management Consulting, Information Technology and Services, HealthcareJob DescriptionWe are looking for a PySpark solutions...

  • PySpark Data Engineer

    3 weeks ago

    India ITI Data Full time

    Location : IndiaType : Full-timeExperience : 10 – 13 years Functions : Consulting, Finance, Information Technology, Big Data Engineering Industries : Capital Markets, Investment Banking, Alternative Investments, Financial Services, Management Consulting, Information Technology and Services, HealthcareJob DescriptionWe are looking for a PySpark solutions...

  • PySpark Data Engineer

    3 weeks ago

    India ITI Data Full time

    Location : India Type : Full-time Experience : 10 – 13 years Functions : Consulting, Finance, Information Technology, Big Data Engineering Industries : Capital Markets, Investment Banking, Alternative Investments, Financial Services, Management Consulting, Information Technology and Services, Healthcare Job Description We are looking for a PySpark...

  • Data Platform Engineer

    4 weeks ago

    India OSD Data Services Full time

    Data Platform EngineerLocation: RemoteType: InternshipAbout UsAt OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve built a...

  • Data Platform Engineer

    3 weeks ago

    India OSD Data Services Full time

    Data Platform Engineer Location : Remote Type : Internship About Us At OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve...

  • Pacific Data Integrators | Data Engineer

    8 hours ago

    india Pacific Data Integrators Full time

    Job Overview We are seeking a skilled Data Engineer to join our team. In this role, you will be responsible for managing and optimizing data pipelines, ensuring the seamless movement of data across systems, and supporting data initiatives through strong technical expertise. The ideal candidate will be proficient in SQL and Python, with hands-on experience...

  • Pacific Data Integrators | Data Engineer

    2 weeks ago

    india Pacific Data Integrators Full time

    Job OverviewWe are seeking a skilled Data Engineer to join our team. In this role, you will be responsible for managing and optimizing data pipelines, ensuring the seamless movement of data across systems, and supporting data initiatives through strong technical expertise. The ideal candidate will be proficient in SQL and Python, with hands-on experience in...

  • AWS Data Engineer

    4 months ago

    India ITI Data Full time

    Job Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....

  • OSD Data Services | Data Platform Engineer | india

    3 weeks ago

    india OSD Data Services Full time

    Data Platform Engineer Location : Remote Type : Internship About Us At OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve built a...

  • OSD Data Services | Data Platform Engineer | india

    4 weeks ago

    india OSD Data Services Full time

    Data Platform EngineerLocation: RemoteType: InternshipAbout UsAt OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve built a...

  • OSD Data Services | Data Platform Engineer | india

    3 weeks ago

    india OSD Data Services Full time

    Data Platform Engineer Location : Remote Type : Internship About Us At OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve built a...

  • Big Data Engineer: Scalable Solutions Developer

    3 weeks ago

    India ITI Data Full time

    We are seeking an experienced PySpark Data Engineer to join our team at ITI Data. As a key member of our team, you will design and build scalable data solutions for one of our Fortune 500 Client programs.About the Role:The ideal candidate will have extensive experience in working with Hadoop, NoSQL databases, and Spark framework on Python. You will be...

  • Data Unveil | Quality Assurance Engineer

    3 weeks ago

    india Data Unveil Full time

    About us: At Data Unveil, we believe in delivering the best for our clients (Pharma Companies). We use the latest technology and tools to aggregate and analyze specialty healthcare data received from various data partners. We provide clear and hassle-free business insights to enhance the client’s vision and drive business success. Position Title: QA...