Current jobs related to Data Engineering Expert for Large-Scale Projects - Pune, Maharashtra - NCS Group

  • Large Scale Data Ingestion Expert

    3 days ago

    Pune, Maharashtra, India Aventior Digital Private Limited Full time

    As a Large Scale Data Ingestion Expert at Aventior Digital Private Limited, you will be responsible for designing, implementing, and managing mass data ingestion processes into Microsoft SQL Server from diverse data sources. You will work closely with cross-functional teams to define and implement data quality standards and ensure adherence.Main...

  • Large Scale Reconciliation Specialist

    2 days ago

    Pune, Maharashtra, India HCLTech Full time

    Job Description:HCLTech is seeking a Senior Java Architect to lead the design and development of a large-scale reconciliation platform for a leading wholesale bank. As a member of our engineering team, you will work on building a highly scalable, distributed, event-driven platform that meets the needs of our customers.Responsibilities:Design and develop a...

  • Teamcenter Expert

    5 days ago

    Pune, Maharashtra, India Flexiventures Pvt Ltd Full time

    Job Description:We are looking for an experienced PLM Specialist with strong expertise in Teamcenter to lead large-scale migration projects. The ideal candidate will be responsible for designing and executing comprehensive Teamcenter migration strategies that meet business objectives.Key Responsibilities:Design and execute large-scale Teamcenter...

  • Citrix Engineer

    7 days ago

    Pune, Maharashtra, India Axiom Software Solutions Limited Full time

    About the Role:Axiom Software Solutions Limited is seeking a highly skilled Citrix Engineer to join our team. As a Citrix Engineer, you will play a key role in the design, implementation, and maintenance of our large-scale Citrix environment. You will be responsible for ensuring the smooth operation of our virtual desktop infrastructure, providing user...

  • Large Scale Data Solution Architect

    3 days ago

    Pune, Maharashtra, India KPI Partners Full time

    About KPI PartnersKPI Partners is a trusted partner in delivering data, analytics, and AI solutions to clients worldwide.We have a strong presence in cloud-based data engineering solutions on Azure, AWS, Google, Snowflake, and Databricks.Our team of experts is seeking a highly skilled Data Engineer to join their dynamic team at KPI's Bengaluru office. As a...

  • Senior Data Architect for Large-Scale Banking Solutions

    7 days ago

    Pune, Maharashtra, India HCLTech Full time

    HCLTech is seeking a seasoned Senior Big Data Engineer with 10+ years of experience in HDF5, Hive, Impala, and HBase to lead the design, development, and optimization of large-scale data solutions within the banking domain.Key Responsibilities:Architect scalable big data solutions using HDFS, Hive, Impala, and HBaseLead data migration projects ensuring high...

  • Data Engineering Expert

    6 days ago

    Pune, Maharashtra, India Techila global services Full time

    Job Description:">We are seeking a highly skilled Data Engineering Expert to join our team at Techila Global Services. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data pipelines using cloud-based technologies.">The ideal candidate will have a minimum of 8 years of experience in...

  • Expert Data Engineer

    4 weeks ago

    Pune, Maharashtra, India Ciklum Full time

    Description Ciklum is looking for an Expert Data Engineer to join our team full-time in India. We are a custom product engineering company that supports both multinational organizations and scaling startups to solve their most complex business challenges. With a global team of over 4,000 highly skilled developers, consultants, analysts and product...

  • ETL Developer for Large Scale Data Warehousing

    6 days ago

    Pune, Maharashtra, India D-TechWorks Pvt Ltd Full time

    Job Responsibilities:The successful candidate will be responsible for:Designing, developing, and maintaining large-scale data warehousing solutions using SQL Server and SSIS.Developing and optimizing SQL queries, stored procedures, and functions.Troubleshooting and resolving production issues.Documenting data flows, business requirements, and...

  • Cloud-Based Data Governance Expert

    7 days ago

    Pune, Maharashtra, India Capgemini Engineering Full time

    Key Responsibilities">The ideal candidate will have expertise in implementing data validation, governance, and anomaly detection frameworks for large-scale IoT datasets.">About the Job Description">This job description outlines the key responsibilities and required skills for the role of Senior IoT Data Quality Specialist at Capgemini Engineering.">Main...

  • Data Engineering Specialist

    3 days ago

    Pune, Maharashtra, India KPI Partners Full time

    About KPI PartnersKPI Partners is a recognized leader in data, analytics, and AI consulting. We are experts in cloud-based data engineering solutions on Azure, AWS, Google, Snowflake, and Databricks.Founded in 2006, KPI has over 500 consultants and has successfully delivered numerous projects to clients worldwide.We are seeking skilled Data Engineers to join...

  • Data Engineer

    1 day ago

    Pune, Maharashtra, India Hinduja Tech Limited Full time

    At Hinduja Tech Limited, we are seeking a highly skilled Data Engineer to lead our cloud architecture efforts. As a key member of our team, you will be responsible for designing, implementing, and maintaining large-scale data ingestion and ETL pipelines in cloud environments, specifically Azure.We are looking for someone with a strong background in data...

  • Lead Developer for Large Scale Applications

    6 days ago

    Pune, Maharashtra, India Perficient Full time

    As a Lead Developer for Large Scale Applications, you will be responsible for leading the development of complex software systems, collaborating closely with cross-functional teams, and driving technical excellence. With a proven track record of success in full-stack development, front-end technologies, and back-end proficiency in C#, .NET Core, you will be...

  • Chief Data Engineer

    9 hours ago

    Pune, Maharashtra, India ACL Digital Full time

    Job Overview:ACL Digital is seeking an experienced Chief Data Engineer to lead our data engineering efforts. As a key member of our team, you will be responsible for designing and implementing large-scale data projects.The ideal candidate will have a strong understanding of data engineering principles and a proven track record of delivering complex data...

  • Data Modelling Expert

    6 days ago

    Pune, Maharashtra, India Birlasoft Full time

    About Birlasoft:A powerhouse of innovation where domain expertise meets enterprise solutions and digital technologies to drive business success.We pride ourselves on our consultative approach, enabling customers to run businesses with unmatched efficiency and innovation. Our 12,500+ strong team is committed to upholding the Group's legacy, prioritizing...

  • Data Science Expert

    7 days ago

    Pune, Maharashtra, India Saransh Inc Full time

    We are looking for a highly skilled Data Science Expert to join our team at Saransh Inc. As a key member of our data science group, you will be responsible for analyzing large amounts of data and coming up with actionable insights using analytical and statistical methods, programming, and data modeling.The ideal candidate will have at least 5+ years of...

  • Real-Time Data Architect

    7 days ago

    Pune, Maharashtra, India Capgemini Engineering Full time

    Job Summary: We are seeking an experienced Streaming Analytics Engineer to join our team at Capgemini Engineering. As a Streaming Analytics Engineer, you will be responsible for designing and implementing real-time streaming architectures using AWS and Snowflake.Main Responsibilities:Design and implement high-performance streaming architectures for handling...

  • Data Engineering Expert Wanted

    1 day ago

    Pune, Maharashtra, India ACL Digital Full time

    At ACL Digital, we are seeking an experienced Data Engineer Architect to lead our data engineering efforts.ResponsibilitiesLead large-scale data projects and drive innovation in data architecture design and implementation.Develop and maintain high-quality data pipelines and ETL processes using industry-leading tools and technologies.Mentor and guide a team...

  • Data Engineering Expert

    3 days ago

    Pune, Maharashtra, India Energy Exemplar Full time

    Job OverviewWe are looking for a highly skilled Software Engineer (Python) to join our Development team at IDC. The successful candidate will be responsible for delivering quality and performant software and design to handle the vast array of use cases that our customers have today. This role requires a deep understanding of Python programming, data...

  • Data Engineering Expert

    2 days ago

    Pune, Maharashtra, India Upraised Full time

    About the RoleWe are seeking an experienced Data Engineer to join our team at Upraised. As a key member of the team, you will be responsible for designing and implementing scalable data processing systems, leveraging expertise in Azure big data tools. You will work closely with stakeholders to develop large-scale batch and real-time data pipelines on...

Data Engineering Expert for Large-Scale Projects

2 weeks ago

Pune, Maharashtra, India NCS Group Full time

About the role

NCS Group is a leading technology services firm that operates across the Asia Pacific region in over 20 cities, providing consulting, digital services, technology solutions, and more.

We believe in harnessing the power of technology to achieve extraordinary things, creating lasting value and impact for our communities, partners, and people. Our diverse workforce has delivered large-scale, mission-critical, and multi-platform projects for governments and enterprises in Singapore and the APAC region.

Key Responsibilities:

  • Design, develop, and maintain data pipelines: Build and optimize data pipelines and architectures for data ingestion, processing, and integration from various data sources.
  • Work with Azure Data Services: Leverage Azure Data Factory, Azure SQL Database, Azure Data Lake, and other Azure services to manage and store large datasets.
  • Utilize Databricks: Implement and manage data processing workflows using Databricks and Apache Spark for big data processing.
  • SQL Development: Write complex SQL queries and optimize database performance for data retrieval and reporting.
  • Orchestrate workflows with Airflow: Develop and maintain ETL workflows using Apache Airflow to ensure reliable data flow and automation.
  • Data Quality and Governance: Ensure data quality, integrity, and governance through appropriate measures and best practices.
  • Collaborate with stakeholders: Work closely with data scientists, analysts, and business stakeholders to understand data needs and deliver actionable insights.
  • Monitor and troubleshoot: Monitor data pipelines and ETL processes, identify issues, and implement solutions to ensure reliability and performance.

Required Qualifications:

  • Education: Bachelor's degree in Computer Science, Information Technology, or a related field. Master's degree is a plus.
  • Experience: 5+ years of experience in data engineering or a similar role.
  • Technical Skills:
    • Proficient in SQL and experience with relational databases.
    • Hands-on experience with Azure Data Services (Data Factory, SQL Database, Data Lake).
    • Strong experience with Databricks and Apache Spark.
    • Proficient in using Apache Airflow for workflow orchestration.
    • Familiarity with data warehousing concepts and ETL processes.
    • Experience with programming languages such as Python or Scala.
  • Soft Skills:
    • Strong problem-solving skills and attention to detail.
    • Excellent communication and collaboration skills.
    • Ability to work in a fast-paced, agile environment.
    • Strong analytical and organizational skills.