Data Engineer for Large-Scale Data Pipelines
6 days ago
About the Role
NCS Group is a leading technology services firm operating across the Asia Pacific region, providing consulting, digital services, technology solutions, and more. We believe in harnessing the power of technology to achieve extraordinary things and create lasting value and impact for our communities, partners, and people.
We're searching for a talented Data Engineer to be part of our diverse team of experts here at NCS Group. If you're passionate about designing, developing, and maintaining large-scale data pipelines, we'd love to hear from you.
Key Responsibilities:
- Design and develop data pipelines for data ingestion, processing, and integration from various data sources.
- Work with Azure Data Services, including Azure Data Factory, Azure SQL Database, and Azure Data Lake, to manage and store large datasets.
- Implement and manage data processing workflows using Databricks and Apache Spark for big data processing.
- Write complex SQL queries and optimize database performance for data retrieval and reporting.
- Orchestrate workflows with Airflow to ensure reliable data flow and automation.
- Ensure data quality, integrity, and governance through appropriate measures and best practices.
- Collaborate with data scientists, analysts, and business stakeholders to understand data needs and deliver actionable insights.
- Monitor and troubleshoot data pipelines and ETL processes to ensure reliability and performance.
Required Qualifications:
- Bachelor's degree in Computer Science, Information Technology, or a related field.
- Master's degree preferred.
- 5+ years of experience in data engineering or a similar role.
- Proficient in SQL and experienced with relational databases.
- Hands-on experience with Azure Data Services.
- Strong experience with Databricks and Apache Spark.
- Proficient in using Airflow for workflow orchestration.
- Familiarity with data warehousing concepts and ETL processes.
- Experience with programming languages such as Python or Scala.
Benefits:
We offer a collaborative work environment, opportunities for growth and development, and a chance to make a real impact on our clients' businesses. If you're passionate about data engineering and want to join a dynamic team of experts, please submit your application.
About NCS Group
We're committed to creating a talent-led delivery model that enables our best people to lead and support them with the right structure, processes, and tools to deliver top-quality services to our clients. We invest in our people and provide well-defined career tracks and specializations to ensure they can continuously deliver new value for our clients.
-
Large Scale Data Ingestion Specialist
4 days ago
Pune, Maharashtra, India Aventior Digital Private Limited Full timeCompany OverviewAventior is a leading provider of innovative technology solutions for businesses across a wide range of industries.Job DescriptionWe are seeking a seasoned Senior Data Engineer to join our team and lead large-scale data ingestion, cleaning, and standardization into Microsoft SQL Server.Key Responsibilities:Design, implement, and manage mass...
-
Large Scale Data Architect
4 days ago
Pune, Maharashtra, India Undisclosed Full timeAbout the PositionWe are looking for a talented individual to join our team as a Data Engineer at Terra TCC. As a key member of our team, you will be responsible for designing and developing large-scale data processing systems, ensuring high-quality data integration, and collaborating with cross-functional teams to drive business growth.Main...
-
Data Engineer for Cloud Data Pipelines
3 days ago
Pune, Maharashtra, India iXceed Solutions Full timeJob Description:iXceed Solutions is seeking an experienced Data Engineer to design, develop, and optimize end-to-end data pipelines for extracting, transforming, and loading large volumes of data from diverse sources into data warehouses or lakes. Key Responsibilities include:* Designing and developing efficient data processing and storage solutions in AWS...
-
Senior Data Engineer
3 weeks ago
Pune, Maharashtra, India Data Axle Full timeJob Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...
-
Pune, Maharashtra, India NCS Group Full timeAbout the roleNCS Group is a leading technology services firm that operates across the Asia Pacific region in over 20 cities, providing consulting, digital services, technology solutions, and more.We believe in harnessing the power of technology to achieve extraordinary things, creating lasting value and impact for our communities, partners, and people. Our...
-
Data Engineer
3 days ago
Pune, Maharashtra, India HyrEzy Talent Solutions Full timeJob OverviewHyrEzy Talent Solutions is seeking a highly skilled Data Engineer - Pipeline Specialist to join our team. As a key member of our data engineering group, you will be responsible for designing, developing, and maintaining large-scale data pipelines to support business growth and innovation.The ideal candidate will have 4-6 years of experience...
-
Senior Data Pipeline Engineer
6 days ago
Pune, Maharashtra, India Flexi Careers India Private Limited Full time**Job Description**We are seeking a highly skilled Senior Data Pipeline Engineer to join our team at Flexi Careers India Private Limited. This role involves designing, developing, and maintaining scalable data pipelines on Google Cloud Platform (GCP).The ideal candidate will have over 5 years of hands-on experience with GCP, BigQuery, Python, DBT, Terraform,...
-
Data Engineer
3 weeks ago
Pune, Maharashtra, India Telefónica Tech UK&I (Data & AI) Full timeJob DescriptionROLEYou will be working from Office in India, collaborating and socialising with your colleagues across our two UK and Bulgaria Offices.You have experience in managing large-scale Power BI deployments and migrations and are comfortable guiding clients on how to embed actionable BI into their overall data strategies. You will have keen business...
-
Senior Data Engineer
3 days ago
Pune, Maharashtra, India DEVOTREND IT PRIVATE LIMITED Full timeCompany OverviewData engineering is a crucial aspect of our company's growth strategy. We are seeking a highly skilled Senior Data Engineer to join our team. The ideal candidate will have expertise in designing, developing, and maintaining large-scale data pipelines for structured and unstructured data.Key Responsibilities- Design and develop efficient data...
-
Data Pipeline Developer Position
2 days ago
Pune, Maharashtra, India LTIMindtree Full timeData Engineer PositionWe are seeking a highly skilled Data Engineer to join our team at LTIMindtree. As a key member of our data engineering team, you will be responsible for designing, implementing, and maintaining large-scale data pipelines to meet business requirements.Key Responsibilities:1. Design and implement complex ETL processes using Spark, Python,...
-
Data Insights Strategist
6 days ago
Pune, Maharashtra, India ITI Data Full timeAbout the Role: We are seeking a highly skilled Data Insights Strategist to join our team at ITI Data. As a key member of our organization, you will be responsible for developing and maintaining reports, dashboards, and data visualizations, as well as working with ETL tools to support data processing and pipeline automation.The successful candidate will have...
-
IT Data Analyst Lead
7 days ago
Pune, Maharashtra, India ITI Data Full timeJob Overview: We are looking for a skilled IT Data Analyst Lead to join our team at ITI Data. As a key member of our organization, you will be responsible for leading the development and maintenance of reports, dashboards, and data visualizations, as well as working with ETL tools to support data processing and pipeline automation.The successful candidate...
-
Pune, Maharashtra, India HCLTech Full timeHCLTech is seeking a seasoned Senior Big Data Engineer with 10+ years of experience in HDF5, Hive, Impala, and HBase to lead the design, development, and optimization of large-scale data solutions within the banking domain.Key Responsibilities:Architect scalable big data solutions using HDFS, Hive, Impala, and HBaseLead data migration projects ensuring high...
-
15h Left: Tech Lead Data Engineer
4 weeks ago
Pune, Maharashtra, India Data Axle Full timeAbout Data Axle Data Axle Inc has been an industry leader in data marketing solutions sales and research for over 50 years in the USA Data Axle now as an established strategic global centre of excellence in Pune This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and by...
-
iOS Engineer for Large Scale Apps
5 days ago
Pune, Maharashtra, India HSBC Full timeWe're seeking an experienced Technical Lead to join our team of talented iOS engineers. As a key member of our organization, you'll be responsible for leading the development of large-scale iOS applications and driving technical excellence throughout the project lifecycle.About the RoleLead a team of engineers in designing, developing, and deploying complex...
-
Data Engineer
3 days ago
Pune, Maharashtra, India Upraised Full timeResponsibilities : - Design and develop business-critical backend systems using stream processors and high-quality data pipelines. - Assemble large, complex data sets that meet functional / non-functional business requirements. - Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources...
-
Data Engineering Lead
4 days ago
Pune, Maharashtra, India Aventior Digital Private Limited Full timeAbout the RoleWe are seeking a seasoned Data Engineer to spearhead large-scale data ingestion, cleaning, and standardization into Microsoft SQL Server.The ideal candidate will have expertise in designing efficient data pipelines, writing complex stored procedures, and managing ETL processes using SSIS, Azure Data Factory, and Python.Key...
-
Enterprise Data Engineer
11 hours ago
Pune, Maharashtra, India FPL Technologies Full timeFPL Technologies is seeking a skilled Data Engineer to join its team and contribute to the development and optimization of the company's data infrastructure.The successful candidate will have 3+ years of experience in Data Engineering and be proficient in designing, building, and optimizing data pipelines to extract, transform, and load (ETL) data from...
-
Data Engineering Expert
40 minutes ago
Pune, Maharashtra, India Techila global services Full timeJob Description:">We are seeking a highly skilled Data Engineering Expert to join our team at Techila Global Services. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data pipelines using cloud-based technologies.">The ideal candidate will have a minimum of 8 years of experience in...
-
Pune, Maharashtra, India USEReady Full timeJob DescriptionJob SummaryWe are seeking a highly skilled Senior Architect with advanced expertise in Java and Python to design and extend scalable, efficient data pipelines and modernize the C3PO framework to integrate with emerging technologies. The ideal candidate will think holistically and drive architectural excellence across diverse systems while...